2024-08-28T19:57:01.829 INFO:root:teuthology version: 1.2.1.dev4+gcf5021f 2024-08-28T19:57:01.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-28T19:57:01.950 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} email: mchangir@redhat.com first_in_suite: false job_id: '7877790' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 500 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7797 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 139/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqf0gtfiF9dgp/RXvN+RlB9jO3Cqf7JHcPvY2xThgTgpe5v9OPGeKoAu8T59sJMMyc197G0ACtpyIGgnaIK3iA= smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJmVxMjqEzsW2+LlFp51ibwPnjmQF606RyPSRAWHHfoocAWpYPca5yNWyzlTTNJ77ZvkeV4PSZZfPV4CikTcEWQ= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIK4jyiG1li0EPYOCQsSPKvzbJa8nZkqSFQ+iuR0BGjWBmlPr5iahBitJ2sPD9HVqYqTJLN9AE5sDkWk2T6rKrw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cf5021f85c4b0bf435c74a1183036b3d19af44b5 timestamp: 2024-08-28_12:36:35 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-28T19:57:01.950 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-28T19:57:01.951 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-28T19:57:01.951 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-28T19:57:01.952 INFO:teuthology.task.internal:Checking packages... 2024-08-28T19:57:01.973 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-28T19:57:01.973 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-28T19:57:01.974 INFO:teuthology.packaging:ref: None 2024-08-28T19:57:01.974 INFO:teuthology.packaging:tag: None 2024-08-28T19:57:01.974 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-28T19:57:01.974 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:57:01.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-28T19:57:02.120 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-28T19:57:02.122 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-28T19:57:02.128 INFO:teuthology.task.internal:no buildpackages task found 2024-08-28T19:57:02.128 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-28T19:57:02.172 INFO:teuthology.task.internal:Saving configuration 2024-08-28T19:57:02.191 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-28T19:57:02.205 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-28T19:57:02.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-28 19:51:20.129702', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqf0gtfiF9dgp/RXvN+RlB9jO3Cqf7JHcPvY2xThgTgpe5v9OPGeKoAu8T59sJMMyc197G0ACtpyIGgnaIK3iA='} 2024-08-28T19:57:02.269 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-28 19:51:20.132473', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJmVxMjqEzsW2+LlFp51ibwPnjmQF606RyPSRAWHHfoocAWpYPca5yNWyzlTTNJ77ZvkeV4PSZZfPV4CikTcEWQ='} 2024-08-28T19:57:02.296 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-28 19:51:20.131175', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIK4jyiG1li0EPYOCQsSPKvzbJa8nZkqSFQ+iuR0BGjWBmlPr5iahBitJ2sPD9HVqYqTJLN9AE5sDkWk2T6rKrw='} 2024-08-28T19:57:02.297 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-28T19:57:02.303 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-28T19:57:02.303 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-28T19:57:02.303 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-28T19:57:02.303 INFO:teuthology.run_tasks:Running task console_log... 2024-08-28T19:57:02.432 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c2a8d6f80>, signals=[15]) 2024-08-28T19:57:02.432 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-28T19:57:02.438 INFO:teuthology.task.internal:Opening connections... 2024-08-28T19:57:02.438 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T19:57:02.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:57:02.543 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-08-28T19:57:02.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:57:02.628 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-08-28T19:57:02.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:57:02.712 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-28T19:57:02.718 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-08-28T19:57:02.737 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-08-28T19:57:02.738 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-08-28T19:57:02.795 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-08-28T19:57:02.795 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-08-28T19:57:02.795 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-08-28T19:57:02.795 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-08-28T19:57:02.795 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-28T19:57:02.796 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-28T19:57:02.797 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-08-28T19:57:02.828 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-08-28T19:57:02.846 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-08-28T19:57:02.847 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-08-28T19:57:02.904 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-28T19:57:02.905 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-28T19:57:02.906 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-28T19:57:02.906 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-08-28T19:57:02.936 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-08-28T19:57:02.954 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-08-28T19:57:02.955 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-08-28T19:57:03.012 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-28T19:57:03.013 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-08-28T19:57:03.013 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-28T19:57:03.013 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-28T19:57:03.013 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-28T19:57:03.013 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-08-28T19:57:03.045 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-28T19:57:03.055 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-28T19:57:03.088 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-28T19:57:03.089 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-08-28T19:57:03.091 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-08-28T19:57:03.094 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-08-28T19:57:03.110 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-28T19:57:03.116 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-28T19:57:03.116 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-08-28T19:57:03.149 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-08-28T19:57:03.151 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-08-28T19:57:03.179 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-28T19:57:03.287 INFO:teuthology.run_tasks:Running task kernel... 2024-08-28T19:57:03.300 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-28T19:57:03.300 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-08-28T19:57:03.300 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-08-28T19:57:03.300 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-28T19:57:03.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:57:03.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-28T19:57:03.515 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-28T19:57:03.515 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8ad8b8b160987a14eb199bb67cc00e23a08d43f6"... 2024-08-28T19:57:03.516 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-08-28T19:57:03.533 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-496.el9.x86_64 2024-08-28T19:57:03.533 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-496.el9.x86_64 vs 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-28T19:57:03.534 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-28T19:57:03.534 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum upgrade -y linux-firmware 2024-08-28T19:57:13.231 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.2 MB 00:07 2024-08-28T19:57:22.188 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-08-28T19:57:33.624 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 899 kB/s | 6.6 MB 00:07 2024-08-28T19:57:35.518 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 18 kB 00:00 2024-08-28T19:57:36.297 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 35 MB/s | 22 MB 00:00 2024-08-28T19:57:41.894 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-28T19:57:44.196 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-08-28T19:57:44.197 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-08-28T19:57:44.197 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-08-28T19:57:44.289 INFO:teuthology.task.kernel:Downloading kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-28T19:57:44.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-28T19:57:44.453 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ 2024-08-28T19:57:44.453 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-28T19:57:44.456 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi001.front.sepia.ceph.com to complete... 2024-08-28T19:57:50.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28 19:57:50 URL:https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm [359646365/359646365] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-28T19:57:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:FINISHED --2024-08-28 19:57:50-- 2024-08-28T19:57:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:Total wall clock time: 6.4s 2024-08-28T19:57:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:Downloaded: 1 files, 343M in 6.1s (56.4 MB/s) 2024-08-28T19:57:50.852 INFO:teuthology.task.kernel:Installing kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-28T19:57:50.853 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-28T19:57:53.083 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying... ######################################## 2024-08-28T19:57:53.238 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing... ######################################## 2024-08-28T19:57:53.352 INFO:teuthology.orchestra.run.smithi001.stdout:Updating / installing... 2024-08-28T19:58:01.676 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-6.11.0_rc5_g8ad8b8b16098-1 ######################################## 2024-08-28T19:58:41.459 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-28T19:58:41.460 DEBUG:teuthology.orchestra.run.smithi001:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/boot/System.map-6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/boot/config-6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/System.map 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/config 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto 2024-08-28T19:58:41.531 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-28T19:58:41.532 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-28T19:58:41.533 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ansi_cprng.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/anubis.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/arc4.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_memcpy.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_pq.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_tx.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_xor.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/raid6test.ko 2024-08-28T19:58:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authenc.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authencesn.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blake2b_generic.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_common.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_generic.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/camellia_generic.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast5_generic.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast6_generic.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast_common.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ccm.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cmac.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crc32_generic.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_engine.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_user.ko 2024-08-28T19:58:41.535 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cts.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/des_generic.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/dh_generic.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecc.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecdh_generic.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/echainiv.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/essiv.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/fcrypt.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/khazad.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4hc.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/md4.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/michael_mic.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcbc.ko 2024-08-28T19:58:41.536 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcrypt.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/rmd160.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/seed.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/serpent_generic.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tcrypt.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tea.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_common.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_generic.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/vmac.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/wp512.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xcbc.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xor.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xxhash_generic.ko 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers 2024-08-28T19:58:41.537 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_pad.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ec_sys.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/platform_profile.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbs.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbshc.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/video.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/acard-ahci.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci_platform.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ata_generic.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci_platform.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_acpi.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ali.ko 2024-08-28T19:58:41.538 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_amd.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_artop.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atiixp.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atp867x.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd640.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd64x.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cypress.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_efar.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt366.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt37x.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it8213.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it821x.ko 2024-08-28T19:58:41.539 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_jmicron.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_marvell.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_mpiix.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_netcell.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ninja32.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87410.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87415.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_oldpiix.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_opti.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_optidma.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pcmcia.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-28T19:58:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_piccolo.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rdc.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sch.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_serverworks.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sil680.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sis.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sl82c105.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_triflex.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_via.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pdc_adma.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_inic162x.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_mv.ko 2024-08-28T19:58:41.541 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_nv.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_promise.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_qstor.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil24.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sis.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_svw.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sx4.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_uli.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_via.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_vsc.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ks0108.ko 2024-08-28T19:58:41.542 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/bcma.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/aoe.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/brd.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/drbd.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/floppy.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/loop.ko 2024-08-28T19:58:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/nbd.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/null_blk.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/pktcdvd.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/rbd.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/virtio_blk.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkfront.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/zram.ko 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char 2024-08-28T19:58:41.544 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hangcheck-timer.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/via-rng.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-28T19:58:41.545 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/lp.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/mwave.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ppdev.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tlclk.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/uv_mmtimer.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/virtio_console.ko 2024-08-28T19:58:41.546 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp.ko 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat 2024-08-28T19:58:41.547 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-aes.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-sha.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/dca.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw 2024-08-28T19:58:41.548 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/amd64_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/e752x_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/edac_mce_amd.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3000_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3200_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5100_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5400_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7300_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7core_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i82975x_edac.ko 2024-08-28T19:58:41.549 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ie31200_edac.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/sb_edac.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/x38_edac.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/edd.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ich.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-appleir.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-aureal.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-axff.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-dr.ko 2024-08-28T19:58:41.550 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elecom.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elo.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-emsff.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gaff.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gt683r.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gyration.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtekff.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-hyperv.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-icade.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-keytouch.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kye.ko 2024-08-28T19:58:41.551 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lcpower.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-led.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lenovo.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-multitouch.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ortek.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-penmount.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-petalynx.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-picolcd.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-pl.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-plantronics.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-primax.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-rmi.ko 2024-08-28T19:58:41.552 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-common.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-saitek.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-samsung.ko 2024-08-28T19:58:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sjoy.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sony.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-speedlink.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-steelseries.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sunplus.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tivo.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tmff.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-topseed.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-twinhan.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-uclogic.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-waltop.ko 2024-08-28T19:58:41.554 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-wiimote.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-xinmo.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zpff.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zydacron.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/uhid.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/wacom.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_balloon.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_utils.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_vmbus.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru3.ko 2024-08-28T19:58:41.555 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7414.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7418.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adc128d818.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1025.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1026.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1029.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1031.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm9240.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ads7828.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7410.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7411.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7462.ko 2024-08-28T19:58:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7470.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7475.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7x10.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/amc6821.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/applesmc.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asb100.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asc7621.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/atxp1.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/coretemp.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dme1737.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds1621.ko 2024-08-28T19:58:41.557 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds620.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc1403.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc6w201.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71805f.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71882fg.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f75375s.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fam15h_power.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fschmd.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g760a.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g762.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl518sm.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl520sm.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5500_temp.ko 2024-08-28T19:58:41.558 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5k_amb.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmaem.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmpex.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina209.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina2xx.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/it87.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k10temp.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k8temp.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lineage-pem.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm63.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm73.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm75.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm77.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm78.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm80.ko 2024-08-28T19:58:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm83.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm85.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm87.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm90.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm92.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm93.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95234.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95241.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95245.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc2945.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4151.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4215.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4222.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4245.ko 2024-08-28T19:58:41.560 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4260.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4261.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max16065.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1619.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1668.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max197.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6639.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6650.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6697.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mcp3021.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6683.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775-core.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct7802.ko 2024-08-28T19:58:41.561 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87360.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87427.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pcf8591.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-28T19:58:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/powr1220.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5627.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5636.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht15.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht21.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/shtc1.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sis5595.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47b397.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m1.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m192.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/thmc50.ko 2024-08-28T19:58:41.563 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp102.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp103.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp401.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp421.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via-cputemp.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via686a.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt1211.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt8231.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627ehf.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627hf.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83781d.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83791d.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83792d.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83793.ko 2024-08-28T19:58:41.564 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83795.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l785ts.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l786ng.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-28T19:58:41.565 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-28T19:58:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-dev.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-mux.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-smbus.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-stub.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_core.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-28T19:58:41.567 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp 2024-08-28T19:58:41.568 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-28T19:58:41.569 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/gameport.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/joydev.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/appletouch.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/bcm5974.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/cyapatp.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/sermouse.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-28T19:58:41.570 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/altera_ps2.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/arc_ps2.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serio_raw.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/sparse-keymap.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-blinkm.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3530.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp3944.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-ss4200.ko 2024-08-28T19:58:41.571 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/bcache.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bio-prison.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache-smq.ko 2024-08-28T19:58:41.572 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-crypt.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-delay.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-flakey.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log-userspace.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-multipath.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-queue-length.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-raid.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-round-robin.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-service-time.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-switch.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-thin-pool.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-verity.ko 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data 2024-08-28T19:58:41.573 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid0.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid1.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid10.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid456.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptbase.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptctl.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptfc.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptlan.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptsas.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptscsih.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptspi.ko 2024-08-28T19:58:41.574 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_ich.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_sch.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mfd-core.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/sm501.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/viperboard.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/vx855.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wl1273-core.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds9802als.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds990x.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/bh1770glc.ko 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710 2024-08-28T19:58:41.575 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/cb710.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/at24.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/max6875.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/enclosure.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hpilo.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29003.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29020.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei 2024-08-28T19:58:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-me.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-txe.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_7xx1.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_core.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tsl2550.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_balloon.ko 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci 2024-08-28T19:58:41.577 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/bonding.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dummy.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/eql.ko 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com 2024-08-28T19:58:41.578 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon 2024-08-28T19:58:41.579 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-28T19:58:41.580 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-28T19:58:41.581 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-28T19:58:41.582 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dnet.ko 2024-08-28T19:58:41.583 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ethoc.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fealnx.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e 2024-08-28T19:58:41.584 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-28T19:58:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/jme.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox 2024-08-28T19:58:41.586 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-28T19:58:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-28T19:58:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc 2024-08-28T19:58:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-28T19:58:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-28T19:58:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/geneve.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ifb.ko 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan 2024-08-28T19:58:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvlan.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvtap.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mii.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/net_failover.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/netconsole.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/nlmon.ko 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs 2024-08-28T19:58:41.593 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/amd.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm87xx.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/broadcom.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/cicada.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/davicom.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/dp83640.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/et1011c.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/icplus.ko 2024-08-28T19:58:41.594 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/lxt.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/marvell.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/micrel.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/national.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/phylink.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/qsemi.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/realtek.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/smsc.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ste10Xp.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/vitesse.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_async.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-28T19:58:41.595 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppoe.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppox.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pptp.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slhc.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slip.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/sungem_phy.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tap.ko 2024-08-28T19:58:41.596 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_random.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tun.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/veth.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/virtio_net.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-28T19:58:41.597 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/vxlan.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netfront.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ntb.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme-core.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_cs.ko 2024-08-28T19:58:41.598 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_pc.ko 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_serial.ko 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/xen-pcifront.ko 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/i82092.ko 2024-08-28T19:58:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pd6729.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acerhdf.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-28T19:58:41.600 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/hdaps.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel_ips.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-28T19:58:41.601 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-28T19:58:41.602 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps_parport.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/pps_core.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp_kvm.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/fmpm.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-28T19:58:41.603 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-em3027.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-28T19:58:41.604 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max6900.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-28T19:58:41.605 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-x1205.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-9xxx.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-sas.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-xxxx.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/BusLogic.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/a100u2w.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/advansys.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-28T19:58:41.606 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/am53c974.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/atp870u.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/bfa.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ch.ko 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor 2024-08-28T19:58:41.607 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-28T19:58:41.608 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi 2024-08-28T19:58:41.608 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-28T19:58:41.608 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dc395x.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dmx3191d.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esp_scsi.ko 2024-08-28T19:58:41.609 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/fnic.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hpsa.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hptiop.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hv_storvsc.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/initio.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ipr.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ips.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/isci.ko 2024-08-28T19:58:41.610 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/libfc.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/libsas.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-28T19:58:41.611 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvumi.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pmcraid.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla1280.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx 2024-08-28T19:58:41.612 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/raid_class.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_debug.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ses.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/st.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/stex.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-28T19:58:41.613 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/virtio_scsi.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/wd719x.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ssb.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_file.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_iblock.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_mod.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_pscsi.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_user.ko 2024-08-28T19:58:41.614 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-28T19:58:41.615 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-28T19:58:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-28T19:58:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-28T19:58:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-28T19:58:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-28T19:58:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-28T19:58:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-28T19:58:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-28T19:58:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-28T19:58:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-28T19:58:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_gsm.ko 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_hdlc.ko 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/nozomi.ko 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/arc_uart.ko 2024-08-28T19:58:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio 2024-08-28T19:58:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_aec.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_cif.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pci_generic.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_sercos3.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-acm.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-28T19:58:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usblp.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usbtmc.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/mdc800.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/microtek.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/adutux.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/appledisplay.ko 2024-08-28T19:58:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi26.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi62.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ezusb.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/idmouse.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/iowarrior.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ldusb.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/legousbtower.ko 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga 2024-08-28T19:58:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usb3503.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usblcd.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/uss720.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/yurex.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-generic.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/aircable.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ark3116.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ch341.ko 2024-08-28T19:58:41.623 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cp210x.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cyberjack.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/empeg.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_ti.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipaq.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipw.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ir-usb.ko 2024-08-28T19:58:41.624 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mct_u232.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7720.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7840.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/navman.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/omninet.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/opticon.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/option.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/oti6858.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/pl2303.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcaux.ko 2024-08-28T19:58:41.625 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcserial.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/quatech2.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/safe_serial.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/sierra.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ssu100.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/symbolserial.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_debug.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/visor.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/whiteheat.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage 2024-08-28T19:58:41.626 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/uas.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-karma.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-28T19:58:41.627 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/usb-storage.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-28T19:58:41.628 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_net.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_scsi.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/apple_bl.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lcd.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_balloon.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_mmio.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-28T19:58:41.629 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_ring.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2482.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2490.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-28T19:58:41.630 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/wire.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/hpwdt.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/i6300esb.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ib700wdt.ko 2024-08-28T19:58:41.631 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ibmasr.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it87_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/machzwd.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/nv_tco.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/softdog.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/via_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-28T19:58:41.632 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wdt_pci.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/xen_wdt.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-evtchn.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntalloc.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntdev.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-privcmd.ko 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs 2024-08-28T19:58:41.633 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/9p.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/affs.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/befs.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/binfmt_misc.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/btrfs.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/cachefiles.ko 2024-08-28T19:58:41.634 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ceph.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/coda.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/cramfs.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/dlm.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/f2fs.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/fat.ko 2024-08-28T19:58:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/msdos.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/vfat.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/cuse.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/fuse.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/gfs2.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/hfs.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/hfsplus.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/isofs.ko 2024-08-28T19:58:41.636 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/jfs.ko 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/lockd.ko 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/minix.ko 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/netfs.ko 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-28T19:58:41.637 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfs.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv3.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv4.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/grace.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/nfs_acl.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/nfsd.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/nilfs2.ko 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls 2024-08-28T19:58:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-celtic.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-centeuro.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-croatian.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-cyrillic.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-gaelic.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-greek.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-iceland.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-inuit.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-roman.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-romanian.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-turkish.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1250.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1251.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1255.ko 2024-08-28T19:58:41.639 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp737.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp775.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp850.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp852.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp855.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp857.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp860.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp861.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp862.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp863.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp864.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp865.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp866.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp869.ko 2024-08-28T19:58:41.640 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp874.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp932.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp936.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp949.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp950.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_euc-jp.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-1.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-13.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-14.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-15.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-2.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-3.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-4.ko 2024-08-28T19:58:41.641 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-5.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-6.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-7.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-9.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-r.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-ru.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-u.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_utf8.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm 2024-08-28T19:58:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/overlay.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ramoops.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/reiserfs.ko 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs 2024-08-28T19:58:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/romfs.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/cifs.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_arc4.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_md4.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/squashfs.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/sysv.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/udf.ko 2024-08-28T19:58:41.644 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ufs.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/xfs.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu/rcutorture.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/torture.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/asn1_encoder.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc-itu-t.ko 2024-08-28T19:58:41.645 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc8.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libaescfb.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libarc4.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libdes.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/libcrc32c.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lru_cache.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4_compress.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4hc_compress.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/cordic.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/raid6_pq.ko 2024-08-28T19:58:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_bm.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_fsm.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_kmp.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd/zstd_compress.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/hwpoison-inject.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/6lowpan.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_dest.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_fragment.ko 2024-08-28T19:58:41.647 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_hop.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_mobility.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_routing.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_udp.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/garp.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/mrp.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/p8022.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/psnap.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/stp.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/8021q.ko 2024-08-28T19:58:41.648 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_fd.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_rdma.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_virtio.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/batman-adv.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/br_netfilter.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/bridge.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-28T19:58:41.649 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-28T19:58:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtables.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/libceph.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/failover.ko 2024-08-28T19:58:41.651 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/pktgen.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_diag.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv4.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv6.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver/dns_resolver.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/dsa_core.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_brcm.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_dsa.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_none.ko 2024-08-28T19:58:41.652 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_trailer.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ah4.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/esp4.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/fou.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/gre.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/inet_diag.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_gre.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_tunnel.ko 2024-08-28T19:58:41.653 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_vti.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipcomp.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipip.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-28T19:58:41.654 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_bic.ko 2024-08-28T19:58:41.655 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_dctcp.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_diag.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_highspeed.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_htcp.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_hybla.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_illinois.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_lp.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_scalable.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_vegas.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_veno.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_westwood.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_yeah.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tunnel4.ko 2024-08-28T19:58:41.656 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_diag.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_tunnel.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ah6.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/esp6.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/fou6.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_tunnel.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_vti.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ipcomp6.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-28T19:58:41.657 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-28T19:58:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/sit.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/tunnel6.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/af_key.ko 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp 2024-08-28T19:58:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_core.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_eth.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip6.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_netlink.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ppp.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/mac802154.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/mpls_gso.ko 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset 2024-08-28T19:58:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-28T19:58:41.661 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-28T19:58:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conncount.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-28T19:58:41.663 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_log_syslog.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_irc.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_sip.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-28T19:58:41.664 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_tables.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_log.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_chain_nat.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_compat.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_ct.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fib.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_hash.ko 2024-08-28T19:58:41.665 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_limit.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_log.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_masq.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_nat.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_numgen.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_queue.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_quota.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_redir.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject_inet.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_socket.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_tunnel.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_AUDIT.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-28T19:58:41.666 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CT.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_DSCP.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HL.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HMARK.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LED.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LOG.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NETMAP.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFLOG.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_RATEEST.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_SECMARK.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-28T19:58:41.667 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TEE.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TPROXY.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TRACE.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_addrtype.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_bpf.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cgroup.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cluster.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_comment.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connbytes.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlabel.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlimit.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connmark.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_conntrack.ko 2024-08-28T19:58:41.668 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cpu.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dccp.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_devgroup.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dscp.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ecn.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_esp.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hashlimit.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_helper.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hl.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipcomp.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_iprange.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipvs.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_l2tp.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_length.ko 2024-08-28T19:58:41.669 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_limit.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mac.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mark.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_multiport.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nat.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nfacct.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_osf.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_owner.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_physdev.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_pkttype.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_policy.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_quota.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_rateest.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_realm.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_recent.ko 2024-08-28T19:58:41.670 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_sctp.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_set.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_socket.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_state.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_statistic.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_string.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpmss.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_time.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_u32.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/netlink_diag.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/nsh.ko 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch 2024-08-28T19:58:41.671 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/openvswitch.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-geneve.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-gre.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-vxlan.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/af_packet_diag.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_rdma.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_tcp.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_csum.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_gact.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_mirred.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_nat.ko 2024-08-28T19:58:41.672 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_pedit.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_police.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_simple.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_skbedit.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_vlan.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_basic.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_bpf.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_flow.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_fw.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_route.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_u32.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_cmp.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_ipset.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_meta.ko 2024-08-28T19:58:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_nbyte.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_text.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_u32.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_choke.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_codel.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_drr.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_gred.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hfsc.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hhf.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_htb.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_ingress.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio_lib.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_multiq.ko 2024-08-28T19:58:41.674 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_netem.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_pie.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_plug.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_prio.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_qfq.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_red.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfb.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfq.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_tbf.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_teql.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp_diag.ko 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss 2024-08-28T19:58:41.675 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/sunrpc.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc_diag.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/unix_diag.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-28T19:58:41.676 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys/trusted.ko 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias.bin 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.alias.bin 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.bin 2024-08-28T19:58:41.677 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.modinfo 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep.bin 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.devname 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.order 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.softdep 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols.bin 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.weakdep 2024-08-28T19:58:41.678 INFO:teuthology.orchestra.run.smithi001.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-08-28T19:58:41.682 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.682 DEBUG:teuthology.orchestra.run.smithi001:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout:postinstall scriptlet (using /bin/sh): 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g8ad8b8b16098 /lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout:for file in vmlinuz System.map config; do 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098"; then 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout: cp "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098" 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout: fi 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout:done 2024-08-28T19:58:41.705 INFO:teuthology.orchestra.run.smithi001.stdout:if [ -d "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" ] && \ 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" >/dev/null 2>&1; then 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout: cp -r "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep" ]; then 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout: /usr/sbin/depmod 6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-install remove 6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:fi 2024-08-28T19:58:41.707 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-08-28T19:58:41.779 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-08-28T19:58:41.779 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-08-28T19:58:41.779 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-08-28T19:58:41.779 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 21 Aug 2024 09:12:29 PM UTC 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-08-28T19:58:41.780 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T19:58:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-28T19:58:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-28T19:58:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-28T19:58:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-08-28T19:58:41.781 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T19:58:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-08-28T19:58:41.782 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-28T19:58:41.782 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:41.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-28T19:58:42.398 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-08-28T19:58:43.807 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-28T19:58:43.847 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-08-28T19:58:43.855 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-08-28T19:58:43.870 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.P6FKcZibae 2024-08-28T19:58:43.871 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.P6FKcZibae 2024-08-28T19:58:43.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.P6FKcZibae 2024-08-28T19:58:44.074 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.P6FKcZibae is 6KB 2024-08-28T19:58:44.123 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.P6FKcZibae 2024-08-28T19:58:44.137 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-08-28T19:58:44.200 INFO:teuthology.orchestra.run.smithi001.stdout:7acb1e34f9714b649e59f4e98f1746e5-0-rescue.conf 2024-08-28T19:58:44.200 INFO:teuthology.orchestra.run.smithi001.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-239.el9.x86_64.conf 2024-08-28T19:58:44.200 INFO:teuthology.orchestra.run.smithi001.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-496.el9.x86_64.conf 2024-08-28T19:58:44.200 INFO:teuthology.orchestra.run.smithi001.stdout:7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc5-g8ad8b8b16098.conf 2024-08-28T19:58:44.201 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default 7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc5-g8ad8b8b16098 2024-08-28T19:58:44.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-08-28T19:59:14.362 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-28T19:59:14.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-08-28T19:59:14.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:59:32.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-08-28T19:59:41.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-08-28T19:59:41.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T20:00:41.938 DEBUG:teuthology.orchestra.remote:timed out 2024-08-28T20:00:53.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-08-28T20:00:53.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T20:00:54.313 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-08-28T20:00:54.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-08-28T20:00:54.871 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g8ad8b8b16098"... 2024-08-28T20:00:54.871 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-08-28T20:00:54.906 INFO:teuthology.orchestra.run.smithi001.stdout:6.11.0-rc5-g8ad8b8b16098 2024-08-28T20:00:54.906 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g8ad8b8b16098 vs 6.11.0-rc5-g8ad8b8b16098 2024-08-28T20:00:54.906 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-28T20:00:54.906 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-28T20:00:55.908 DEBUG:teuthology.parallel:result is None 2024-08-28T20:00:55.908 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-28T20:00:55.915 INFO:teuthology.task.internal:Creating test directory... 2024-08-28T20:00:55.916 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-28T20:00:55.920 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-28T20:00:55.923 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-28T20:00:55.954 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-28T20:00:55.963 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-28T20:00:55.994 INFO:teuthology.task.internal:Creating archive directory... 2024-08-28T20:00:55.994 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-28T20:00:55.999 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-28T20:00:56.001 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-28T20:00:56.047 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-28T20:00:56.053 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-28T20:00:56.054 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-28T20:00:56.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:00:56.080 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-28T20:00:56.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:00:56.098 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-28T20:00:56.102 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-28T20:00:56.123 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-28T20:00:56.156 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T20:00:56.171 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T20:00:56.188 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T20:00:56.199 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T20:00:56.204 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T20:00:56.227 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T20:00:56.230 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-28T20:00:56.237 INFO:teuthology.task.internal:Configuring sudo... 2024-08-28T20:00:56.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-28T20:00:56.241 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-28T20:00:56.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-28T20:00:56.294 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-28T20:00:56.304 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-28T20:00:56.304 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-28T20:00:56.309 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-28T20:00:56.313 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-28T20:00:56.339 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T20:00:56.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T20:00:56.520 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T20:00:56.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T20:00:56.653 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:00:56.654 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-28T20:00:56.708 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T20:00:56.763 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T20:00:56.813 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T20:00:56.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T20:00:56.941 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:00:56.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-28T20:00:57.008 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T20:00:57.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T20:00:57.114 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T20:00:57.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T20:00:57.203 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:00:57.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-28T20:00:57.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-08-28T20:00:57.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-08-28T20:00:57.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-08-28T20:00:57.306 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T20:00:57.341 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T20:00:57.353 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T20:00:57.788 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-28T20:00:57.800 INFO:teuthology.task.internal:Starting timer... 2024-08-28T20:00:57.800 INFO:teuthology.run_tasks:Running task pcp... 2024-08-28T20:00:57.840 INFO:teuthology.run_tasks:Running task selinux... 2024-08-28T20:00:57.888 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-28T20:00:57.889 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-08-28T20:00:57.971 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-08-28T20:00:57.975 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-08-28T20:00:58.031 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-08-28T20:00:58.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-08-28T20:00:58.105 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-08-28T20:00:58.107 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-28T20:00:58.108 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-08-28T20:00:58.158 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-08-28T20:00:58.159 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-08-28T20:00:58.182 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-08-28T20:00:58.182 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-08-28T20:00:58.203 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-08-28T20:00:58.204 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2024-08-28T20:00:58.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T20:00:58.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:00:58.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T20:00:58.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:00:58.290 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T20:00:58.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:00:58.325 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-28T20:00:58.325 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-08-28T20:00:58.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-08-28T20:00:58.424 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-08-28T20:00:58.450 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-28T20:00:58.462 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-28T20:00:58.474 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-28T20:00:58.475 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi007.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-28T20:03:31.136 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-08-28T20:03:31.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-08-28T20:03:31.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T20:03:31.234 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-08-28T20:03:31.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-08-28T20:03:31.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-28T20:03:31.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T20:03:31.425 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-08-28T20:03:31.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-08-28T20:03:31.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-28T20:03:31.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T20:03:31.586 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-08-28T20:03:31.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-28T20:03:31.665 INFO:teuthology.run_tasks:Running task clock... 2024-08-28T20:03:31.676 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-28T20:03:31.676 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-28T20:03:31.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T20:03:31.680 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-28T20:03:31.681 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T20:03:31.683 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-28T20:03:31.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T20:03:31.712 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-28T20:03:31.727 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-28T20:03:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-28T20:03:31.738 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-28T20:03:31.749 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-28T20:03:31.753 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-08-28T20:03:31.764 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-08-28T20:03:31.768 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-28T20:03:31.773 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-08-28T20:03:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-28T20:03:31.784 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-08-28T20:03:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-28T20:03:31.798 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-28T20:03:31.812 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-28T20:03:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-08-28T20:03:31.844 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-08-28T20:03:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-08-28T20:03:31.851 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T20:03:31.851 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-08-28T20:03:31.851 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.852 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.852 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.852 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.871 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-08-28T20:03:31.873 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-28T20:03:31.874 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T20:03:31.874 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-08-28T20:03:31.875 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.875 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.875 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.875 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-28T20:03:32.000 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-08-28T20:03:32.007 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T20:03:32.007 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-08-28T20:03:32.007 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:32.007 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:32.007 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:32.007 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:03:32.008 INFO:teuthology.run_tasks:Running task install... 2024-08-28T20:03:32.016 DEBUG:teuthology.task.install:project ceph 2024-08-28T20:03:32.016 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-28T20:03:32.016 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-28T20:03:32.017 INFO:teuthology.task.install:Using flavor: default 2024-08-28T20:03:32.022 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-28T20:03:32.022 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-28T20:03:32.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-28T20:03:32.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:03:32.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-28T20:03:32.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:03:32.026 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-28T20:03:32.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:03:32.178 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-28T20:03:32.178 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-28T20:03:32.190 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-28T20:03:32.190 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-28T20:03:32.191 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-28T20:03:32.191 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-28T20:03:32.297 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-28T20:03:32.298 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:03:32.298 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-28T20:03:32.309 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-28T20:03:32.309 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:03:32.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-28T20:03:32.319 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-28T20:03:32.320 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:03:32.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-28T20:03:32.336 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-28T20:03:32.336 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-28T20:03:32.348 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-28T20:03:32.349 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-28T20:03:32.355 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-28T20:03:32.356 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-28T20:03:32.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-28T20:03:32.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-28T20:03:32.454 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-28T20:03:32.478 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-28T20:03:32.492 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-28T20:03:32.533 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-28T20:03:32.543 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-08-28T20:03:32.544 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-08-28T20:03:32.557 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-08-28T20:03:32.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-08-28T20:03:32.588 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-08-28T20:03:32.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-08-28T20:03:32.768 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-08-28T20:03:32.794 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-08-28T20:03:32.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-28T20:03:32.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-28T20:03:32.881 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-08-28T20:03:32.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-28T20:03:33.345 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-08-28T20:03:33.363 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-08-28T20:03:33.629 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-28T20:03:33.647 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-08-28T20:03:33.701 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 224 kB/s | 84 kB 00:00 2024-08-28T20:03:33.905 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-08-28T20:03:33.913 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-28T20:03:34.009 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2024-08-28T20:03:34.302 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-08-28T20:03:41.138 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.2 MB 00:07 2024-08-28T20:03:41.241 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.2 MB 00:07 2024-08-28T20:03:41.451 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.2 MB 00:07 2024-08-28T20:03:44.184 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-08-28T20:03:49.153 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 20 MB 00:06 2024-08-28T20:03:49.691 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-08-28T20:03:55.228 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 928 kB/s | 6.6 MB 00:07 2024-08-28T20:03:56.848 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 18 kB 00:00 2024-08-28T20:03:57.935 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-28T20:04:01.206 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 856 kB/s | 6.6 MB 00:07 2024-08-28T20:04:01.899 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 811 kB/s | 6.6 MB 00:08 2024-08-28T20:04:02.759 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 18 kB 00:00 2024-08-28T20:04:03.332 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-28T20:04:03.410 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 18 kB 00:00 2024-08-28T20:04:03.622 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-28T20:04:04.239 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 32 MB/s | 22 MB 00:00 2024-08-28T20:04:05.603 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T20:04:05.604 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T20:04:05.617 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-28T20:04:05.618 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-28T20:04:05.619 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-28T20:04:05.620 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-28T20:04:05.622 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-28T20:04:05.625 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-28T20:04:05.626 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-28T20:04:05.690 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-28T20:04:05.725 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-28T20:04:05.725 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-28T20:04:05.726 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-28T20:04:05.727 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-28T20:04:05.728 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: libblkid x86_64 2.37.4-20.el9 baseos 107 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: libfdisk x86_64 2.37.4-20.el9 baseos 154 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: libmount x86_64 2.37.4-20.el9 baseos 135 k 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-28T20:04:05.729 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: libsmartcols x86_64 2.37.4-20.el9 baseos 63 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid x86_64 2.37.4-20.el9 baseos 28 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-4.el9 baseos 1.3 M 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-4.el9 baseos 2.4 M 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux x86_64 2.37.4-20.el9 baseos 2.3 M 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-core x86_64 2.37.4-20.el9 baseos 464 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-user x86_64 2.37.4-20.el9 baseos 30 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-28T20:04:05.730 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-28T20:04:05.731 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-28T20:04:05.732 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-28T20:04:05.733 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-28T20:04:05.734 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-28T20:04:05.735 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-28T20:04:05.736 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-28T20:04:05.737 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-28T20:04:05.738 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 12 Packages 2024-08-28T20:04:05.739 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:04:05.740 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 231 M 2024-08-28T20:04:05.740 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-28T20:04:06.434 INFO:teuthology.orchestra.run.smithi121.stdout:(1/160): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-08-28T20:04:06.626 INFO:teuthology.orchestra.run.smithi121.stdout:(2/160): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.5 MB/s | 874 kB 00:00 2024-08-28T20:04:06.718 INFO:teuthology.orchestra.run.smithi121.stdout:(3/160): ceph-immutable-object-cache-19.3.0-456 1.6 MB/s | 148 kB 00:00 2024-08-28T20:04:06.792 INFO:teuthology.orchestra.run.smithi121.stdout:(4/160): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-28T20:04:06.893 INFO:teuthology.orchestra.run.smithi121.stdout:(5/160): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 15 MB/s | 1.5 MB 00:00 2024-08-28T20:04:06.968 INFO:teuthology.orchestra.run.smithi121.stdout:(6/160): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-08-28T20:04:07.352 INFO:teuthology.orchestra.run.smithi121.stdout:(7/160): ceph-common-19.3.0-4560.gd19e6118.el9. 19 MB/s | 20 MB 00:01 2024-08-28T20:04:07.427 INFO:teuthology.orchestra.run.smithi121.stdout:(8/160): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 9.2 MB/s | 4.9 MB 00:00 2024-08-28T20:04:07.469 INFO:teuthology.orchestra.run.smithi121.stdout:(9/160): ceph-selinux-19.3.0-4560.gd19e6118.el9 606 kB/s | 25 kB 00:00 2024-08-28T20:04:07.753 INFO:teuthology.orchestra.run.smithi121.stdout:(10/160): ceph-radosgw-19.3.0-4560.gd19e6118.el 26 MB/s | 10 MB 00:00 2024-08-28T20:04:07.803 INFO:teuthology.orchestra.run.smithi121.stdout:(11/160): cephfs-mirror-19.3.0-4560.gd19e6118.e 4.5 MB/s | 226 kB 00:00 2024-08-28T20:04:07.869 INFO:teuthology.orchestra.run.smithi121.stdout:(12/160): cephfs-shell-19.3.0-4560.gd19e6118.el 406 kB/s | 27 kB 00:00 2024-08-28T20:04:08.070 INFO:teuthology.orchestra.run.smithi121.stdout:(13/160): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 16 MB/s | 18 MB 00:01 2024-08-28T20:04:08.089 INFO:teuthology.orchestra.run.smithi121.stdout:(14/160): libcephfs-devel-19.3.0-4560.gd19e6118 146 kB/s | 32 kB 00:00 2024-08-28T20:04:08.129 INFO:teuthology.orchestra.run.smithi121.stdout:(15/160): libcephfs2-19.3.0-4560.gd19e6118.el9. 13 MB/s | 766 kB 00:00 2024-08-28T20:04:08.146 INFO:teuthology.orchestra.run.smithi121.stdout:(16/160): libcephsqlite-19.3.0-4560.gd19e6118.e 2.7 MB/s | 159 kB 00:00 2024-08-28T20:04:08.179 INFO:teuthology.orchestra.run.smithi121.stdout:(17/160): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-28T20:04:08.213 INFO:teuthology.orchestra.run.smithi121.stdout:(18/160): libradosstriper1-19.3.0-4560.gd19e611 7.4 MB/s | 506 kB 00:00 2024-08-28T20:04:08.263 INFO:teuthology.orchestra.run.smithi121.stdout:(19/160): python3-ceph-argparse-19.3.0-4560.gd1 901 kB/s | 45 kB 00:00 2024-08-28T20:04:08.330 INFO:teuthology.orchestra.run.smithi121.stdout:(20/160): python3-ceph-common-19.3.0-4560.gd19e 2.1 MB/s | 141 kB 00:00 2024-08-28T20:04:08.405 INFO:teuthology.orchestra.run.smithi121.stdout:(21/160): librgw2-19.3.0-4560.gd19e6118.el9.x86 23 MB/s | 5.3 MB 00:00 2024-08-28T20:04:08.431 INFO:teuthology.orchestra.run.smithi121.stdout:(22/160): python3-cephfs-19.3.0-4560.gd19e6118. 1.6 MB/s | 161 kB 00:00 2024-08-28T20:04:08.456 INFO:teuthology.orchestra.run.smithi121.stdout:(23/160): python3-rados-19.3.0-4560.gd19e6118.e 6.3 MB/s | 321 kB 00:00 2024-08-28T20:04:08.490 INFO:teuthology.orchestra.run.smithi121.stdout:(24/160): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-28T20:04:08.506 INFO:teuthology.orchestra.run.smithi121.stdout:(25/160): python3-rgw-19.3.0-4560.gd19e6118.el9 1.9 MB/s | 99 kB 00:00 2024-08-28T20:04:08.540 INFO:teuthology.orchestra.run.smithi121.stdout:(26/160): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-28T20:04:08.641 INFO:teuthology.orchestra.run.smithi121.stdout:(27/160): rbd-mirror-19.3.0-4560.gd19e6118.el9. 23 MB/s | 3.1 MB 00:00 2024-08-28T20:04:08.666 INFO:teuthology.orchestra.run.smithi121.stdout:(28/160): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 1.3 MB/s | 170 kB 00:00 2024-08-28T20:04:08.691 INFO:teuthology.orchestra.run.smithi121.stdout:(29/160): ceph-grafana-dashboards-19.3.0-4560.g 685 kB/s | 34 kB 00:00 2024-08-28T20:04:08.716 INFO:teuthology.orchestra.run.smithi121.stdout:(30/160): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-28T20:04:09.142 INFO:teuthology.orchestra.run.smithi121.stdout:(31/160): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-08-28T20:04:09.242 INFO:teuthology.orchestra.run.smithi121.stdout:(32/160): ceph-mgr-modules-core-19.3.0-4560.gd1 2.8 MB/s | 290 kB 00:00 2024-08-28T20:04:09.392 INFO:teuthology.orchestra.run.smithi121.stdout:(33/160): ceph-mgr-dashboard-19.3.0-4560.gd19e6 20 MB/s | 14 MB 00:00 2024-08-28T20:04:09.418 INFO:teuthology.orchestra.run.smithi121.stdout:(34/160): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 281 kB/s | 49 kB 00:00 2024-08-28T20:04:09.451 INFO:teuthology.orchestra.run.smithi121.stdout:(35/160): ceph-prometheus-alerts-19.3.0-4560.gd 282 kB/s | 16 kB 00:00 2024-08-28T20:04:09.477 INFO:teuthology.orchestra.run.smithi121.stdout:(36/160): ceph-volume-19.3.0-4560.gd19e6118.el9 4.8 MB/s | 285 kB 00:00 2024-08-28T20:04:09.518 INFO:teuthology.orchestra.run.smithi121.stdout:(37/160): cephadm-19.3.0-4560.gd19e6118.el9.noa 11 MB/s | 781 kB 00:00 2024-08-28T20:04:09.544 INFO:teuthology.orchestra.run.smithi121.stdout:(38/160): cephfs-top-19.3.0-4560.gd19e6118.el9. 273 kB/s | 18 kB 00:00 2024-08-28T20:04:09.677 INFO:teuthology.orchestra.run.smithi121.stdout:(39/160): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-08-28T20:04:09.753 INFO:teuthology.orchestra.run.smithi121.stdout:(40/160): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-08-28T20:04:09.778 INFO:teuthology.orchestra.run.smithi121.stdout:(41/160): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-08-28T20:04:09.811 INFO:teuthology.orchestra.run.smithi121.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-08-28T20:04:09.870 INFO:teuthology.orchestra.run.smithi121.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-28T20:04:09.870 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-28T20:04:09.904 INFO:teuthology.orchestra.run.smithi121.stdout:(44/160): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-08-28T20:04:09.937 INFO:teuthology.orchestra.run.smithi121.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-28T20:04:10.212 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-28T20:04:10.313 INFO:teuthology.orchestra.run.smithi121.stdout:(46/160): ceph-test-19.3.0-4560.gd19e6118.el9.x 15 MB/s | 44 MB 00:02 2024-08-28T20:04:10.338 INFO:teuthology.orchestra.run.smithi121.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 288 kB/s | 125 kB 00:00 2024-08-28T20:04:10.371 INFO:teuthology.orchestra.run.smithi121.stdout:(48/160): python3-urllib3-1.26.5-6.el9.noarch.r 495 kB/s | 215 kB 00:00 2024-08-28T20:04:10.555 INFO:teuthology.orchestra.run.smithi121.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 583 kB/s | 107 kB 00:00 2024-08-28T20:04:10.580 INFO:teuthology.orchestra.run.smithi121.stdout:(50/160): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-08-28T20:04:10.614 INFO:teuthology.orchestra.run.smithi121.stdout:(51/160): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-08-28T20:04:10.631 INFO:teuthology.orchestra.run.smithi121.stdout:(52/160): elfutils-libelf-devel-0.191-4.el9.x86 287 kB/s | 22 kB 00:00 2024-08-28T20:04:10.656 INFO:teuthology.orchestra.run.smithi121.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-08-28T20:04:10.673 INFO:teuthology.orchestra.run.smithi121.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-08-28T20:04:10.698 INFO:teuthology.orchestra.run.smithi121.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-08-28T20:04:10.724 INFO:teuthology.orchestra.run.smithi121.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 220 kB/s | 11 kB 00:00 2024-08-28T20:04:10.757 INFO:teuthology.orchestra.run.smithi121.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-28T20:04:10.783 INFO:teuthology.orchestra.run.smithi121.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-08-28T20:04:10.850 INFO:teuthology.orchestra.run.smithi121.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-08-28T20:04:10.875 INFO:teuthology.orchestra.run.smithi121.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-08-28T20:04:10.880 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:10.925 INFO:teuthology.orchestra.run.smithi121.stdout:(61/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 953 kB/s | 47 kB 00:00 2024-08-28T20:04:10.992 INFO:teuthology.orchestra.run.smithi121.stdout:(62/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-08-28T20:04:11.017 INFO:teuthology.orchestra.run.smithi121.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-28T20:04:11.023 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:11.051 INFO:teuthology.orchestra.run.smithi121.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-08-28T20:04:11.051 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:11.061 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:11.081 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:11.081 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:11.104 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:11.128 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:11.168 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:11.203 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:11.226 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:11.286 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:11.288 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:11.326 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:11.447 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:11.620 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:11.653 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:11.697 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:11.724 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:11.781 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:11.810 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:11.830 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:11.838 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:11.854 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:11.883 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:11.891 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:11.913 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:11.942 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:11.957 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:11.975 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:11.988 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:11.988 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:12.051 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:12.067 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:12.083 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:12.107 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:12.123 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:12.148 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:12.205 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:12.216 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:12.240 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:12.258 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T20:04:12.259 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T20:04:12.273 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-28T20:04:12.274 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-28T20:04:12.275 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-28T20:04:12.276 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-28T20:04:12.278 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-28T20:04:12.281 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-28T20:04:12.282 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-28T20:04:12.351 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-08-28T20:04:12.372 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-08-28T20:04:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-28T20:04:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-28T20:04:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T20:04:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: libblkid x86_64 2.37.4-20.el9 baseos 107 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: libfdisk x86_64 2.37.4-20.el9 baseos 154 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: libmount x86_64 2.37.4-20.el9 baseos 135 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: libsmartcols x86_64 2.37.4-20.el9 baseos 63 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid x86_64 2.37.4-20.el9 baseos 28 k 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.2-4.el9 baseos 1.3 M 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.2-4.el9 baseos 2.4 M 2024-08-28T20:04:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux x86_64 2.37.4-20.el9 baseos 2.3 M 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-core x86_64 2.37.4-20.el9 baseos 464 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-user x86_64 2.37.4-20.el9 baseos 30 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-28T20:04:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-28T20:04:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-28T20:04:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-28T20:04:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-28T20:04:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-28T20:04:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-28T20:04:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-28T20:04:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout:Install 148 Packages 2024-08-28T20:04:12.385 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 12 Packages 2024-08-28T20:04:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:04:12.386 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 231 M 2024-08-28T20:04:12.386 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-08-28T20:04:12.648 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:12.666 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:12.679 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:12.778 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T20:04:12.779 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T20:04:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-28T20:04:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-28T20:04:12.795 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-28T20:04:12.796 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-28T20:04:12.798 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-28T20:04:12.801 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-28T20:04:12.802 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-28T20:04:12.874 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-08-28T20:04:12.899 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-08-28T20:04:12.899 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-08-28T20:04:12.899 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-28T20:04:12.900 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-28T20:04:12.901 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-28T20:04:12.902 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: libblkid x86_64 2.37.4-20.el9 baseos 107 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: libfdisk x86_64 2.37.4-20.el9 baseos 154 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: libmount x86_64 2.37.4-20.el9 baseos 135 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: libsmartcols x86_64 2.37.4-20.el9 baseos 63 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid x86_64 2.37.4-20.el9 baseos 28 k 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-4.el9 baseos 1.3 M 2024-08-28T20:04:12.903 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-4.el9 baseos 2.4 M 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux x86_64 2.37.4-20.el9 baseos 2.3 M 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux-core x86_64 2.37.4-20.el9 baseos 464 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux-user x86_64 2.37.4-20.el9 baseos 30 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-28T20:04:12.904 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-28T20:04:12.905 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-28T20:04:12.906 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-28T20:04:12.907 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-28T20:04:12.908 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-28T20:04:12.909 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-28T20:04:12.910 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-28T20:04:12.911 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-08-28T20:04:12.912 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout:======================================================================================= 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout:Install 148 Packages 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 12 Packages 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:04:12.913 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 231 M 2024-08-28T20:04:12.914 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-08-28T20:04:12.942 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:12.965 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:12.977 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:12.978 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:12.995 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:13.001 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:13.029 INFO:teuthology.orchestra.run.smithi007.stdout:(1/160): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-08-28T20:04:13.039 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:13.056 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:13.059 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:13.168 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:13.182 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:13.189 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:13.213 INFO:teuthology.orchestra.run.smithi007.stdout:(2/160): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.7 MB/s | 874 kB 00:00 2024-08-28T20:04:13.220 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:13.240 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:13.305 INFO:teuthology.orchestra.run.smithi007.stdout:(3/160): ceph-immutable-object-cache-19.3.0-456 1.6 MB/s | 148 kB 00:00 2024-08-28T20:04:13.308 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:13.321 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:13.328 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:13.388 INFO:teuthology.orchestra.run.smithi007.stdout:(4/160): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-28T20:04:13.443 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:13.472 INFO:teuthology.orchestra.run.smithi007.stdout:(5/160): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 18 MB/s | 1.5 MB 00:00 2024-08-28T20:04:13.504 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:13.522 INFO:teuthology.orchestra.run.smithi007.stdout:(6/160): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 10 MB/s | 2.3 MB 00:00 2024-08-28T20:04:13.530 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:13.587 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:13.600 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:13.649 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:13.741 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:13.758 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:13.764 INFO:teuthology.orchestra.run.smithi007.stdout:(7/160): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 17 MB/s | 4.9 MB 00:00 2024-08-28T20:04:13.800 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:13.839 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:13.854 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:13.882 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:13.916 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:13.939 INFO:teuthology.orchestra.run.smithi001.stdout:(1/160): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-08-28T20:04:13.946 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:14.009 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:14.019 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:14.023 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:14.057 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:14.060 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:14.064 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:14.077 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:14.098 INFO:teuthology.orchestra.run.smithi007.stdout:(8/160): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-28T20:04:14.104 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:14.134 INFO:teuthology.orchestra.run.smithi121.stdout:(65/160): libuuid-devel-2.37.4-20.el9.x86_64.rp 7.4 kB/s | 24 kB 00:03 2024-08-28T20:04:14.151 INFO:teuthology.orchestra.run.smithi121.stdout:(66/160): openblas-0.3.26-2.el9.x86_64.rpm 12 kB/s | 38 kB 00:03 2024-08-28T20:04:14.151 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:14.161 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:14.172 INFO:teuthology.orchestra.run.smithi001.stdout:(2/160): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 3.7 MB/s | 874 kB 00:00 2024-08-28T20:04:14.181 INFO:teuthology.orchestra.run.smithi007.stdout:(9/160): ceph-selinux-19.3.0-4560.gd19e6118.el9 303 kB/s | 25 kB 00:00 2024-08-28T20:04:14.289 INFO:teuthology.orchestra.run.smithi001.stdout:(3/160): ceph-immutable-object-cache-19.3.0-456 1.2 MB/s | 148 kB 00:00 2024-08-28T20:04:14.293 INFO:teuthology.orchestra.run.smithi121.stdout:(67/160): openblas-openmp-0.3.26-2.el9.x86_64.r 1.5 MB/s | 4.9 MB 00:03 2024-08-28T20:04:14.335 INFO:teuthology.orchestra.run.smithi121.stdout:(68/160): postgresql-13.16-1.el9.x86_64.rpm 8.7 MB/s | 1.6 MB 00:00 2024-08-28T20:04:14.342 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:14.381 INFO:teuthology.orchestra.run.smithi001.stdout:(4/160): ceph-base-19.3.0-4560.gd19e6118.el9.x8 8.5 MB/s | 5.5 MB 00:00 2024-08-28T20:04:14.418 INFO:teuthology.orchestra.run.smithi121.stdout:(69/160): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-08-28T20:04:14.419 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:14.583 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:14.677 INFO:teuthology.orchestra.run.smithi121.stdout:(70/160): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-08-28T20:04:14.681 INFO:teuthology.orchestra.run.smithi001.stdout:(5/160): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-08-28T20:04:14.710 INFO:teuthology.orchestra.run.smithi121.stdout:(71/160): postgresql-contrib-13.16-1.el9.x86_64 2.1 MB/s | 910 kB 00:00 2024-08-28T20:04:14.737 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:14.786 INFO:teuthology.orchestra.run.smithi121.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-08-28T20:04:14.790 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:14.823 INFO:teuthology.orchestra.run.smithi007.stdout:(10/160): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 14 MB/s | 18 MB 00:01 2024-08-28T20:04:14.836 INFO:teuthology.orchestra.run.smithi121.stdout:(73/160): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-08-28T20:04:14.873 INFO:teuthology.orchestra.run.smithi001.stdout:(6/160): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 3.9 MB/s | 2.3 MB 00:00 2024-08-28T20:04:14.895 INFO:teuthology.orchestra.run.smithi121.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-28T20:04:14.940 INFO:teuthology.orchestra.run.smithi007.stdout:(11/160): ceph-radosgw-19.3.0-4560.gd19e6118.el 8.9 MB/s | 10 MB 00:01 2024-08-28T20:04:15.002 INFO:teuthology.orchestra.run.smithi001.stdout:(7/160): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 15 MB/s | 4.9 MB 00:00 2024-08-28T20:04:15.003 INFO:teuthology.orchestra.run.smithi121.stdout:(75/160): python3-devel-3.9.19-7.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-08-28T20:04:15.007 INFO:teuthology.orchestra.run.smithi007.stdout:(12/160): cephfs-mirror-19.3.0-4560.gd19e6118.e 1.2 MB/s | 226 kB 00:00 2024-08-28T20:04:15.024 INFO:teuthology.orchestra.run.smithi007.stdout:(13/160): cephfs-shell-19.3.0-4560.gd19e6118.el 324 kB/s | 27 kB 00:00 2024-08-28T20:04:15.058 INFO:teuthology.orchestra.run.smithi007.stdout:(14/160): libcephfs-devel-19.3.0-4560.gd19e6118 635 kB/s | 32 kB 00:00 2024-08-28T20:04:15.103 INFO:teuthology.orchestra.run.smithi121.stdout:(76/160): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-08-28T20:04:15.142 INFO:teuthology.orchestra.run.smithi007.stdout:(15/160): libcephsqlite-19.3.0-4560.gd19e6118.e 1.9 MB/s | 159 kB 00:00 2024-08-28T20:04:15.154 INFO:teuthology.orchestra.run.smithi121.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-08-28T20:04:15.179 INFO:teuthology.orchestra.run.smithi121.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-08-28T20:04:15.183 INFO:teuthology.orchestra.run.smithi007.stdout:(16/160): libcephfs2-19.3.0-4560.gd19e6118.el9. 4.7 MB/s | 766 kB 00:00 2024-08-28T20:04:15.185 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:15.217 INFO:teuthology.orchestra.run.smithi007.stdout:(17/160): librados-devel-19.3.0-4560.gd19e6118. 1.6 MB/s | 127 kB 00:00 2024-08-28T20:04:15.221 INFO:teuthology.orchestra.run.smithi121.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-08-28T20:04:15.242 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:15.267 INFO:teuthology.orchestra.run.smithi007.stdout:(18/160): libradosstriper1-19.3.0-4560.gd19e611 5.9 MB/s | 506 kB 00:00 2024-08-28T20:04:15.271 INFO:teuthology.orchestra.run.smithi121.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-08-28T20:04:15.297 INFO:teuthology.orchestra.run.smithi121.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-08-28T20:04:15.352 INFO:teuthology.orchestra.run.smithi007.stdout:(19/160): python3-ceph-argparse-19.3.0-4560.gd1 542 kB/s | 45 kB 00:00 2024-08-28T20:04:15.390 INFO:teuthology.orchestra.run.smithi121.stdout:(82/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-08-28T20:04:15.390 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:15.426 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:15.443 INFO:teuthology.orchestra.run.smithi007.stdout:(20/160): python3-ceph-common-19.3.0-4560.gd19e 1.5 MB/s | 141 kB 00:00 2024-08-28T20:04:15.472 INFO:teuthology.orchestra.run.smithi121.stdout:(83/160): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 222 kB 00:00 2024-08-28T20:04:15.503 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:15.527 INFO:teuthology.orchestra.run.smithi007.stdout:(21/160): python3-cephfs-19.3.0-4560.gd19e6118. 1.9 MB/s | 161 kB 00:00 2024-08-28T20:04:15.547 INFO:teuthology.orchestra.run.smithi121.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-08-28T20:04:15.559 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:15.615 INFO:teuthology.orchestra.run.smithi121.stdout:(85/160): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-08-28T20:04:15.618 INFO:teuthology.orchestra.run.smithi007.stdout:(22/160): python3-rados-19.3.0-4560.gd19e6118.e 3.4 MB/s | 321 kB 00:00 2024-08-28T20:04:15.648 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:15.677 INFO:teuthology.orchestra.run.smithi007.stdout:(23/160): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-28T20:04:15.690 INFO:teuthology.orchestra.run.smithi001.stdout:(8/160): ceph-radosgw-19.3.0-4560.gd19e6118.el9 15 MB/s | 10 MB 00:00 2024-08-28T20:04:15.707 INFO:teuthology.orchestra.run.smithi121.stdout:(86/160): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-08-28T20:04:15.752 INFO:teuthology.orchestra.run.smithi007.stdout:(24/160): librgw2-19.3.0-4560.gd19e6118.el9.x86 9.9 MB/s | 5.3 MB 00:00 2024-08-28T20:04:15.777 INFO:teuthology.orchestra.run.smithi007.stdout:(25/160): python3-rgw-19.3.0-4560.gd19e6118.el9 993 kB/s | 99 kB 00:00 2024-08-28T20:04:15.790 INFO:teuthology.orchestra.run.smithi121.stdout:(87/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-08-28T20:04:15.811 INFO:teuthology.orchestra.run.smithi007.stdout:(26/160): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.4 MB/s | 86 kB 00:00 2024-08-28T20:04:15.870 INFO:teuthology.orchestra.run.smithi007.stdout:(27/160): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.9 MB/s | 170 kB 00:00 2024-08-28T20:04:15.899 INFO:teuthology.orchestra.run.smithi121.stdout:(88/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.2 MB/s | 5.1 MB 00:00 2024-08-28T20:04:15.907 INFO:teuthology.orchestra.run.smithi001.stdout:(9/160): ceph-common-19.3.0-4560.gd19e6118.el9. 9.2 MB/s | 20 MB 00:02 2024-08-28T20:04:15.924 INFO:teuthology.orchestra.run.smithi001.stdout:(10/160): ceph-selinux-19.3.0-4560.gd19e6118.el 108 kB/s | 25 kB 00:00 2024-08-28T20:04:15.928 INFO:teuthology.orchestra.run.smithi007.stdout:(28/160): ceph-grafana-dashboards-19.3.0-4560.g 588 kB/s | 34 kB 00:00 2024-08-28T20:04:15.966 INFO:teuthology.orchestra.run.smithi121.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-08-28T20:04:15.974 INFO:teuthology.orchestra.run.smithi001.stdout:(11/160): cephfs-mirror-19.3.0-4560.gd19e6118.e 4.4 MB/s | 226 kB 00:00 2024-08-28T20:04:15.991 INFO:teuthology.orchestra.run.smithi121.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-08-28T20:04:15.995 INFO:teuthology.orchestra.run.smithi007.stdout:(29/160): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.3 MB/s | 154 kB 00:00 2024-08-28T20:04:16.033 INFO:teuthology.orchestra.run.smithi001.stdout:(12/160): cephfs-shell-19.3.0-4560.gd19e6118.el 462 kB/s | 27 kB 00:00 2024-08-28T20:04:16.049 INFO:teuthology.orchestra.run.smithi121.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 643 kB/s | 54 kB 00:00 2024-08-28T20:04:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:(30/160): rbd-mirror-19.3.0-4560.gd19e6118.el9. 11 MB/s | 3.1 MB 00:00 2024-08-28T20:04:16.108 INFO:teuthology.orchestra.run.smithi121.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 717 kB/s | 42 kB 00:00 2024-08-28T20:04:16.108 INFO:teuthology.orchestra.run.smithi001.stdout:(13/160): libcephfs-devel-19.3.0-4560.gd19e6118 424 kB/s | 32 kB 00:00 2024-08-28T20:04:16.155 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:16.192 INFO:teuthology.orchestra.run.smithi121.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 530 kB/s | 44 kB 00:00 2024-08-28T20:04:16.208 INFO:teuthology.orchestra.run.smithi001.stdout:(14/160): libcephfs2-19.3.0-4560.gd19e6118.el9. 7.5 MB/s | 766 kB 00:00 2024-08-28T20:04:16.260 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:16.292 INFO:teuthology.orchestra.run.smithi001.stdout:(15/160): libcephsqlite-19.3.0-4560.gd19e6118.e 1.9 MB/s | 159 kB 00:00 2024-08-28T20:04:16.300 INFO:teuthology.orchestra.run.smithi121.stdout:(94/160): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-08-28T20:04:16.318 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:16.367 INFO:teuthology.orchestra.run.smithi121.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 540 kB/s | 36 kB 00:00 2024-08-28T20:04:16.376 INFO:teuthology.orchestra.run.smithi001.stdout:(16/160): librados-devel-19.3.0-4560.gd19e6118. 1.5 MB/s | 127 kB 00:00 2024-08-28T20:04:16.442 INFO:teuthology.orchestra.run.smithi121.stdout:(96/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-08-28T20:04:16.467 INFO:teuthology.orchestra.run.smithi001.stdout:(17/160): libradosstriper1-19.3.0-4560.gd19e611 5.4 MB/s | 506 kB 00:00 2024-08-28T20:04:16.610 INFO:teuthology.orchestra.run.smithi121.stdout:(97/160): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-08-28T20:04:16.617 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:16.751 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:16.810 INFO:teuthology.orchestra.run.smithi121.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 289 kB/s | 58 kB 00:00 2024-08-28T20:04:16.810 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:16.893 INFO:teuthology.orchestra.run.smithi121.stdout:(99/160): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-08-28T20:04:16.938 INFO:teuthology.orchestra.run.smithi007.stdout:(31/160): ceph-mgr-diskprediction-local-19.3.0- 8.4 MB/s | 7.4 MB 00:00 2024-08-28T20:04:16.960 INFO:teuthology.orchestra.run.smithi001.stdout:(18/160): librgw2-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 5.3 MB 00:00 2024-08-28T20:04:17.010 INFO:teuthology.orchestra.run.smithi001.stdout:(19/160): python3-ceph-argparse-19.3.0-4560.gd1 903 kB/s | 45 kB 00:00 2024-08-28T20:04:17.060 INFO:teuthology.orchestra.run.smithi001.stdout:(20/160): python3-ceph-common-19.3.0-4560.gd19e 2.8 MB/s | 141 kB 00:00 2024-08-28T20:04:17.085 INFO:teuthology.orchestra.run.smithi121.stdout:(100/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-08-28T20:04:17.087 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:17.102 INFO:teuthology.orchestra.run.smithi121.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 306 kB/s | 64 kB 00:00 2024-08-28T20:04:17.110 INFO:teuthology.orchestra.run.smithi001.stdout:(21/160): python3-cephfs-19.3.0-4560.gd19e6118. 3.2 MB/s | 161 kB 00:00 2024-08-28T20:04:17.152 INFO:teuthology.orchestra.run.smithi121.stdout:(102/160): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-08-28T20:04:17.153 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:17.169 INFO:teuthology.orchestra.run.smithi121.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 546 kB/s | 45 kB 00:00 2024-08-28T20:04:17.178 INFO:teuthology.orchestra.run.smithi001.stdout:(22/160): python3-rados-19.3.0-4560.gd19e6118.e 4.7 MB/s | 321 kB 00:00 2024-08-28T20:04:17.228 INFO:teuthology.orchestra.run.smithi121.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-28T20:04:17.236 INFO:teuthology.orchestra.run.smithi001.stdout:(23/160): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-28T20:04:17.262 INFO:teuthology.orchestra.run.smithi121.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-28T20:04:17.262 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:17.278 INFO:teuthology.orchestra.run.smithi121.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-08-28T20:04:17.287 INFO:teuthology.orchestra.run.smithi001.stdout:(24/160): python3-rgw-19.3.0-4560.gd19e6118.el9 1.9 MB/s | 99 kB 00:00 2024-08-28T20:04:17.320 INFO:teuthology.orchestra.run.smithi121.stdout:(107/160): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-08-28T20:04:17.337 INFO:teuthology.orchestra.run.smithi001.stdout:(25/160): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-28T20:04:17.338 INFO:teuthology.orchestra.run.smithi007.stdout:(32/160): ceph-test-19.3.0-4560.gd19e6118.el9.x 14 MB/s | 44 MB 00:03 2024-08-28T20:04:17.363 INFO:teuthology.orchestra.run.smithi007.stdout:(33/160): ceph-mgr-modules-core-19.3.0-4560.gd1 683 kB/s | 290 kB 00:00 2024-08-28T20:04:17.379 INFO:teuthology.orchestra.run.smithi121.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 515 kB/s | 26 kB 00:00 2024-08-28T20:04:17.412 INFO:teuthology.orchestra.run.smithi121.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-08-28T20:04:17.446 INFO:teuthology.orchestra.run.smithi121.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-28T20:04:17.448 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:17.471 INFO:teuthology.orchestra.run.smithi121.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2024-08-28T20:04:17.513 INFO:teuthology.orchestra.run.smithi007.stdout:(34/160): ceph-mgr-dashboard-19.3.0-4560.gd19e6 9.3 MB/s | 14 MB 00:01 2024-08-28T20:04:17.530 INFO:teuthology.orchestra.run.smithi007.stdout:(35/160): ceph-prometheus-alerts-19.3.0-4560.gd 98 kB/s | 16 kB 00:00 2024-08-28T20:04:17.535 INFO:teuthology.orchestra.run.smithi001.stdout:(26/160): rbd-mirror-19.3.0-4560.gd19e6118.el9. 16 MB/s | 3.1 MB 00:00 2024-08-28T20:04:17.538 INFO:teuthology.orchestra.run.smithi121.stdout:(112/160): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-08-28T20:04:17.547 INFO:teuthology.orchestra.run.smithi007.stdout:(36/160): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 236 kB/s | 49 kB 00:00 2024-08-28T20:04:17.572 INFO:teuthology.orchestra.run.smithi007.stdout:(37/160): ceph-volume-19.3.0-4560.gd19e6118.el9 4.8 MB/s | 285 kB 00:00 2024-08-28T20:04:17.580 INFO:teuthology.orchestra.run.smithi121.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-28T20:04:17.589 INFO:teuthology.orchestra.run.smithi007.stdout:(38/160): cephfs-top-19.3.0-4560.gd19e6118.el9. 437 kB/s | 18 kB 00:00 2024-08-28T20:04:17.596 INFO:teuthology.orchestra.run.smithi001.stdout:(27/160): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.7 MB/s | 170 kB 00:00 2024-08-28T20:04:17.605 INFO:teuthology.orchestra.run.smithi121.stdout:(114/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-08-28T20:04:17.623 INFO:teuthology.orchestra.run.smithi007.stdout:(39/160): cephadm-19.3.0-4560.gd19e6118.el9.noa 8.3 MB/s | 781 kB 00:00 2024-08-28T20:04:17.631 INFO:teuthology.orchestra.run.smithi121.stdout:(115/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 861 kB/s | 43 kB 00:00 2024-08-28T20:04:17.646 INFO:teuthology.orchestra.run.smithi001.stdout:(28/160): ceph-grafana-dashboards-19.3.0-4560.g 688 kB/s | 34 kB 00:00 2024-08-28T20:04:17.656 INFO:teuthology.orchestra.run.smithi121.stdout:(116/160): python3-cachetools-4.2.4-1.el9.noarc 647 kB/s | 32 kB 00:00 2024-08-28T20:04:17.657 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:17.682 INFO:teuthology.orchestra.run.smithi121.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-08-28T20:04:17.696 INFO:teuthology.orchestra.run.smithi001.stdout:(29/160): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-28T20:04:17.707 INFO:teuthology.orchestra.run.smithi121.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-28T20:04:17.732 INFO:teuthology.orchestra.run.smithi121.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-28T20:04:17.756 INFO:teuthology.orchestra.run.smithi007.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-08-28T20:04:17.757 INFO:teuthology.orchestra.run.smithi121.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-28T20:04:17.758 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:17.791 INFO:teuthology.orchestra.run.smithi121.stdout:(121/160): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-28T20:04:17.815 INFO:teuthology.orchestra.run.smithi007.stdout:(41/160): libquadmath-11.5.0-2.el9.x86_64.rpm 996 kB/s | 191 kB 00:00 2024-08-28T20:04:17.825 INFO:teuthology.orchestra.run.smithi121.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-08-28T20:04:17.865 INFO:teuthology.orchestra.run.smithi007.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-28T20:04:17.883 INFO:teuthology.orchestra.run.smithi121.stdout:(123/160): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-08-28T20:04:17.890 INFO:teuthology.orchestra.run.smithi007.stdout:(43/160): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-08-28T20:04:17.900 INFO:teuthology.orchestra.run.smithi121.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-08-28T20:04:17.916 INFO:teuthology.orchestra.run.smithi007.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-28T20:04:17.925 INFO:teuthology.orchestra.run.smithi121.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 429 kB/s | 18 kB 00:00 2024-08-28T20:04:17.943 INFO:teuthology.orchestra.run.smithi007.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 135 kB 00:00 2024-08-28T20:04:17.951 INFO:teuthology.orchestra.run.smithi121.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-08-28T20:04:17.951 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:17.976 INFO:teuthology.orchestra.run.smithi121.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-28T20:04:18.001 INFO:teuthology.orchestra.run.smithi121.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-28T20:04:18.026 INFO:teuthology.orchestra.run.smithi121.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-28T20:04:18.047 INFO:teuthology.orchestra.run.smithi001.stdout:(30/160): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 5.6 MB/s | 18 MB 00:03 2024-08-28T20:04:18.052 INFO:teuthology.orchestra.run.smithi121.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-28T20:04:18.052 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:18.077 INFO:teuthology.orchestra.run.smithi121.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-28T20:04:18.102 INFO:teuthology.orchestra.run.smithi007.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 672 kB/s | 125 kB 00:00 2024-08-28T20:04:18.110 INFO:teuthology.orchestra.run.smithi121.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-28T20:04:18.127 INFO:teuthology.orchestra.run.smithi007.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 1.1 MB/s | 215 kB 00:00 2024-08-28T20:04:18.136 INFO:teuthology.orchestra.run.smithi121.stdout:(133/160): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-08-28T20:04:18.136 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:18.161 INFO:teuthology.orchestra.run.smithi007.stdout:(48/160): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-08-28T20:04:18.161 INFO:teuthology.orchestra.run.smithi121.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-08-28T20:04:18.195 INFO:teuthology.orchestra.run.smithi121.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-28T20:04:18.220 INFO:teuthology.orchestra.run.smithi121.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 553 kB/s | 28 kB 00:00 2024-08-28T20:04:18.245 INFO:teuthology.orchestra.run.smithi121.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2024-08-28T20:04:18.270 INFO:teuthology.orchestra.run.smithi121.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-28T20:04:18.296 INFO:teuthology.orchestra.run.smithi121.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-28T20:04:18.321 INFO:teuthology.orchestra.run.smithi121.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-28T20:04:18.336 INFO:teuthology.orchestra.run.smithi007.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-08-28T20:04:18.346 INFO:teuthology.orchestra.run.smithi121.stdout:(141/160): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-28T20:04:18.363 INFO:teuthology.orchestra.run.smithi121.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 5.4 MB/s | 90 kB 00:00 2024-08-28T20:04:18.386 INFO:teuthology.orchestra.run.smithi007.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-08-28T20:04:18.389 INFO:teuthology.orchestra.run.smithi001.stdout:(31/160): ceph-mgr-dashboard-19.3.0-4560.gd19e6 20 MB/s | 14 MB 00:00 2024-08-28T20:04:18.397 INFO:teuthology.orchestra.run.smithi121.stdout:(143/160): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-28T20:04:18.422 INFO:teuthology.orchestra.run.smithi121.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 824 kB/s | 20 kB 00:00 2024-08-28T20:04:18.428 INFO:teuthology.orchestra.run.smithi007.stdout:(51/160): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-08-28T20:04:18.447 INFO:teuthology.orchestra.run.smithi001.stdout:(32/160): ceph-mgr-modules-core-19.3.0-4560.gd1 4.9 MB/s | 290 kB 00:00 2024-08-28T20:04:18.448 INFO:teuthology.orchestra.run.smithi121.stdout:(145/160): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-28T20:04:18.462 INFO:teuthology.orchestra.run.smithi007.stdout:(52/160): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-08-28T20:04:18.473 INFO:teuthology.orchestra.run.smithi121.stdout:(146/160): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2024-08-28T20:04:18.487 INFO:teuthology.orchestra.run.smithi007.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-08-28T20:04:18.497 INFO:teuthology.orchestra.run.smithi001.stdout:(33/160): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 995 kB/s | 49 kB 00:00 2024-08-28T20:04:18.523 INFO:teuthology.orchestra.run.smithi121.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-08-28T20:04:18.546 INFO:teuthology.orchestra.run.smithi007.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-08-28T20:04:18.547 INFO:teuthology.orchestra.run.smithi001.stdout:(34/160): ceph-prometheus-alerts-19.3.0-4560.gd 330 kB/s | 16 kB 00:00 2024-08-28T20:04:18.571 INFO:teuthology.orchestra.run.smithi007.stdout:(55/160): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-08-28T20:04:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-28T20:04:18.622 INFO:teuthology.orchestra.run.smithi007.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-28T20:04:18.624 INFO:teuthology.orchestra.run.smithi121.stdout:(148/160): openssl-devel-3.2.2-4.el9.x86_64.rpm 1.0 MB/s | 4.4 MB 00:04 2024-08-28T20:04:18.631 INFO:teuthology.orchestra.run.smithi001.stdout:(35/160): ceph-volume-19.3.0-4560.gd19e6118.el9 3.3 MB/s | 285 kB 00:00 2024-08-28T20:04:18.647 INFO:teuthology.orchestra.run.smithi007.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-08-28T20:04:18.698 INFO:teuthology.orchestra.run.smithi001.stdout:(36/160): cephadm-19.3.0-4560.gd19e6118.el9.noa 11 MB/s | 781 kB 00:00 2024-08-28T20:04:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:18.714 INFO:teuthology.orchestra.run.smithi007.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-08-28T20:04:18.739 INFO:teuthology.orchestra.run.smithi007.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-08-28T20:04:18.745 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:18.749 INFO:teuthology.orchestra.run.smithi001.stdout:(37/160): cephfs-top-19.3.0-4560.gd19e6118.el9. 365 kB/s | 18 kB 00:00 2024-08-28T20:04:18.817 INFO:teuthology.orchestra.run.smithi007.stdout:(61/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-08-28T20:04:18.840 INFO:teuthology.orchestra.run.smithi007.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-08-28T20:04:18.854 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:18.870 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:18.882 INFO:teuthology.orchestra.run.smithi007.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 292 kB 00:00 2024-08-28T20:04:18.899 INFO:teuthology.orchestra.run.smithi007.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-08-28T20:04:18.913 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:18.913 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:18.930 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:18.943 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:18.966 INFO:teuthology.orchestra.run.smithi121.stdout:(149/160): librbd1-19.3.0-4560.gd19e6118.el9.x8 7.3 MB/s | 3.1 MB 00:00 2024-08-28T20:04:18.971 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:18.995 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:18.999 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:19.008 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.023 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.034 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:19.040 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:19.047 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:19.057 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:19.065 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.071 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:19.074 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:19.076 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.091 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:19.104 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.105 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.111 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:19.128 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:19.226 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:19.249 INFO:teuthology.orchestra.run.smithi001.stdout:(38/160): ceph-test-19.3.0-4560.gd19e6118.el9.x 13 MB/s | 44 MB 00:03 2024-08-28T20:04:19.263 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:19.266 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:19.375 INFO:teuthology.orchestra.run.smithi001.stdout:(39/160): ceph-mgr-diskprediction-local-19.3.0- 5.6 MB/s | 7.4 MB 00:01 2024-08-28T20:04:19.457 INFO:teuthology.orchestra.run.smithi121.stdout:(150/160): librados2-19.3.0-4560.gd19e6118.el9. 3.4 MB/s | 3.4 MB 00:00 2024-08-28T20:04:19.486 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.502 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:19.530 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:19.532 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:19.546 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:19.561 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:19.563 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:19.594 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:19.600 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:19.603 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:19.603 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:19.619 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:19.646 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:19.651 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:19.705 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:19.753 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:19.778 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:19.789 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:19.796 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:19.809 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:19.812 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:19.813 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:19.837 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:19.837 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:19.863 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:19.880 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:19.890 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:19.897 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:19.933 INFO:teuthology.orchestra.run.smithi001.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 67 kB/s | 80 kB 00:01 2024-08-28T20:04:19.951 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:19.954 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:19.980 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:19.986 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:20.041 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:20.094 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:20.096 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:20.113 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:20.120 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:20.128 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:20.162 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:20.167 INFO:teuthology.orchestra.run.smithi001.stdout:(41/160): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-08-28T20:04:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:20.192 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:20.271 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:20.296 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:20.302 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:20.303 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:20.329 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:20.335 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:20.372 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:20.377 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:20.387 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:20.402 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:20.409 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:20.430 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:20.442 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:20.468 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:20.471 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:20.550 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:20.557 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:20.582 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:20.603 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:20.612 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:20.635 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:20.668 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:20.669 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:20.709 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:20.722 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:20.747 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:20.769 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:20.787 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:20.807 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:20.809 INFO:teuthology.orchestra.run.smithi001.stdout:(42/160): libgfortran-11.5.0-2.el9.x86_64.rpm 514 kB/s | 801 kB 00:01 2024-08-28T20:04:20.817 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:20.834 INFO:teuthology.orchestra.run.smithi001.stdout:(43/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 281 kB/s | 253 kB 00:00 2024-08-28T20:04:20.846 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:20.878 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:20.880 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:20.884 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:20.910 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:20.924 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:20.926 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:20.960 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:20.997 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.013 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.035 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.048 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.065 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.086 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.117 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:21.136 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.152 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.160 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.174 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.177 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:21.178 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:21.198 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.224 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:21.229 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.236 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.239 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:21.251 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.264 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:21.271 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:21.295 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:21.333 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:21.366 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:21.381 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:21.403 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:21.428 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:21.429 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:21.436 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:21.446 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:21.461 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:21.469 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:21.476 INFO:teuthology.orchestra.run.smithi001.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-08-28T20:04:21.534 INFO:teuthology.orchestra.run.smithi001.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-08-28T20:04:21.549 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:21.557 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:21.565 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.573 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.579 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:21.601 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.635 INFO:teuthology.orchestra.run.smithi001.stdout:(46/160): python3-cryptography-36.0.1-4.el9.x86 862 kB/s | 1.2 MB 00:01 2024-08-28T20:04:21.647 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.655 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.679 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.682 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.689 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.700 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.706 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.712 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.744 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.765 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.772 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.789 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.794 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:21.802 INFO:teuthology.orchestra.run.smithi001.stdout:(47/160): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-08-28T20:04:21.809 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.826 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:21.832 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:21.840 INFO:teuthology.orchestra.run.smithi121.stdout:(151/160): libblkid-2.37.4-20.el9.x86_64.rpm 33 kB/s | 107 kB 00:03 2024-08-28T20:04:21.851 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:21.851 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:21.866 INFO:teuthology.orchestra.run.smithi121.stdout:(152/160): libmount-2.37.4-20.el9.x86_64.rpm 56 kB/s | 135 kB 00:02 2024-08-28T20:04:21.870 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:21.870 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:21.891 INFO:teuthology.orchestra.run.smithi121.stdout:(153/160): libfdisk-2.37.4-20.el9.x86_64.rpm 53 kB/s | 154 kB 00:02 2024-08-28T20:04:21.894 INFO:teuthology.orchestra.run.smithi001.stdout:(48/160): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-08-28T20:04:21.896 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:21.907 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:21.924 INFO:teuthology.orchestra.run.smithi007.stdout:(65/160): openblas-0.3.26-2.el9.x86_64.rpm 13 kB/s | 38 kB 00:03 2024-08-28T20:04:21.925 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:21.925 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:21.936 INFO:teuthology.orchestra.run.smithi001.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 107 kB 00:00 2024-08-28T20:04:21.957 INFO:teuthology.orchestra.run.smithi007.stdout:(66/160): libuuid-devel-2.37.4-20.el9.x86_64.rp 7.5 kB/s | 24 kB 00:03 2024-08-28T20:04:21.978 INFO:teuthology.orchestra.run.smithi001.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-08-28T20:04:22.000 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.017 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.019 INFO:teuthology.orchestra.run.smithi001.stdout:(51/160): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-08-28T20:04:22.025 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:(67/160): openblas-openmp-0.3.26-2.el9.x86_64.r 1.6 MB/s | 4.9 MB 00:03 2024-08-28T20:04:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.056 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.061 INFO:teuthology.orchestra.run.smithi001.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 788 kB/s | 33 kB 00:00 2024-08-28T20:04:22.081 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.083 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.130 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:22.139 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:22.162 INFO:teuthology.orchestra.run.smithi001.stdout:(53/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-08-28T20:04:22.165 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:22.165 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:22.167 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:22.201 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:22.202 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:22.204 INFO:teuthology.orchestra.run.smithi001.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 441 kB/s | 18 kB 00:00 2024-08-28T20:04:22.206 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:22.208 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:22.236 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:22.262 INFO:teuthology.orchestra.run.smithi001.stdout:(55/160): python3-requests-2.25.1-8.el9.noarch. 159 kB/s | 125 kB 00:00 2024-08-28T20:04:22.288 INFO:teuthology.orchestra.run.smithi001.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-08-28T20:04:22.291 INFO:teuthology.orchestra.run.smithi007.stdout:(68/160): postgresql-13.16-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-08-28T20:04:22.313 INFO:teuthology.orchestra.run.smithi001.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-28T20:04:22.316 INFO:teuthology.orchestra.run.smithi007.stdout:(69/160): postgresql-contrib-13.16-1.el9.x86_64 3.1 MB/s | 910 kB 00:00 2024-08-28T20:04:22.342 INFO:teuthology.orchestra.run.smithi007.stdout:(70/160): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-08-28T20:04:22.363 INFO:teuthology.orchestra.run.smithi001.stdout:(58/160): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-08-28T20:04:22.373 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.388 INFO:teuthology.orchestra.run.smithi001.stdout:(59/160): python3-urllib3-1.26.5-6.el9.noarch.r 252 kB/s | 215 kB 00:00 2024-08-28T20:04:22.414 INFO:teuthology.orchestra.run.smithi001.stdout:(60/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-08-28T20:04:22.456 INFO:teuthology.orchestra.run.smithi001.stdout:(61/160): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-08-28T20:04:22.456 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:22.459 INFO:teuthology.orchestra.run.smithi007.stdout:(71/160): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-08-28T20:04:22.488 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:22.498 INFO:teuthology.orchestra.run.smithi001.stdout:(62/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-08-28T20:04:22.509 INFO:teuthology.orchestra.run.smithi007.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-08-28T20:04:22.523 INFO:teuthology.orchestra.run.smithi001.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-08-28T20:04:22.548 INFO:teuthology.orchestra.run.smithi001.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-28T20:04:22.549 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:22.566 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:22.578 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:22.629 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.642 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:22.646 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:22.660 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:22.664 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:22.674 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:22.710 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.727 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.821 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.824 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.834 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.911 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:22.947 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:22.991 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:23.029 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:23.056 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:23.074 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:23.084 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:23.105 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:23.117 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.124 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.160 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.181 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:23.186 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:23.223 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:23.251 INFO:teuthology.orchestra.run.smithi007.stdout:(73/160): python3-babel-2.9.1-2.el9.noarch.rpm 8.0 MB/s | 6.0 MB 00:00 2024-08-28T20:04:23.310 INFO:teuthology.orchestra.run.smithi007.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-28T20:04:23.310 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:23.385 INFO:teuthology.orchestra.run.smithi007.stdout:(75/160): postgresql-server-13.16-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-08-28T20:04:23.410 INFO:teuthology.orchestra.run.smithi007.stdout:(76/160): python3-devel-3.9.19-7.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-08-28T20:04:23.430 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:23.458 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.469 INFO:teuthology.orchestra.run.smithi007.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-08-28T20:04:23.502 INFO:teuthology.orchestra.run.smithi007.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-08-28T20:04:23.514 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.515 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:23.524 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:23.524 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.527 INFO:teuthology.orchestra.run.smithi007.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-08-28T20:04:23.553 INFO:teuthology.orchestra.run.smithi007.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-08-28T20:04:23.559 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:23.579 INFO:teuthology.orchestra.run.smithi007.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 700 kB/s | 35 kB 00:00 2024-08-28T20:04:23.579 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:23.579 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:23.596 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:23.629 INFO:teuthology.orchestra.run.smithi007.stdout:(82/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-28T20:04:23.633 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-28T20:04:23.687 INFO:teuthology.orchestra.run.smithi007.stdout:(83/160): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-08-28T20:04:23.688 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:23.705 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:23.728 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:23.758 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:23.758 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.760 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.764 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:23.788 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:23.792 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.793 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.818 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:23.822 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.824 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:23.838 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.846 INFO:teuthology.orchestra.run.smithi007.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 487 kB/s | 77 kB 00:00 2024-08-28T20:04:23.859 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:23.865 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:23.866 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.870 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.879 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:23.902 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:23.907 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:23.921 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:23.925 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.931 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:23.941 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:23.975 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:23.986 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.007 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.013 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.025 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.046 INFO:teuthology.orchestra.run.smithi007.stdout:(85/160): python3-prettytable-0.7.2-27.el9.noar 211 kB/s | 42 kB 00:00 2024-08-28T20:04:24.051 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.058 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:24.064 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:24.075 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:24.080 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.091 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:24.126 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:24.130 INFO:teuthology.orchestra.run.smithi007.stdout:(86/160): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-08-28T20:04:24.133 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.138 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.148 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.151 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:24.180 INFO:teuthology.orchestra.run.smithi007.stdout:(87/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-28T20:04:24.186 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:24.214 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:24.221 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:24.221 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:24.226 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:24.231 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:24.236 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:24.237 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:24.264 INFO:teuthology.orchestra.run.smithi007.stdout:(88/160): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-08-28T20:04:24.280 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.289 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.295 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.309 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:24.313 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:24.314 INFO:teuthology.orchestra.run.smithi007.stdout:(89/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-28T20:04:24.324 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:24.364 INFO:teuthology.orchestra.run.smithi007.stdout:(90/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-28T20:04:24.373 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:24.377 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:24.389 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:24.411 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.424 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.430 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.454 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.466 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.473 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.517 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:24.523 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:24.530 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:24.533 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.541 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.553 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.648 INFO:teuthology.orchestra.run.smithi007.stdout:(91/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.7 MB/s | 5.1 MB 00:01 2024-08-28T20:04:24.649 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.667 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.668 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.668 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.679 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.689 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.698 INFO:teuthology.orchestra.run.smithi007.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 838 kB/s | 42 kB 00:00 2024-08-28T20:04:24.716 INFO:teuthology.orchestra.run.smithi121.stdout:(154/160): libuuid-2.37.4-20.el9.x86_64.rpm 9.9 kB/s | 28 kB 00:02 2024-08-28T20:04:24.724 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:24.748 INFO:teuthology.orchestra.run.smithi007.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-08-28T20:04:24.751 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.757 INFO:teuthology.orchestra.run.smithi121.stdout:(155/160): libsmartcols-2.37.4-20.el9.x86_64.rp 22 kB/s | 63 kB 00:02 2024-08-28T20:04:24.761 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.770 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:24.788 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] openssl-libs-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/openssl-libs-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.802 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.808 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.815 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] util-linux-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/util-linux-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.818 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.827 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.840 INFO:teuthology.orchestra.run.smithi007.stdout:(94/160): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-08-28T20:04:24.862 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:24.882 INFO:teuthology.orchestra.run.smithi007.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 871 kB/s | 36 kB 00:00 2024-08-28T20:04:24.883 INFO:teuthology.orchestra.run.smithi121.stdout:(156/160): openssl-3.2.2-4.el9.x86_64.rpm 462 kB/s | 1.3 MB 00:02 2024-08-28T20:04:24.905 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.915 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.924 INFO:teuthology.orchestra.run.smithi007.stdout:(96/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-28T20:04:24.927 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:24.928 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.933 INFO:teuthology.orchestra.run.smithi121.stdout:(157/160): openssl-libs-3.2.2-4.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-08-28T20:04:24.936 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:24.958 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:24.984 INFO:teuthology.orchestra.run.smithi121.stdout:(158/160): util-linux-2.37.4-20.el9.x86_64.rpm 10 MB/s | 2.3 MB 00:00 2024-08-28T20:04:24.984 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] util-linux-core-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/util-linux-core-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.984 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:24.984 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] util-linux-user-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/util-linux-user-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:24.988 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:24.996 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:25.016 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:25.025 INFO:teuthology.orchestra.run.smithi121.stdout:(159/160): util-linux-core-2.37.4-20.el9.x86_64 3.2 MB/s | 464 kB 00:00 2024-08-28T20:04:25.033 INFO:teuthology.orchestra.run.smithi007.stdout:(97/160): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-28T20:04:25.036 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.042 INFO:teuthology.orchestra.run.smithi121.stdout:(160/160): util-linux-user-2.37.4-20.el9.x86_64 280 kB/s | 30 kB 00:00 2024-08-28T20:04:25.048 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.049 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-28T20:04:25.049 INFO:teuthology.orchestra.run.smithi121.stdout:Total 12 MB/s | 231 MB 00:19 2024-08-28T20:04:25.073 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.075 INFO:teuthology.orchestra.run.smithi007.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-08-28T20:04:25.075 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:25.125 INFO:teuthology.orchestra.run.smithi007.stdout:(99/160): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-28T20:04:25.135 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.147 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.159 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.168 INFO:teuthology.orchestra.run.smithi007.stdout:(100/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-28T20:04:25.168 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:25.210 INFO:teuthology.orchestra.run.smithi007.stdout:(101/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-08-28T20:04:25.224 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:25.236 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:25.248 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:25.303 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:25.369 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:25.378 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:25.390 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:25.391 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.428 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.428 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.437 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.442 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:25.448 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.448 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.454 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.460 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:25.513 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:25.513 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:25.521 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:25.627 INFO:teuthology.orchestra.run.smithi007.stdout:(102/160): openssl-devel-3.2.2-4.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-08-28T20:04:25.628 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-devel-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/libuuid-devel-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:25.636 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:25.658 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openblas-openmp-0.3.26-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:25.707 INFO:teuthology.orchestra.run.smithi001.stdout:(65/160): openblas-0.3.26-2.el9.x86_64.rpm 12 kB/s | 38 kB 00:03 2024-08-28T20:04:25.749 INFO:teuthology.orchestra.run.smithi001.stdout:(66/160): libuuid-devel-2.37.4-20.el9.x86_64.rp 7.3 kB/s | 24 kB 00:03 2024-08-28T20:04:25.802 INFO:teuthology.orchestra.run.smithi007.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-08-28T20:04:25.850 INFO:teuthology.orchestra.run.smithi001.stdout:(67/160): openblas-openmp-0.3.26-2.el9.x86_64.r 1.5 MB/s | 4.9 MB 00:03 2024-08-28T20:04:25.860 INFO:teuthology.orchestra.run.smithi007.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-08-28T20:04:25.886 INFO:teuthology.orchestra.run.smithi007.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-28T20:04:25.920 INFO:teuthology.orchestra.run.smithi007.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-08-28T20:04:26.028 INFO:teuthology.orchestra.run.smithi007.stdout:(107/160): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-28T20:04:26.053 INFO:teuthology.orchestra.run.smithi007.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-08-28T20:04:26.079 INFO:teuthology.orchestra.run.smithi007.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-28T20:04:26.104 INFO:teuthology.orchestra.run.smithi007.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-28T20:04:26.105 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:26.138 INFO:teuthology.orchestra.run.smithi007.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-08-28T20:04:26.171 INFO:teuthology.orchestra.run.smithi007.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-08-28T20:04:26.205 INFO:teuthology.orchestra.run.smithi007.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-28T20:04:26.230 INFO:teuthology.orchestra.run.smithi007.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-28T20:04:26.244 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-28T20:04:26.255 INFO:teuthology.orchestra.run.smithi007.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-28T20:04:26.270 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:26.281 INFO:teuthology.orchestra.run.smithi007.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-08-28T20:04:26.306 INFO:teuthology.orchestra.run.smithi007.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-28T20:04:26.307 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:26.340 INFO:teuthology.orchestra.run.smithi007.stdout:(118/160): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-08-28T20:04:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-08-28T20:04:26.390 INFO:teuthology.orchestra.run.smithi007.stdout:(120/160): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-08-28T20:04:26.413 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-28T20:04:26.413 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-28T20:04:26.457 INFO:teuthology.orchestra.run.smithi007.stdout:(121/160): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-08-28T20:04:26.483 INFO:teuthology.orchestra.run.smithi007.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-28T20:04:26.508 INFO:teuthology.orchestra.run.smithi007.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-08-28T20:04:26.533 INFO:teuthology.orchestra.run.smithi007.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-08-28T20:04:26.559 INFO:teuthology.orchestra.run.smithi007.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-08-28T20:04:26.584 INFO:teuthology.orchestra.run.smithi007.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 773 kB/s | 19 kB 00:00 2024-08-28T20:04:26.609 INFO:teuthology.orchestra.run.smithi007.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-08-28T20:04:26.640 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:26.660 INFO:teuthology.orchestra.run.smithi007.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-08-28T20:04:26.677 INFO:teuthology.orchestra.run.smithi007.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-08-28T20:04:26.702 INFO:teuthology.orchestra.run.smithi007.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-28T20:04:26.744 INFO:teuthology.orchestra.run.smithi007.stdout:(131/160): protobuf-compiler-3.14.0-13.el9.x86_ 773 kB/s | 863 kB 00:01 2024-08-28T20:04:26.761 INFO:teuthology.orchestra.run.smithi007.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-08-28T20:04:26.786 INFO:teuthology.orchestra.run.smithi007.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 981 kB/s | 16 kB 00:00 2024-08-28T20:04:26.812 INFO:teuthology.orchestra.run.smithi007.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.8 MB/s | 90 kB 00:00 2024-08-28T20:04:26.837 INFO:teuthology.orchestra.run.smithi007.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-28T20:04:26.854 INFO:teuthology.orchestra.run.smithi007.stdout:(136/160): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-08-28T20:04:26.879 INFO:teuthology.orchestra.run.smithi007.stdout:(137/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-08-28T20:04:26.905 INFO:teuthology.orchestra.run.smithi007.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-28T20:04:26.921 INFO:teuthology.orchestra.run.smithi007.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-08-28T20:04:26.947 INFO:teuthology.orchestra.run.smithi007.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-08-28T20:04:26.972 INFO:teuthology.orchestra.run.smithi007.stdout:(141/160): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-28T20:04:26.997 INFO:teuthology.orchestra.run.smithi007.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-28T20:04:27.023 INFO:teuthology.orchestra.run.smithi007.stdout:(143/160): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-28T20:04:27.048 INFO:teuthology.orchestra.run.smithi007.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-08-28T20:04:27.073 INFO:teuthology.orchestra.run.smithi007.stdout:(145/160): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-08-28T20:04:27.084 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:27.099 INFO:teuthology.orchestra.run.smithi007.stdout:(146/160): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-08-28T20:04:27.157 INFO:teuthology.orchestra.run.smithi007.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-28T20:04:27.160 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:27.193 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:27.300 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:27.363 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:27.457 INFO:teuthology.orchestra.run.smithi001.stdout:(68/160): postgresql-contrib-13.16-1.el9.x86_64 573 kB/s | 910 kB 00:01 2024-08-28T20:04:27.462 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:27.521 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:27.599 INFO:teuthology.orchestra.run.smithi007.stdout:(148/160): librados2-19.3.0-4560.gd19e6118.el9. 6.8 MB/s | 3.4 MB 00:00 2024-08-28T20:04:27.650 INFO:teuthology.orchestra.run.smithi007.stdout:(149/160): librbd1-19.3.0-4560.gd19e6118.el9.x8 6.5 MB/s | 3.1 MB 00:00 2024-08-28T20:04:27.650 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:27.653 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:27.680 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:27.681 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:27.710 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:27.711 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:27.742 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:27.770 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:27.790 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:27.834 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:27.847 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:27.875 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:27.882 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:27.883 INFO:teuthology.orchestra.run.smithi001.stdout:(69/160): postgresql-private-libs-13.16-1.el9.x 323 kB/s | 137 kB 00:00 2024-08-28T20:04:27.911 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:27.915 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:27.924 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:27.944 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:27.991 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:28.019 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:28.052 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:28.143 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:28.191 INFO:teuthology.orchestra.run.smithi001.stdout:(70/160): postgresql-13.16-1.el9.x86_64.rpm 666 kB/s | 1.6 MB 00:02 2024-08-28T20:04:28.224 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:28.261 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-28T20:04:28.262 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-28T20:04:28.281 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:28.378 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:28.475 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:28.533 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:28.593 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:28.614 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:28.625 INFO:teuthology.orchestra.run.smithi007.stdout:(150/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-08-28T20:04:28.700 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:28.704 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:28.756 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:28.822 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:28.852 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:28.880 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:28.983 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:28.990 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:28.994 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:29.009 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:29.015 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:29.020 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:29.049 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:29.052 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:29.078 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:29.120 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:29.126 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:29.151 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:29.163 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-devel-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:29.171 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:29.191 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:29.194 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:29.246 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:29.249 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:29.268 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:29.276 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:29.290 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:29.318 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:29.325 INFO:teuthology.orchestra.run.smithi001.stdout:(71/160): openssl-devel-3.2.2-4.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-08-28T20:04:29.343 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:29.346 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:29.392 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:29.397 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:29.467 INFO:teuthology.orchestra.run.smithi001.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 810 kB/s | 1.0 MB 00:01 2024-08-28T20:04:29.478 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:29.486 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:29.639 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:29.647 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:29.713 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:29.970 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:29.988 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:30.007 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:30.015 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:30.017 INFO:teuthology.orchestra.run.smithi001.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 126 kB/s | 87 kB 00:00 2024-08-28T20:04:30.025 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:30.027 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:30.034 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:30.046 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:30.081 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:30.098 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:30.103 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:30.110 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:30.129 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:30.157 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:30.186 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:30.207 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:30.220 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:30.237 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:30.242 INFO:teuthology.orchestra.run.smithi001.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 272 kB/s | 61 kB 00:00 2024-08-28T20:04:30.333 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:30.339 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:30.354 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:30.421 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:30.438 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:30.508 INFO:teuthology.orchestra.run.smithi007.stdout:(151/160): libblkid-2.37.4-20.el9.x86_64.rpm 37 kB/s | 107 kB 00:02 2024-08-28T20:04:30.509 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:30.542 INFO:teuthology.orchestra.run.smithi007.stdout:(152/160): libfdisk-2.37.4-20.el9.x86_64.rpm 53 kB/s | 154 kB 00:02 2024-08-28T20:04:30.572 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:30.593 INFO:teuthology.orchestra.run.smithi001.stdout:(75/160): python3-devel-3.9.19-7.el9.x86_64.rpm 699 kB/s | 245 kB 00:00 2024-08-28T20:04:30.610 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:30.622 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:30.660 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:30.679 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:30.707 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:30.736 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:30.744 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:30.767 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:30.777 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:30.795 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:30.871 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:30.898 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:30.903 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:30.911 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:30.931 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:30.938 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:30.943 INFO:teuthology.orchestra.run.smithi001.stdout:(76/160): python3-jinja2-2.11.3-6.el9.noarch.rp 710 kB/s | 248 kB 00:00 2024-08-28T20:04:30.966 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:30.993 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:31.018 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:31.026 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.20) 2024-08-28T20:04:31.052 INFO:teuthology.orchestra.run.smithi001.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-08-28T20:04:31.067 INFO:teuthology.orchestra.run.smithi007.stdout:(153/160): libmount-2.37.4-20.el9.x86_64.rpm 55 kB/s | 135 kB 00:02 2024-08-28T20:04:31.099 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:31.101 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:31.101 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:31.152 INFO:teuthology.orchestra.run.smithi001.stdout:(78/160): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-08-28T20:04:31.171 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:31.419 INFO:teuthology.orchestra.run.smithi001.stdout:(79/160): python3-mako-1.1.4-6.el9.noarch.rpm 646 kB/s | 172 kB 00:00 2024-08-28T20:04:31.519 INFO:teuthology.orchestra.run.smithi001.stdout:(80/160): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-08-28T20:04:31.551 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:31.573 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:31.605 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:31.637 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:31.655 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:31.659 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:31.664 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:31.677 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:31.951 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:31.960 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:31.994 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:32.000 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:32.002 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:32.055 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:32.055 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:32.060 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:32.109 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:32.110 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:32.116 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:32.182 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:32.189 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:32.199 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:32.234 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:32.240 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:32.250 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:32.326 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:32.333 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:32.342 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:32.486 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:32.492 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:32.501 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:32.573 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:32.580 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:32.597 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:32.615 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:32.617 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:32.635 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:32.946 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:32.952 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:32.963 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:33.010 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:33.014 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:33.025 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:33.028 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:33.032 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:33.044 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:33.162 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:33.169 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:33.185 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:33.234 INFO:teuthology.orchestra.run.smithi007.stdout:(154/160): libsmartcols-2.37.4-20.el9.x86_64.rp 23 kB/s | 63 kB 00:02 2024-08-28T20:04:33.259 INFO:teuthology.orchestra.run.smithi007.stdout:(155/160): libuuid-2.37.4-20.el9.x86_64.rpm 10 kB/s | 28 kB 00:02 2024-08-28T20:04:33.318 INFO:teuthology.orchestra.run.smithi007.stdout:(156/160): openssl-3.2.2-4.el9.x86_64.rpm 615 kB/s | 1.3 MB 00:02 2024-08-28T20:04:33.318 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] openssl-libs-3.2.2-4.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/openssl-libs-3.2.2-4.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:33.347 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] util-linux-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/util-linux-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:33.347 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] util-linux-core-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/util-linux-core-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:33.410 INFO:teuthology.orchestra.run.smithi007.stdout:(157/160): util-linux-core-2.37.4-20.el9.x86_64 4.9 MB/s | 464 kB 00:00 2024-08-28T20:04:33.460 INFO:teuthology.orchestra.run.smithi007.stdout:(158/160): openssl-libs-3.2.2-4.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-08-28T20:04:33.502 INFO:teuthology.orchestra.run.smithi007.stdout:(159/160): util-linux-2.37.4-20.el9.x86_64.rpm 9.4 MB/s | 2.3 MB 00:00 2024-08-28T20:04:33.502 INFO:teuthology.orchestra.run.smithi007.stdout:[MIRROR] util-linux-user-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/util-linux-user-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:33.544 INFO:teuthology.orchestra.run.smithi007.stdout:(160/160): util-linux-user-2.37.4-20.el9.x86_64 228 kB/s | 30 kB 00:00 2024-08-28T20:04:33.551 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-08-28T20:04:33.551 INFO:teuthology.orchestra.run.smithi007.stdout:Total 11 MB/s | 231 MB 00:21 2024-08-28T20:04:34.773 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-08-28T20:04:34.840 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-28T20:04:34.912 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-4.el9.x86_64 1/172 2024-08-28T20:04:34.956 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-08-28T20:04:34.956 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-08-28T20:04:34.974 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libuuid-2.37.4-20.el9.x86_64 2/172 2024-08-28T20:04:34.995 INFO:teuthology.orchestra.run.smithi001.stdout:(81/160): postgresql-server-13.16-1.el9.x86_64. 832 kB/s | 5.8 MB 00:07 2024-08-28T20:04:35.047 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libblkid-2.37.4-20.el9.x86_64 3/172 2024-08-28T20:04:35.057 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libblkid-2.37.4-20.el9.x86_64 3/172 2024-08-28T20:04:35.168 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/172 2024-08-28T20:04:35.221 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/172 2024-08-28T20:04:35.264 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/172 2024-08-28T20:04:35.290 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/172 2024-08-28T20:04:35.332 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/172 2024-08-28T20:04:35.361 INFO:teuthology.orchestra.run.smithi001.stdout:(82/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 687 kB/s | 250 kB 00:00 2024-08-28T20:04:35.665 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/172 2024-08-28T20:04:35.712 INFO:teuthology.orchestra.run.smithi001.stdout:(83/160): python3-oauthlib-3.1.1-5.el9.noarch.r 635 kB/s | 222 kB 00:00 2024-08-28T20:04:35.782 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:04:35.895 INFO:teuthology.orchestra.run.smithi001.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-08-28T20:04:35.909 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:04:35.933 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:04:35.996 INFO:teuthology.orchestra.run.smithi001.stdout:(85/160): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-08-28T20:04:36.025 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:04:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 12/172 2024-08-28T20:04:36.216 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 13/172 2024-08-28T20:04:36.269 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.16-1.el9.x86_64 14/172 2024-08-28T20:04:36.296 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 15/172 2024-08-28T20:04:36.403 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 15/172 2024-08-28T20:04:36.421 INFO:teuthology.orchestra.run.smithi001.stdout:(86/160): python3-protobuf-3.14.0-13.el9.noarch 634 kB/s | 269 kB 00:00 2024-08-28T20:04:36.431 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 16/172 2024-08-28T20:04:36.478 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 16/172 2024-08-28T20:04:36.526 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libmount-2.37.4-20.el9.x86_64 17/172 2024-08-28T20:04:36.557 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 18/172 2024-08-28T20:04:36.581 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 18/172 2024-08-28T20:04:36.688 INFO:teuthology.orchestra.run.smithi001.stdout:(87/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 595 kB/s | 159 kB 00:00 2024-08-28T20:04:36.883 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 19/172 2024-08-28T20:04:36.895 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-08-28T20:04:36.895 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-08-28T20:04:36.896 INFO:teuthology.orchestra.run.smithi001.stdout:(88/160): python3-babel-2.9.1-2.el9.noarch.rpm 822 kB/s | 6.0 MB 00:07 2024-08-28T20:04:36.913 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 19/172 2024-08-28T20:04:36.949 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libsmartcols-2.37.4-20.el9.x86_64 20/172 2024-08-28T20:04:37.037 INFO:teuthology.orchestra.run.smithi001.stdout:(89/160): python3-pytz-2021.1-5.el9.noarch.rpm 364 kB/s | 51 kB 00:00 2024-08-28T20:04:37.066 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 21/172 2024-08-28T20:04:37.106 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-08-28T20:04:37.140 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-08-28T20:04:37.147 INFO:teuthology.orchestra.run.smithi001.stdout:(90/160): python3-requests-oauthlib-1.3.0-12.el 488 kB/s | 54 kB 00:00 2024-08-28T20:04:37.173 INFO:teuthology.orchestra.run.smithi001.stdout:(91/160): python3-pyasn1-modules-0.4.8-6.el9.no 576 kB/s | 279 kB 00:00 2024-08-28T20:04:37.205 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-08-28T20:04:37.249 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-08-28T20:04:37.281 INFO:teuthology.orchestra.run.smithi001.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-08-28T20:04:37.281 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-08-28T20:04:37.325 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-08-28T20:04:37.357 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-08-28T20:04:37.385 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-08-28T20:04:37.406 INFO:teuthology.orchestra.run.smithi001.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 353 kB/s | 44 kB 00:00 2024-08-28T20:04:37.454 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-08-28T20:04:37.507 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-08-28T20:04:37.538 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-08-28T20:04:37.565 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 33/172 2024-08-28T20:04:37.632 INFO:teuthology.orchestra.run.smithi001.stdout:(94/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 854 kB/s | 5.1 MB 00:06 2024-08-28T20:04:37.633 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 34/172 2024-08-28T20:04:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 35/172 2024-08-28T20:04:37.712 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 36/172 2024-08-28T20:04:37.740 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 37/172 2024-08-28T20:04:37.774 INFO:teuthology.orchestra.run.smithi001.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 254 kB/s | 36 kB 00:00 2024-08-28T20:04:37.807 INFO:teuthology.orchestra.run.smithi001.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 551 kB/s | 221 kB 00:00 2024-08-28T20:04:37.809 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-08-28T20:04:37.854 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-08-28T20:04:37.874 INFO:teuthology.orchestra.run.smithi001.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-08-28T20:04:37.928 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-08-28T20:04:38.058 INFO:teuthology.orchestra.run.smithi001.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 315 kB/s | 58 kB 00:00 2024-08-28T20:04:38.060 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-08-28T20:04:38.115 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-08-28T20:04:38.250 INFO:teuthology.orchestra.run.smithi001.stdout:(99/160): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 500 kB/s | 96 kB 00:00 2024-08-28T20:04:38.284 INFO:teuthology.orchestra.run.smithi001.stdout:(100/160): socat-1.7.4.1-6.el9.x86_64.rpm 639 kB/s | 304 kB 00:00 2024-08-28T20:04:38.392 INFO:teuthology.orchestra.run.smithi001.stdout:(101/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 415 kB/s | 45 kB 00:00 2024-08-28T20:04:38.434 INFO:teuthology.orchestra.run.smithi001.stdout:(102/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 346 kB/s | 64 kB 00:00 2024-08-28T20:04:38.518 INFO:teuthology.orchestra.run.smithi001.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-08-28T20:04:38.585 INFO:teuthology.orchestra.run.smithi001.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-08-28T20:04:38.619 INFO:teuthology.orchestra.run.smithi001.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-28T20:04:38.636 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-08-28T20:04:38.643 INFO:teuthology.orchestra.run.smithi001.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 793 kB/s | 19 kB 00:00 2024-08-28T20:04:38.686 INFO:teuthology.orchestra.run.smithi001.stdout:(107/160): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-08-28T20:04:38.740 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-08-28T20:04:38.761 INFO:teuthology.orchestra.run.smithi001.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 348 kB/s | 26 kB 00:00 2024-08-28T20:04:38.786 INFO:teuthology.orchestra.run.smithi001.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-28T20:04:38.812 INFO:teuthology.orchestra.run.smithi001.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-28T20:04:38.849 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-08-28T20:04:38.856 INFO:teuthology.orchestra.run.smithi001.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 3.3 MB/s | 151 kB 00:00 2024-08-28T20:04:38.904 INFO:teuthology.orchestra.run.smithi001.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 18 MB/s | 839 kB 00:00 2024-08-28T20:04:38.905 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-core-2.37.4-20.el9.x86_64 46/172 2024-08-28T20:04:38.915 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: util-linux-core-2.37.4-20.el9.x86_64 46/172 2024-08-28T20:04:38.953 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 47/172 2024-08-28T20:04:38.971 INFO:teuthology.orchestra.run.smithi001.stdout:(113/160): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-08-28T20:04:38.990 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 48/172 2024-08-28T20:04:38.996 INFO:teuthology.orchestra.run.smithi001.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-28T20:04:39.020 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-08-28T20:04:39.021 INFO:teuthology.orchestra.run.smithi001.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-28T20:04:39.243 INFO:teuthology.orchestra.run.smithi001.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 64 kB/s | 14 kB 00:00 2024-08-28T20:04:39.280 INFO:teuthology.orchestra.run.smithi001.stdout:(117/160): python3-asyncssh-2.13.2-5.el9.noarch 1.4 MB/s | 548 kB 00:00 2024-08-28T20:04:39.304 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libfdisk-2.37.4-20.el9.x86_64 50/172 2024-08-28T20:04:39.306 INFO:teuthology.orchestra.run.smithi001.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.7 MB/s | 172 kB 00:00 2024-08-28T20:04:39.339 INFO:teuthology.orchestra.run.smithi001.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-28T20:04:39.364 INFO:teuthology.orchestra.run.smithi001.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-28T20:04:39.398 INFO:teuthology.orchestra.run.smithi001.stdout:(121/160): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-28T20:04:39.424 INFO:teuthology.orchestra.run.smithi001.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-28T20:04:39.449 INFO:teuthology.orchestra.run.smithi001.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-08-28T20:04:39.474 INFO:teuthology.orchestra.run.smithi001.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-08-28T20:04:39.488 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-2.37.4-20.el9.x86_64 51/172 2024-08-28T20:04:39.499 INFO:teuthology.orchestra.run.smithi001.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-08-28T20:04:39.524 INFO:teuthology.orchestra.run.smithi001.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 788 kB/s | 19 kB 00:00 2024-08-28T20:04:39.531 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 52/172 2024-08-28T20:04:39.550 INFO:teuthology.orchestra.run.smithi001.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-08-28T20:04:39.642 INFO:teuthology.orchestra.run.smithi001.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-08-28T20:04:39.667 INFO:teuthology.orchestra.run.smithi001.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-28T20:04:39.692 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 53/172 2024-08-28T20:04:39.709 INFO:teuthology.orchestra.run.smithi001.stdout:(130/160): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-08-28T20:04:39.735 INFO:teuthology.orchestra.run.smithi001.stdout:(131/160): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-08-28T20:04:39.759 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-4.el9.x86_64 54/172 2024-08-28T20:04:39.760 INFO:teuthology.orchestra.run.smithi001.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-28T20:04:39.785 INFO:teuthology.orchestra.run.smithi001.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-28T20:04:39.810 INFO:teuthology.orchestra.run.smithi001.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-08-28T20:04:39.836 INFO:teuthology.orchestra.run.smithi001.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-28T20:04:39.850 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 55/172 2024-08-28T20:04:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:(136/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-08-28T20:04:39.886 INFO:teuthology.orchestra.run.smithi001.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-08-28T20:04:39.912 INFO:teuthology.orchestra.run.smithi001.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-28T20:04:39.923 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 56/172 2024-08-28T20:04:39.965 INFO:teuthology.orchestra.run.smithi001.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-28T20:04:39.995 INFO:teuthology.orchestra.run.smithi001.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-08-28T20:04:39.996 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/172 2024-08-28T20:04:40.021 INFO:teuthology.orchestra.run.smithi001.stdout:(141/160): python3-typing-extensions-4.12.2-2.e 1.3 MB/s | 74 kB 00:00 2024-08-28T20:04:40.037 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 58/172 2024-08-28T20:04:40.063 INFO:teuthology.orchestra.run.smithi001.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-08-28T20:04:40.072 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 59/172 2024-08-28T20:04:40.088 INFO:teuthology.orchestra.run.smithi001.stdout:(143/160): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-28T20:04:40.113 INFO:teuthology.orchestra.run.smithi001.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-08-28T20:04:40.119 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/172 2024-08-28T20:04:40.147 INFO:teuthology.orchestra.run.smithi001.stdout:(145/160): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-08-28T20:04:40.164 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/172 2024-08-28T20:04:40.172 INFO:teuthology.orchestra.run.smithi001.stdout:(146/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-08-28T20:04:40.206 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 62/172 2024-08-28T20:04:40.231 INFO:teuthology.orchestra.run.smithi001.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-28T20:04:40.249 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 63/172 2024-08-28T20:04:40.383 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 64/172 2024-08-28T20:04:40.417 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 65/172 2024-08-28T20:04:40.458 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 66/172 2024-08-28T20:04:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 67/172 2024-08-28T20:04:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 68/172 2024-08-28T20:04:40.632 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/172 2024-08-28T20:04:40.696 INFO:teuthology.orchestra.run.smithi001.stdout:(148/160): librados2-19.3.0-4560.gd19e6118.el9. 6.5 MB/s | 3.4 MB 00:00 2024-08-28T20:04:40.748 INFO:teuthology.orchestra.run.smithi001.stdout:(149/160): librbd1-19.3.0-4560.gd19e6118.el9.x8 6.2 MB/s | 3.1 MB 00:00 2024-08-28T20:04:40.817 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 70/172 2024-08-28T20:04:40.908 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 71/172 2024-08-28T20:04:40.977 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/172 2024-08-28T20:04:41.102 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 73/172 2024-08-28T20:04:41.138 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:41.149 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/172 2024-08-28T20:04:41.176 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/172 2024-08-28T20:04:41.186 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:41.211 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 76/172 2024-08-28T20:04:41.250 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 77/172 2024-08-28T20:04:41.281 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/172 2024-08-28T20:04:41.311 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 79/172 2024-08-28T20:04:41.345 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 80/172 2024-08-28T20:04:41.379 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 81/172 2024-08-28T20:04:41.412 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 82/172 2024-08-28T20:04:41.455 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 83/172 2024-08-28T20:04:41.468 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:41.482 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:41.504 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:41.519 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:41.540 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 84/172 2024-08-28T20:04:41.562 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:41.576 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:41.585 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 85/172 2024-08-28T20:04:41.616 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 86/172 2024-08-28T20:04:41.659 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:41.673 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:41.692 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:41.721 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-28T20:04:41.770 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:41.775 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 88/172 2024-08-28T20:04:41.782 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:41.812 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:41.825 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:41.892 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:41.904 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:41.952 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:41.964 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:42.082 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:42.094 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:42.144 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:42.155 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:42.249 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:42.260 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:42.409 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:42.421 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:42.522 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 89/172 2024-08-28T20:04:42.581 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 90/172 2024-08-28T20:04:42.615 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 91/172 2024-08-28T20:04:42.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 92/172 2024-08-28T20:04:42.744 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:42.755 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:42.762 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 93/172 2024-08-28T20:04:42.806 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 94/172 2024-08-28T20:04:42.833 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:42.844 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:42.895 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/172 2024-08-28T20:04:42.926 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/172 2024-08-28T20:04:42.977 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:42.993 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:43.040 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:43.067 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:43.111 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 97/172 2024-08-28T20:04:43.140 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 98/172 2024-08-28T20:04:43.157 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:43.157 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:43.217 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/172 2024-08-28T20:04:43.223 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:43.223 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:43.336 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:43.345 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:43.387 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:43.397 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:43.478 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-08-28T20:04:43.488 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:43.615 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.2-4.el9.x86_64 1/172 2024-08-28T20:04:43.615 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:43.625 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:43.640 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libuuid-2.37.4-20.el9.x86_64 2/172 2024-08-28T20:04:43.679 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libblkid-2.37.4-20.el9.x86_64 3/172 2024-08-28T20:04:43.689 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libblkid-2.37.4-20.el9.x86_64 3/172 2024-08-28T20:04:43.697 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:43.718 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:43.730 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/172 2024-08-28T20:04:43.748 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:43.759 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:43.767 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:43.776 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:43.783 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/172 2024-08-28T20:04:43.788 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:43.796 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:43.825 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/172 2024-08-28T20:04:43.845 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/172 2024-08-28T20:04:43.848 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libblkid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libblkid-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:43.851 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/172 2024-08-28T20:04:43.855 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libfdisk-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libfdisk-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:43.894 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/172 2024-08-28T20:04:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/172 2024-08-28T20:04:43.957 INFO:teuthology.orchestra.run.smithi001.stdout:(150/160): libblkid-2.37.4-20.el9.x86_64.rpm 33 kB/s | 107 kB 00:03 2024-08-28T20:04:43.990 INFO:teuthology.orchestra.run.smithi001.stdout:(151/160): libfdisk-2.37.4-20.el9.x86_64.rpm 47 kB/s | 154 kB 00:03 2024-08-28T20:04:44.253 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/172 2024-08-28T20:04:44.258 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:44.290 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:44.325 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 199.223.246.113) 2024-08-28T20:04:44.385 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:04:44.514 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:04:44.536 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:04:44.611 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:04:44.632 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 12/172 2024-08-28T20:04:44.752 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:44.765 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 13/172 2024-08-28T20:04:44.812 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:44.822 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.16-1.el9.x86_64 14/172 2024-08-28T20:04:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 15/172 2024-08-28T20:04:44.910 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-28T20:04:44.942 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:44.990 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 15/172 2024-08-28T20:04:45.017 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 16/172 2024-08-28T20:04:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-28T20:04:45.064 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:45.073 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:45.081 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 16/172 2024-08-28T20:04:45.130 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libmount-2.37.4-20.el9.x86_64 17/172 2024-08-28T20:04:45.142 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:45.152 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 18/172 2024-08-28T20:04:45.153 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-28T20:04:45.164 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/172 2024-08-28T20:04:45.175 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 18/172 2024-08-28T20:04:45.200 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:45.212 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:45.252 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/172 2024-08-28T20:04:45.279 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/172 2024-08-28T20:04:45.331 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:45.341 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-28T20:04:45.392 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:45.404 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:45.481 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 19/172 2024-08-28T20:04:45.499 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 19/172 2024-08-28T20:04:45.511 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-28T20:04:45.544 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libsmartcols-2.37.4-20.el9.x86_64 20/172 2024-08-28T20:04:45.607 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/172 2024-08-28T20:04:45.650 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 106/172 2024-08-28T20:04:45.660 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 21/172 2024-08-28T20:04:45.673 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-08-28T20:04:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-08-28T20:04:45.742 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 106/172 2024-08-28T20:04:45.764 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/172 2024-08-28T20:04:45.796 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-08-28T20:04:45.816 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/172 2024-08-28T20:04:45.847 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-08-28T20:04:45.886 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-08-28T20:04:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-08-28T20:04:45.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-08-28T20:04:45.990 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-08-28T20:04:45.994 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:46.007 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-28T20:04:46.071 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-08-28T20:04:46.082 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:46.097 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:46.147 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-08-28T20:04:46.177 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-08-28T20:04:46.212 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 33/172 2024-08-28T20:04:46.229 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:46.244 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirrors.lug.mtu.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 141.219.188.21) 2024-08-28T20:04:46.291 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:46.292 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 34/172 2024-08-28T20:04:46.314 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 35/172 2024-08-28T20:04:46.315 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 109/172 2024-08-28T20:04:46.318 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-28T20:04:46.345 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 110/172 2024-08-28T20:04:46.350 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 36/172 2024-08-28T20:04:46.378 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 37/172 2024-08-28T20:04:46.387 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:46.403 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 172.65.90.22) 2024-08-28T20:04:46.408 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 110/172 2024-08-28T20:04:46.430 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 111/172 2024-08-28T20:04:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-08-28T20:04:46.451 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:46.469 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:46.493 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-08-28T20:04:46.565 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:46.572 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-08-28T20:04:46.581 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-28T20:04:46.617 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:46.633 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:46.705 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-08-28T20:04:46.723 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://ord.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 166.78.229.131) 2024-08-28T20:04:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-08-28T20:04:46.842 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:46.862 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:46.924 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:46.946 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-28T20:04:46.977 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:46.986 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:47.000 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:47.011 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://iad.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 72.4.120.219) 2024-08-28T20:04:47.020 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:47.045 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:47.082 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libmount-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libmount-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:47.102 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libsmartcols-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libsmartcols-2.37.4-20.el9.x86_64.rpm (IP: 163.114.130.31) 2024-08-28T20:04:47.199 INFO:teuthology.orchestra.run.smithi001.stdout:(152/160): libmount-2.37.4-20.el9.x86_64.rpm 42 kB/s | 135 kB 00:03 2024-08-28T20:04:47.232 INFO:teuthology.orchestra.run.smithi001.stdout:(153/160): libsmartcols-2.37.4-20.el9.x86_64.rp 19 kB/s | 63 kB 00:03 2024-08-28T20:04:47.333 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-08-28T20:04:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-08-28T20:04:47.517 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-08-28T20:04:47.569 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : util-linux-core-2.37.4-20.el9.x86_64 46/172 2024-08-28T20:04:47.579 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: util-linux-core-2.37.4-20.el9.x86_64 46/172 2024-08-28T20:04:47.625 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 47/172 2024-08-28T20:04:47.641 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] libuuid-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/libuuid-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:47.663 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 48/172 2024-08-28T20:04:47.674 INFO:teuthology.orchestra.run.smithi001.stdout:(154/160): libuuid-2.37.4-20.el9.x86_64.rpm 59 kB/s | 28 kB 00:00 2024-08-28T20:04:47.687 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/openssl-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:47.692 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-08-28T20:04:47.758 INFO:teuthology.orchestra.run.smithi001.stdout:(155/160): openssl-3.2.2-4.el9.x86_64.rpm 2.6 MB/s | 1.3 MB 00:00 2024-08-28T20:04:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : libfdisk-2.37.4-20.el9.x86_64 50/172 2024-08-28T20:04:48.129 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] openssl-libs-3.2.2-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/openssl-libs-3.2.2-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:48.194 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : util-linux-2.37.4-20.el9.x86_64 51/172 2024-08-28T20:04:48.208 INFO:teuthology.orchestra.run.smithi001.stdout:(156/160): openssl-libs-3.2.2-4.el9.x86_64.rpm 4.5 MB/s | 2.4 MB 00:00 2024-08-28T20:04:48.235 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] util-linux-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/util-linux-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:48.240 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 52/172 2024-08-28T20:04:48.325 INFO:teuthology.orchestra.run.smithi001.stdout:(157/160): util-linux-2.37.4-20.el9.x86_64.rpm 4.0 MB/s | 2.3 MB 00:00 2024-08-28T20:04:48.389 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 53/172 2024-08-28T20:04:48.442 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.2-4.el9.x86_64 54/172 2024-08-28T20:04:48.529 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 55/172 2024-08-28T20:04:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 56/172 2024-08-28T20:04:48.658 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:04:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/172 2024-08-28T20:04:48.693 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:04:48.699 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] util-linux-core-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/util-linux-core-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 58/172 2024-08-28T20:04:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 59/172 2024-08-28T20:04:48.743 INFO:teuthology.orchestra.run.smithi001.stdout:(158/160): util-linux-core-2.37.4-20.el9.x86_64 870 kB/s | 464 kB 00:00 2024-08-28T20:04:48.767 INFO:teuthology.orchestra.run.smithi001.stdout:[MIRROR] util-linux-user-2.37.4-20.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/util-linux-user-2.37.4-20.el9.x86_64.rpm (IP: 104.251.122.5) 2024-08-28T20:04:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/172 2024-08-28T20:04:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/172 2024-08-28T20:04:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 62/172 2024-08-28T20:04:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 63/172 2024-08-28T20:04:49.047 INFO:teuthology.orchestra.run.smithi001.stdout:(159/160): util-linux-user-2.37.4-20.el9.x86_64 42 kB/s | 30 kB 00:00 2024-08-28T20:04:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 64/172 2024-08-28T20:04:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 65/172 2024-08-28T20:04:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 66/172 2024-08-28T20:04:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 67/172 2024-08-28T20:04:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:04:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 68/172 2024-08-28T20:04:49.305 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 113/172 2024-08-28T20:04:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/172 2024-08-28T20:04:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 70/172 2024-08-28T20:04:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 71/172 2024-08-28T20:04:49.376 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 113/172 2024-08-28T20:04:49.377 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-28T20:04:49.377 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-28T20:04:49.377 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:04:49.406 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 114/172 2024-08-28T20:04:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/172 2024-08-28T20:04:49.565 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 73/172 2024-08-28T20:04:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/172 2024-08-28T20:04:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/172 2024-08-28T20:04:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 76/172 2024-08-28T20:04:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 77/172 2024-08-28T20:04:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/172 2024-08-28T20:04:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 79/172 2024-08-28T20:04:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 80/172 2024-08-28T20:04:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 81/172 2024-08-28T20:04:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 82/172 2024-08-28T20:04:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 83/172 2024-08-28T20:04:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 84/172 2024-08-28T20:04:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 85/172 2024-08-28T20:04:50.085 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 86/172 2024-08-28T20:04:50.193 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-28T20:04:50.246 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 88/172 2024-08-28T20:04:51.004 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 89/172 2024-08-28T20:04:51.058 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 90/172 2024-08-28T20:04:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 91/172 2024-08-28T20:04:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 92/172 2024-08-28T20:04:51.231 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 93/172 2024-08-28T20:04:51.276 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 94/172 2024-08-28T20:04:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/172 2024-08-28T20:04:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/172 2024-08-28T20:04:51.596 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 97/172 2024-08-28T20:04:51.626 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 98/172 2024-08-28T20:04:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/172 2024-08-28T20:04:52.368 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/172 2024-08-28T20:04:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/172 2024-08-28T20:04:53.783 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/172 2024-08-28T20:04:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/172 2024-08-28T20:04:53.883 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/172 2024-08-28T20:04:54.228 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/172 2024-08-28T20:04:54.271 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 106/172 2024-08-28T20:04:54.363 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 106/172 2024-08-28T20:04:54.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/172 2024-08-28T20:04:54.429 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/172 2024-08-28T20:04:54.956 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 109/172 2024-08-28T20:04:54.983 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 110/172 2024-08-28T20:04:55.054 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 110/172 2024-08-28T20:04:55.076 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 111/172 2024-08-28T20:04:57.134 INFO:teuthology.orchestra.run.smithi001.stdout:(160/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 833 kB/s | 16 MB 00:19 2024-08-28T20:04:57.144 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-08-28T20:04:57.145 INFO:teuthology.orchestra.run.smithi001.stdout:Total 5.2 MB/s | 231 MB 00:44 2024-08-28T20:04:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:04:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:04:58.078 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:04:58.117 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 113/172 2024-08-28T20:04:58.191 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 113/172 2024-08-28T20:04:58.191 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-28T20:04:58.191 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-28T20:04:58.191 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:04:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 114/172 2024-08-28T20:04:59.265 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-08-28T20:04:59.504 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-08-28T20:04:59.505 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-08-28T20:05:00.924 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 114/172 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-08-28T20:05:00.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:01.101 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 115/172 2024-08-28T20:05:01.117 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 115/172 2024-08-28T20:05:01.117 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:01.117 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-28T20:05:01.117 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:01.998 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-08-28T20:05:01.998 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-08-28T20:05:02.696 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 116/172 2024-08-28T20:05:02.722 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 116/172 2024-08-28T20:05:02.722 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:02.722 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-28T20:05:02.722 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T20:05:02.722 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T20:05:02.722 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 117/172 2024-08-28T20:05:02.977 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 117/172 2024-08-28T20:05:02.977 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:02.977 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-28T20:05:02.977 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T20:05:02.977 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T20:05:02.977 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:03.447 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 118/172 2024-08-28T20:05:03.469 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 118/172 2024-08-28T20:05:03.469 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:03.470 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-28T20:05:03.470 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T20:05:03.470 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T20:05:03.470 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:03.577 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 119/172 2024-08-28T20:05:03.634 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 120/172 2024-08-28T20:05:03.689 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 121/172 2024-08-28T20:05:03.874 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 122/172 2024-08-28T20:05:03.931 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 123/172 2024-08-28T20:05:04.008 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/172 2024-08-28T20:05:04.096 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 125/172 2024-08-28T20:05:04.228 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 126/172 2024-08-28T20:05:04.264 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 127/172 2024-08-28T20:05:04.297 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 128/172 2024-08-28T20:05:04.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 129/172 2024-08-28T20:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 130/172 2024-08-28T20:05:04.747 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 130/172 2024-08-28T20:05:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 131/172 2024-08-28T20:05:04.848 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 132/172 2024-08-28T20:05:04.879 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 133/172 2024-08-28T20:05:08.041 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 133/172 2024-08-28T20:05:08.101 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 134/172 2024-08-28T20:05:09.062 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 134/172 2024-08-28T20:05:09.085 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 135/172 2024-08-28T20:05:09.199 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 135/172 2024-08-28T20:05:09.250 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-08-28T20:05:09.369 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 136/172 2024-08-28T20:05:09.404 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 137/172 2024-08-28T20:05:09.422 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-4.el9.x86_64 1/172 2024-08-28T20:05:09.427 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 137/172 2024-08-28T20:05:09.427 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:09.427 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-28T20:05:09.428 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T20:05:09.428 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T20:05:09.428 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:09.473 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libuuid-2.37.4-20.el9.x86_64 2/172 2024-08-28T20:05:09.479 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 138/172 2024-08-28T20:05:09.491 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 138/172 2024-08-28T20:05:09.527 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libblkid-2.37.4-20.el9.x86_64 3/172 2024-08-28T20:05:09.554 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libblkid-2.37.4-20.el9.x86_64 3/172 2024-08-28T20:05:09.589 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 139/172 2024-08-28T20:05:09.620 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/172 2024-08-28T20:05:09.635 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 140/172 2024-08-28T20:05:09.701 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/172 2024-08-28T20:05:09.742 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/172 2024-08-28T20:05:09.774 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/172 2024-08-28T20:05:09.846 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/172 2024-08-28T20:05:10.251 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/172 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 114/172 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-08-28T20:05:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:10.391 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:05:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 115/172 2024-08-28T20:05:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 115/172 2024-08-28T20:05:10.500 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:10.500 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-28T20:05:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:10.544 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:05:10.575 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:05:10.592 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 141/172 2024-08-28T20:05:10.623 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 142/172 2024-08-28T20:05:10.646 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 142/172 2024-08-28T20:05:10.646 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:10.646 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-28T20:05:10.647 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T20:05:10.647 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T20:05:10.647 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:10.673 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:05:10.690 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 143/172 2024-08-28T20:05:10.713 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 143/172 2024-08-28T20:05:10.713 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:10.713 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-28T20:05:10.713 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:10.722 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 12/172 2024-08-28T20:05:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 144/172 2024-08-28T20:05:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 144/172 2024-08-28T20:05:10.781 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:10.781 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-28T20:05:10.781 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T20:05:10.781 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T20:05:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:10.953 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 13/172 2024-08-28T20:05:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 14/172 2024-08-28T20:05:11.072 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 15/172 2024-08-28T20:05:11.109 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 145/172 2024-08-28T20:05:11.132 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 145/172 2024-08-28T20:05:11.132 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:11.132 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-28T20:05:11.132 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T20:05:11.132 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T20:05:11.132 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:11.186 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 15/172 2024-08-28T20:05:11.223 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 16/172 2024-08-28T20:05:11.342 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 16/172 2024-08-28T20:05:11.416 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libmount-2.37.4-20.el9.x86_64 17/172 2024-08-28T20:05:11.450 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 18/172 2024-08-28T20:05:11.491 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 18/172 2024-08-28T20:05:11.832 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 19/172 2024-08-28T20:05:11.900 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 19/172 2024-08-28T20:05:11.952 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libsmartcols-2.37.4-20.el9.x86_64 20/172 2024-08-28T20:05:12.092 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 21/172 2024-08-28T20:05:12.142 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-08-28T20:05:12.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 116/172 2024-08-28T20:05:12.180 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 116/172 2024-08-28T20:05:12.180 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:12.180 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-28T20:05:12.180 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T20:05:12.181 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T20:05:12.181 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:12.187 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-08-28T20:05:12.272 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-08-28T20:05:12.342 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-08-28T20:05:12.387 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-08-28T20:05:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 117/172 2024-08-28T20:05:12.436 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 117/172 2024-08-28T20:05:12.436 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-28T20:05:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T20:05:12.437 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T20:05:12.437 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:12.442 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-08-28T20:05:12.509 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-08-28T20:05:12.547 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-08-28T20:05:12.647 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-08-28T20:05:12.717 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-08-28T20:05:12.750 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-08-28T20:05:12.797 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 33/172 2024-08-28T20:05:12.881 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 34/172 2024-08-28T20:05:12.921 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 35/172 2024-08-28T20:05:12.930 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 118/172 2024-08-28T20:05:12.953 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 118/172 2024-08-28T20:05:12.953 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:12.953 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-28T20:05:12.953 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T20:05:12.953 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T20:05:12.953 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:12.966 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 36/172 2024-08-28T20:05:12.992 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 37/172 2024-08-28T20:05:13.070 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 119/172 2024-08-28T20:05:13.094 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-08-28T20:05:13.127 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 120/172 2024-08-28T20:05:13.163 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-08-28T20:05:13.193 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 121/172 2024-08-28T20:05:13.289 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-08-28T20:05:13.385 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 122/172 2024-08-28T20:05:13.432 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 123/172 2024-08-28T20:05:13.465 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-08-28T20:05:13.505 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/172 2024-08-28T20:05:13.534 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-08-28T20:05:13.593 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 125/172 2024-08-28T20:05:13.737 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 126/172 2024-08-28T20:05:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 127/172 2024-08-28T20:05:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 128/172 2024-08-28T20:05:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 129/172 2024-08-28T20:05:14.197 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 130/172 2024-08-28T20:05:14.224 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 130/172 2024-08-28T20:05:14.240 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-08-28T20:05:14.265 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 131/172 2024-08-28T20:05:14.333 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 132/172 2024-08-28T20:05:14.362 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-08-28T20:05:14.363 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 133/172 2024-08-28T20:05:14.490 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-08-28T20:05:14.558 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : util-linux-core-2.37.4-20.el9.x86_64 46/172 2024-08-28T20:05:14.580 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: util-linux-core-2.37.4-20.el9.x86_64 46/172 2024-08-28T20:05:14.628 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 47/172 2024-08-28T20:05:14.703 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 48/172 2024-08-28T20:05:14.741 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-08-28T20:05:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libfdisk-2.37.4-20.el9.x86_64 50/172 2024-08-28T20:05:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : util-linux-2.37.4-20.el9.x86_64 51/172 2024-08-28T20:05:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 52/172 2024-08-28T20:05:15.521 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 146/172 2024-08-28T20:05:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 53/172 2024-08-28T20:05:15.562 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 147/172 2024-08-28T20:05:15.592 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 148/172 2024-08-28T20:05:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-4.el9.x86_64 54/172 2024-08-28T20:05:15.619 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 149/172 2024-08-28T20:05:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 55/172 2024-08-28T20:05:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 150/172 2024-08-28T20:05:15.820 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 56/172 2024-08-28T20:05:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 151/172 2024-08-28T20:05:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 152/172 2024-08-28T20:05:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/172 2024-08-28T20:05:15.925 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-user-2.37.4-20.el9.x86_64 153/172 2024-08-28T20:05:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 58/172 2024-08-28T20:05:15.956 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 154/172 2024-08-28T20:05:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 59/172 2024-08-28T20:05:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/172 2024-08-28T20:05:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/172 2024-08-28T20:05:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 62/172 2024-08-28T20:05:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 63/172 2024-08-28T20:05:16.406 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 64/172 2024-08-28T20:05:16.456 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 65/172 2024-08-28T20:05:16.525 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 66/172 2024-08-28T20:05:16.546 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:16.579 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:16.598 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:16.657 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 67/172 2024-08-28T20:05:16.706 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 68/172 2024-08-28T20:05:16.748 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/172 2024-08-28T20:05:16.778 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 70/172 2024-08-28T20:05:16.802 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 71/172 2024-08-28T20:05:16.945 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/172 2024-08-28T20:05:17.104 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 73/172 2024-08-28T20:05:17.145 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/172 2024-08-28T20:05:17.184 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/172 2024-08-28T20:05:17.249 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 76/172 2024-08-28T20:05:17.290 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 77/172 2024-08-28T20:05:17.338 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/172 2024-08-28T20:05:17.374 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 79/172 2024-08-28T20:05:17.409 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 80/172 2024-08-28T20:05:17.428 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 156/172 2024-08-28T20:05:17.442 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 81/172 2024-08-28T20:05:17.486 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 82/172 2024-08-28T20:05:17.517 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 157/172 2024-08-28T20:05:17.518 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 83/172 2024-08-28T20:05:17.558 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-08-28T20:05:17.638 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-08-28T20:05:17.641 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 84/172 2024-08-28T20:05:17.670 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-08-28T20:05:17.702 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 85/172 2024-08-28T20:05:17.704 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.2.2-2.el9.x86_64 161/172 2024-08-28T20:05:17.704 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 162/172 2024-08-28T20:05:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 133/172 2024-08-28T20:05:17.738 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 86/172 2024-08-28T20:05:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 134/172 2024-08-28T20:05:17.789 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 162/172 2024-08-28T20:05:17.789 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 163/172 2024-08-28T20:05:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 163/172 2024-08-28T20:05:17.876 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-28T20:05:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-user-2.37.4-18.el9.x86_64 164/172 2024-08-28T20:05:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-2.37.4-18.el9.x86_64 165/172 2024-08-28T20:05:17.962 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 88/172 2024-08-28T20:05:17.977 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-core-2.37.4-18.el9.x86_64 166/172 2024-08-28T20:05:18.002 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libfdisk-2.37.4-18.el9.x86_64 167/172 2024-08-28T20:05:18.027 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libmount-2.37.4-18.el9.x86_64 168/172 2024-08-28T20:05:18.052 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libblkid-2.37.4-18.el9.x86_64 169/172 2024-08-28T20:05:18.078 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libuuid-2.37.4-18.el9.x86_64 170/172 2024-08-28T20:05:18.103 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libsmartcols-2.37.4-18.el9.x86_64 171/172 2024-08-28T20:05:18.169 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.2.2-2.el9.x86_64 172/172 2024-08-28T20:05:18.787 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 134/172 2024-08-28T20:05:18.811 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 135/172 2024-08-28T20:05:18.909 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 89/172 2024-08-28T20:05:18.932 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 135/172 2024-08-28T20:05:18.970 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 90/172 2024-08-28T20:05:19.029 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 91/172 2024-08-28T20:05:19.104 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 136/172 2024-08-28T20:05:19.130 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 137/172 2024-08-28T20:05:19.147 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 92/172 2024-08-28T20:05:19.154 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 137/172 2024-08-28T20:05:19.154 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:19.154 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-28T20:05:19.154 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T20:05:19.154 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T20:05:19.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:19.206 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 138/172 2024-08-28T20:05:19.213 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 93/172 2024-08-28T20:05:19.218 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 138/172 2024-08-28T20:05:19.266 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 94/172 2024-08-28T20:05:19.321 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 139/172 2024-08-28T20:05:19.372 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 140/172 2024-08-28T20:05:19.377 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/172 2024-08-28T20:05:19.423 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/172 2024-08-28T20:05:19.672 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 97/172 2024-08-28T20:05:19.711 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 98/172 2024-08-28T20:05:19.834 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/172 2024-08-28T20:05:20.387 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 141/172 2024-08-28T20:05:20.426 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 142/172 2024-08-28T20:05:20.449 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 142/172 2024-08-28T20:05:20.449 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:20.449 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-28T20:05:20.449 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T20:05:20.449 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T20:05:20.449 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:20.493 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 143/172 2024-08-28T20:05:20.516 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 143/172 2024-08-28T20:05:20.516 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:20.516 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-28T20:05:20.516 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 144/172 2024-08-28T20:05:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 144/172 2024-08-28T20:05:20.583 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:20.583 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-28T20:05:20.583 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T20:05:20.584 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T20:05:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:20.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/172 2024-08-28T20:05:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/172 2024-08-28T20:05:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 145/172 2024-08-28T20:05:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 145/172 2024-08-28T20:05:20.943 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:20.943 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-28T20:05:20.943 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T20:05:20.943 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T20:05:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:22.495 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/172 2024-08-28T20:05:22.630 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/172 2024-08-28T20:05:22.668 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/172 2024-08-28T20:05:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/172 2024-08-28T20:05:23.096 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 106/172 2024-08-28T20:05:23.243 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 106/172 2024-08-28T20:05:23.277 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/172 2024-08-28T20:05:23.330 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/172 2024-08-28T20:05:23.902 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 109/172 2024-08-28T20:05:23.942 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 110/172 2024-08-28T20:05:24.032 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 110/172 2024-08-28T20:05:24.085 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 111/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.2.2-2.el9.x86_64 172/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/172 2024-08-28T20:05:24.593 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/172 2024-08-28T20:05:24.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/172 2024-08-28T20:05:24.595 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/172 2024-08-28T20:05:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-08-28T20:05:24.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-08-28T20:05:24.598 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-08-28T20:05:24.599 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-08-28T20:05:24.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-08-28T20:05:24.601 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-08-28T20:05:24.602 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-08-28T20:05:24.603 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-08-28T20:05:24.604 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-08-28T20:05:24.605 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-08-28T20:05:24.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libblkid-2.37.4-20.el9.x86_64 153/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 154/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libfdisk-2.37.4-20.el9.x86_64 155/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 156/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libmount-2.37.4-20.el9.x86_64 157/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 158/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsmartcols-2.37.4-20.el9.x86_64 159/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 160/172 2024-08-28T20:05:24.607 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-2.37.4-20.el9.x86_64 161/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 162/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 164/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 166/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-2.37.4-20.el9.x86_64 167/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 168/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-core-2.37.4-20.el9.x86_64 169/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 170/172 2024-08-28T20:05:24.608 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-user-2.37.4-20.el9.x86_64 171/172 2024-08-28T20:05:25.549 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 146/172 2024-08-28T20:05:25.590 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 147/172 2024-08-28T20:05:25.620 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 148/172 2024-08-28T20:05:25.647 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 149/172 2024-08-28T20:05:25.840 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 150/172 2024-08-28T20:05:25.896 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 151/172 2024-08-28T20:05:25.927 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 152/172 2024-08-28T20:05:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : util-linux-user-2.37.4-20.el9.x86_64 153/172 2024-08-28T20:05:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 154/172 2024-08-28T20:05:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:26.699 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:26.774 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:05:26.831 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 172/172 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout: libblkid-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout: libfdisk-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout: libmount-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.377 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: libsmartcols-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-4.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-4.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-core-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-user-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-08-28T20:05:27.378 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.379 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:27.380 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.381 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-28T20:05:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.16-1.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-28T20:05:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-28T20:05:27.384 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-28T20:05:27.385 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-28T20:05:27.386 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.387 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-28T20:05:27.388 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-28T20:05:27.389 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-28T20:05:27.390 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-28T20:05:27.390 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-28T20:05:27.390 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-28T20:05:27.390 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-28T20:05:27.390 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:05:27.390 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-28T20:05:27.527 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 112/172 2024-08-28T20:05:27.576 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 113/172 2024-08-28T20:05:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 156/172 2024-08-28T20:05:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 157/172 2024-08-28T20:05:27.760 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 113/172 2024-08-28T20:05:27.760 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-28T20:05:27.760 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-28T20:05:27.760 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-08-28T20:05:27.802 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 114/172 2024-08-28T20:05:27.836 DEBUG:teuthology.parallel:result is None 2024-08-28T20:05:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-08-28T20:05:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-08-28T20:05:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.2.2-2.el9.x86_64 161/172 2024-08-28T20:05:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 162/172 2024-08-28T20:05:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 162/172 2024-08-28T20:05:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 163/172 2024-08-28T20:05:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 163/172 2024-08-28T20:05:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : util-linux-user-2.37.4-18.el9.x86_64 164/172 2024-08-28T20:05:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : util-linux-2.37.4-18.el9.x86_64 165/172 2024-08-28T20:05:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : util-linux-core-2.37.4-18.el9.x86_64 166/172 2024-08-28T20:05:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libfdisk-2.37.4-18.el9.x86_64 167/172 2024-08-28T20:05:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libmount-2.37.4-18.el9.x86_64 168/172 2024-08-28T20:05:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libblkid-2.37.4-18.el9.x86_64 169/172 2024-08-28T20:05:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libuuid-2.37.4-18.el9.x86_64 170/172 2024-08-28T20:05:28.309 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : libsmartcols-2.37.4-18.el9.x86_64 171/172 2024-08-28T20:05:28.376 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.2.2-2.el9.x86_64 172/172 2024-08-28T20:05:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.2.2-2.el9.x86_64 172/172 2024-08-28T20:05:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/172 2024-08-28T20:05:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/172 2024-08-28T20:05:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/172 2024-08-28T20:05:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/172 2024-08-28T20:05:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/172 2024-08-28T20:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-08-28T20:05:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-08-28T20:05:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/172 2024-08-28T20:05:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-08-28T20:05:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-08-28T20:05:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-08-28T20:05:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/172 2024-08-28T20:05:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-08-28T20:05:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-08-28T20:05:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libblkid-2.37.4-20.el9.x86_64 153/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 154/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libfdisk-2.37.4-20.el9.x86_64 155/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 156/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libmount-2.37.4-20.el9.x86_64 157/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 158/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsmartcols-2.37.4-20.el9.x86_64 159/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 160/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-2.37.4-20.el9.x86_64 161/172 2024-08-28T20:05:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 162/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 164/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 166/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-2.37.4-20.el9.x86_64 167/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 168/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-core-2.37.4-20.el9.x86_64 169/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 170/172 2024-08-28T20:05:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-user-2.37.4-20.el9.x86_64 171/172 2024-08-28T20:05:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 172/172 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: libblkid-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: libfdisk-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: libmount-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: libsmartcols-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.2-4.el9.x86_64 2024-08-28T20:05:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.2-4.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-core-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-user-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-28T20:05:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-28T20:05:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-28T20:05:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.16-1.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-28T20:05:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-28T20:05:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-28T20:05:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-28T20:05:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-28T20:05:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-28T20:05:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:05:37.577 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-08-28T20:05:38.069 DEBUG:teuthology.parallel:result is None 2024-08-28T20:05:40.674 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 114/172 2024-08-28T20:05:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-08-28T20:05:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-08-28T20:05:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-08-28T20:05:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-08-28T20:05:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-08-28T20:05:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-08-28T20:05:40.675 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-08-28T20:05:40.675 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:40.890 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 115/172 2024-08-28T20:05:40.925 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 115/172 2024-08-28T20:05:40.926 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:40.926 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-28T20:05:40.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:42.816 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 116/172 2024-08-28T20:05:42.876 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 116/172 2024-08-28T20:05:43.043 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:43.044 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-28T20:05:43.044 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T20:05:43.044 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T20:05:43.044 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:43.136 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 117/172 2024-08-28T20:05:43.188 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 117/172 2024-08-28T20:05:43.188 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:43.188 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-28T20:05:43.188 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T20:05:43.188 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T20:05:43.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:43.729 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 118/172 2024-08-28T20:05:43.780 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 118/172 2024-08-28T20:05:43.780 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:43.780 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-28T20:05:43.780 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T20:05:43.780 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T20:05:43.781 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:43.930 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 119/172 2024-08-28T20:05:43.993 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 120/172 2024-08-28T20:05:44.081 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 121/172 2024-08-28T20:05:44.328 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 122/172 2024-08-28T20:05:44.400 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 123/172 2024-08-28T20:05:44.492 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/172 2024-08-28T20:05:44.600 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 125/172 2024-08-28T20:05:44.775 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 126/172 2024-08-28T20:05:44.832 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 127/172 2024-08-28T20:05:44.873 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 128/172 2024-08-28T20:05:44.898 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 129/172 2024-08-28T20:05:45.515 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 130/172 2024-08-28T20:05:45.547 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 130/172 2024-08-28T20:05:45.590 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 131/172 2024-08-28T20:05:45.682 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 132/172 2024-08-28T20:05:45.728 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 133/172 2024-08-28T20:05:49.585 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 133/172 2024-08-28T20:05:49.683 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 134/172 2024-08-28T20:05:50.836 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 134/172 2024-08-28T20:05:50.868 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 135/172 2024-08-28T20:05:51.028 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 135/172 2024-08-28T20:05:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 136/172 2024-08-28T20:05:51.245 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 137/172 2024-08-28T20:05:51.297 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 137/172 2024-08-28T20:05:51.297 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:51.297 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-28T20:05:51.297 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T20:05:51.297 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T20:05:51.297 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:51.354 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 138/172 2024-08-28T20:05:51.381 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 138/172 2024-08-28T20:05:51.494 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 139/172 2024-08-28T20:05:51.556 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 140/172 2024-08-28T20:05:52.664 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 141/172 2024-08-28T20:05:52.707 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 142/172 2024-08-28T20:05:52.759 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 142/172 2024-08-28T20:05:52.759 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:52.759 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-28T20:05:52.759 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T20:05:52.760 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T20:05:52.760 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:52.808 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 143/172 2024-08-28T20:05:52.858 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 143/172 2024-08-28T20:05:52.859 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:52.859 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-28T20:05:52.859 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:52.938 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 144/172 2024-08-28T20:05:52.989 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 144/172 2024-08-28T20:05:52.989 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:52.990 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-28T20:05:52.990 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T20:05:52.990 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T20:05:52.990 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 145/172 2024-08-28T20:05:53.420 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 145/172 2024-08-28T20:05:53.420 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T20:05:53.420 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-28T20:05:53.420 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T20:05:53.420 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T20:05:53.420 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:05:58.468 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 146/172 2024-08-28T20:05:58.518 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 147/172 2024-08-28T20:05:58.547 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 148/172 2024-08-28T20:05:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 149/172 2024-08-28T20:05:58.826 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 150/172 2024-08-28T20:05:58.902 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 151/172 2024-08-28T20:05:58.938 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 152/172 2024-08-28T20:05:58.972 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : util-linux-user-2.37.4-20.el9.x86_64 153/172 2024-08-28T20:05:59.001 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 154/172 2024-08-28T20:05:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:05:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 155/172 2024-08-28T20:06:01.219 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 156/172 2024-08-28T20:06:01.322 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 157/172 2024-08-28T20:06:01.386 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-08-28T20:06:01.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-08-28T20:06:01.558 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-08-28T20:06:01.627 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-2.el9.x86_64 161/172 2024-08-28T20:06:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 162/172 2024-08-28T20:06:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 162/172 2024-08-28T20:06:01.735 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 163/172 2024-08-28T20:06:01.844 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 163/172 2024-08-28T20:06:01.887 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : util-linux-user-2.37.4-18.el9.x86_64 164/172 2024-08-28T20:06:01.966 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : util-linux-2.37.4-18.el9.x86_64 165/172 2024-08-28T20:06:02.006 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : util-linux-core-2.37.4-18.el9.x86_64 166/172 2024-08-28T20:06:02.031 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libfdisk-2.37.4-18.el9.x86_64 167/172 2024-08-28T20:06:02.065 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libmount-2.37.4-18.el9.x86_64 168/172 2024-08-28T20:06:02.090 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libblkid-2.37.4-18.el9.x86_64 169/172 2024-08-28T20:06:02.115 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libuuid-2.37.4-18.el9.x86_64 170/172 2024-08-28T20:06:02.142 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libsmartcols-2.37.4-18.el9.x86_64 171/172 2024-08-28T20:06:02.219 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-2.el9.x86_64 172/172 2024-08-28T20:06:02.458 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-2.el9.x86_64 172/172 2024-08-28T20:06:02.459 INFO:teuthology.orchestra.run.smithi001.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-28T20:06:02.459 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/172 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/172 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/172 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/172 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/172 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/172 2024-08-28T20:06:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/172 2024-08-28T20:06:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/172 2024-08-28T20:06:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/172 2024-08-28T20:06:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/172 2024-08-28T20:06:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/172 2024-08-28T20:06:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/172 2024-08-28T20:06:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/172 2024-08-28T20:06:08.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-08-28T20:06:08.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-08-28T20:06:08.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-08-28T20:06:08.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-08-28T20:06:08.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/172 2024-08-28T20:06:08.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-08-28T20:06:08.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-08-28T20:06:08.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/172 2024-08-28T20:06:08.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-08-28T20:06:08.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-08-28T20:06:08.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-08-28T20:06:08.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-08-28T20:06:08.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-08-28T20:06:08.669 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-08-28T20:06:08.670 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-08-28T20:06:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libblkid-2.37.4-20.el9.x86_64 153/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 154/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libfdisk-2.37.4-20.el9.x86_64 155/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 156/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libmount-2.37.4-20.el9.x86_64 157/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 158/172 2024-08-28T20:06:08.672 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libsmartcols-2.37.4-20.el9.x86_64 159/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 160/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-2.37.4-20.el9.x86_64 161/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 162/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 164/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 166/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : util-linux-2.37.4-20.el9.x86_64 167/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 168/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : util-linux-core-2.37.4-20.el9.x86_64 169/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 170/172 2024-08-28T20:06:08.673 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : util-linux-user-2.37.4-20.el9.x86_64 171/172 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 172/172 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout: libblkid-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout: libfdisk-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout: libmount-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.002 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: libsmartcols-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-4.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-4.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux-core-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux-user-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-08-28T20:06:11.003 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.004 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.005 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.006 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-28T20:06:11.007 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-28T20:06:11.008 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-28T20:06:11.009 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-28T20:06:11.010 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-28T20:06:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.012 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-28T20:06:11.013 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-28T20:06:11.014 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-28T20:06:11.015 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-28T20:06:11.015 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:06:11.015 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-08-28T20:06:11.629 DEBUG:teuthology.parallel:result is None 2024-08-28T20:06:11.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:06:11.813 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-28T20:06:11.858 INFO:teuthology.orchestra.run.smithi001.stdout:19.3.0-4560.gd19e6118.el9 2024-08-28T20:06:11.859 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-28T20:06:11.859 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-28T20:06:11.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:06:12.006 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-28T20:06:12.031 INFO:teuthology.orchestra.run.smithi007.stdout:19.3.0-4560.gd19e6118.el9 2024-08-28T20:06:12.032 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-28T20:06:12.032 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-28T20:06:12.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:06:12.177 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-28T20:06:12.204 INFO:teuthology.orchestra.run.smithi121.stdout:19.3.0-4560.gd19e6118.el9 2024-08-28T20:06:12.204 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-28T20:06:12.205 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-28T20:06:12.206 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-28T20:06:12.207 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:06:12.207 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-28T20:06:12.270 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:06:12.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-28T20:06:12.303 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:06:12.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-28T20:06:12.337 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-28T20:06:12.337 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:06:12.337 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-08-28T20:06:12.394 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-28T20:06:12.494 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:06:12.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-08-28T20:06:12.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-28T20:06:12.593 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:06:12.593 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-08-28T20:06:12.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-28T20:06:12.691 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-28T20:06:12.691 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:06:12.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-28T20:06:12.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-28T20:06:12.861 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:06:12.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-28T20:06:12.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-28T20:06:12.951 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:06:12.951 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-28T20:06:12.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-28T20:06:13.051 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-28T20:06:13.052 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:06:13.052 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-08-28T20:06:13.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-28T20:06:13.211 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:06:13.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-08-28T20:06:13.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-28T20:06:13.301 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:06:13.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-08-28T20:06:13.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-28T20:06:13.400 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-28T20:06:13.506 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-28T20:06:13.506 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:06:13.506 INFO:tasks.cephadm:Cluster fsid is f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:06:13.506 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-28T20:06:13.507 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.7', 'mon.c': '172.21.15.121'} 2024-08-28T20:06:13.507 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-08-28T20:06:13.507 INFO:tasks.cephadm:First mgr is x 2024-08-28T20:06:13.507 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-28T20:06:13.507 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-08-28T20:06:13.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-08-28T20:06:13.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname $(hostname -s) 2024-08-28T20:06:13.619 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-28T20:06:13.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:06:13.768 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-28T20:06:13.918 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:06:13.920 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-28T20:06:13.920 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-28T20:06:13.920 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:14.335 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 28 20:06 /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:14.335 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:14.712 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 28 20:06 /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:14.712 DEBUG:teuthology.orchestra.run.smithi121:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:15.348 INFO:teuthology.orchestra.run.smithi121.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 28 20:06 /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:15.349 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:15.391 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:15.410 DEBUG:teuthology.orchestra.run.smithi121:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-28T20:06:15.445 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-28T20:06:15.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-28T20:06:15.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-28T20:06:15.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-28T20:06:16.287 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T20:06:16.332 INFO:teuthology.orchestra.run.smithi121.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T20:06:16.863 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T20:06:47.756 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-28T20:06:47.756 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T20:06:47.756 INFO:teuthology.orchestra.run.smithi121.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-28T20:06:47.756 INFO:teuthology.orchestra.run.smithi121.stdout: "repo_digests": [ 2024-08-28T20:06:47.756 INFO:teuthology.orchestra.run.smithi121.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-28T20:06:47.757 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-08-28T20:06:47.757 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:06:50.835 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:06:52.600 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-28T20:06:52.600 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T20:06:52.601 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-28T20:06:52.601 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-08-28T20:06:52.601 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-28T20:06:52.601 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-08-28T20:06:52.601 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-28T20:06:52.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-08-28T20:06:52.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-08-28T20:06:52.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph 2024-08-28T20:06:52.746 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-08-28T20:06:52.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-08-28T20:06:52.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /etc/ceph 2024-08-28T20:06:52.856 INFO:tasks.cephadm:Writing seed config... 2024-08-28T20:06:52.857 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-28T20:06:52.857 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-28T20:06:52.857 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-28T20:06:52.857 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-28T20:06:52.858 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-28T20:06:52.859 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-28T20:06:52.860 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:06:52.860 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-28T20:06:52.895 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f9e93946-6578-11ef-bcd4-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-08-28T20:06:52.896 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service 2024-08-28T20:06:52.941 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-28T20:06:52.986 INFO:tasks.cephadm:Bootstrapping... 2024-08-28T20:06:52.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:06:53.251 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-08-28T20:06:53.251 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-08-28T20:06:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-28T20:06:53.252 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-08-28T20:06:53.297 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-08-28T20:06:53.297 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-08-28T20:06:53.297 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-08-28T20:06:53.311 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-28T20:06:53.312 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-28T20:06:53.324 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-28T20:06:53.324 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-08-28T20:06:53.340 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-08-28T20:06:53.350 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-08-28T20:06:53.350 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-08-28T20:06:53.351 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-08-28T20:06:53.395 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-08-28T20:06:53.395 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-28T20:06:53.395 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-08-28T20:06:53.395 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-08-28T20:06:53.408 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-28T20:06:53.408 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-28T20:06:53.420 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-28T20:06:53.421 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-08-28T20:06:53.434 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-08-28T20:06:53.446 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-08-28T20:06:53.446 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-08-28T20:06:53.447 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-08-28T20:06:53.447 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:06:53.447 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 139635384304688 on /run/cephadm/f9e93946-6578-11ef-bcd4-c7b262605968.lock 2024-08-28T20:06:53.448 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 139635384304688 acquired on /run/cephadm/f9e93946-6578-11ef-bcd4-c7b262605968.lock 2024-08-28T20:06:53.448 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-08-28T20:06:53.448 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-08-28T20:06:53.448 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-08-28T20:06:53.455 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-08-28T20:06:53.455 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-08-28T20:06:53.461 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-28T20:06:53.461 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-08-28T20:06:53.461 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1770sec hoplimit 64 pref medium 2024-08-28T20:06:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-28T20:06:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-28T20:06:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-28T20:06:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-28T20:06:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-08-28T20:06:53.467 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-28T20:06:53.468 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-08-28T20:06:53.468 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-08-28T20:06:53.468 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-28T20:06:53.469 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-28T20:06:53.470 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T20:07:01.967 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-28T20:07:01.968 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T20:07:01.968 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-08-28T20:07:01.968 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-28T20:07:01.968 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-28T20:07:01.968 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-28T20:07:01.968 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-28T20:07:03.969 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-28T20:07:03.969 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-28T20:07:03.969 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-08-28T20:07:05.060 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-08-28T20:07:05.061 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-08-28T20:07:06.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBpg89myDmgHhAA3stj1DGwgL/E1Kbl9ArNvg== 2024-08-28T20:07:07.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBqg89mt1MFKBAAPERJzFodTvRUhzMM9KCY5A== 2024-08-28T20:07:08.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBrg89mnNSILBAAroThv2P3BNydbA4kPAp/qw== 2024-08-28T20:07:08.334 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:07:09.457 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-08-28T20:07:10.578 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-08-28T20:07:10.889 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-28T20:07:11.123 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-28T20:07:11.386 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f9e93946-6578-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-f9e93946-6578-11ef-bcd4-c7b262605968.target. 2024-08-28T20:07:11.387 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f9e93946-6578-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-f9e93946-6578-11ef-bcd4-c7b262605968.target. 2024-08-28T20:07:11.758 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a 2024-08-28T20:07:11.758 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-28T20:07:12.045 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9e93946-6578-11ef-bcd4-c7b262605968.target.wants/ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-f9e93946-6578-11ef-bcd4-c7b262605968@.service. 2024-08-28T20:07:12.685 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:12 smithi001 podman[20601]: 2024-08-28 20:07:12.61611547 +0000 UTC m=+0.346570604 container start 436beace3e585e7f14c21baaf021a25900fbe9fcaf551ad750ce179dbeb23877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-28T20:07:12.712 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T20:07:12.712 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-08-28T20:07:12.727 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T20:07:12.729 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-08-28T20:07:12.729 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-08-28T20:07:12.729 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-08-28T20:07:12.729 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-08-28T20:07:12.730 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-08-28T20:07:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:12 smithi001 bash[20601]: 436beace3e585e7f14c21baaf021a25900fbe9fcaf551ad750ce179dbeb23877 2024-08-28T20:07:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:12 smithi001 systemd[1]: Started Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:07:12.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:12 smithi001 ceph-mon[20619]: mkfs f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:12.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:12 smithi001 ceph-mon[20619]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-28T20:07:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-28T20:07:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: monmap epoch 1 2024-08-28T20:07:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: last_changed 2024-08-28T20:07:08.826838+0000 2024-08-28T20:07:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: min_mon_release 19 (squid) 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: election_strategy: 1 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: fsmap 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: osdmap e1: 0 total, 0 up, 0 in 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: mgrmap e1: no daemons active 2024-08-28T20:07:13.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:13 smithi001 ceph-mon[20619]: from='client.? 172.21.15.1:0/1126940145' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-28T20:07:13.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-08-28T20:07:13.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:13.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.611784s) 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-08-28T20:07:13.991 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-08-28T20:07:14.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:14 smithi001 ceph-mon[20619]: from='client.? 172.21.15.1:0/2678448594' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-28T20:07:14.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:14 smithi001 ceph-mon[20619]: from='client.? 172.21.15.1:0/2678448594' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-28T20:07:15.330 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-28T20:07:15.331 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-28T20:07:15.332 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-08-28T20:07:16.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:16 smithi001 ceph-mon[20619]: from='client.? 172.21.15.1:0/2412566500' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:07:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-08-28T20:07:16.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:16 smithi001 systemd[1]: Stopping Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:07:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:16 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a[20615]: 2024-08-28T20:07:16.974+0000 7fbecf400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:07:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:16 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a[20615]: 2024-08-28T20:07:16.974+0000 7fbecf400640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-28T20:07:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 podman[20860]: 2024-08-28 20:07:17.027424928 +0000 UTC m=+0.176684048 container died 436beace3e585e7f14c21baaf021a25900fbe9fcaf551ad750ce179dbeb23877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-28T20:07:17.680 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 podman[20860]: 2024-08-28 20:07:17.436136821 +0000 UTC m=+0.585395933 container cleanup 436beace3e585e7f14c21baaf021a25900fbe9fcaf551ad750ce179dbeb23877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-28T20:07:17.680 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 bash[20860]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a 2024-08-28T20:07:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 podman[20874]: 2024-08-28 20:07:17.678760217 +0000 UTC m=+0.640237446 container remove 436beace3e585e7f14c21baaf021a25900fbe9fcaf551ad750ce179dbeb23877 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-28T20:07:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-28T20:07:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 systemd[1]: Stopped Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:07:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service: Consumed 1.318s CPU time. 2024-08-28T20:07:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:17 smithi001 systemd[1]: Starting Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:07:18.474 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 podman[20965]: 2024-08-28 20:07:18.056907163 +0000 UTC m=+0.026538099 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T20:07:18.474 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 podman[20965]: 2024-08-28 20:07:18.1630943 +0000 UTC m=+0.132725206 container create e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-28T20:07:18.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 podman[20965]: 2024-08-28 20:07:18.382228516 +0000 UTC m=+0.351859451 container init e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1) 2024-08-28T20:07:18.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 podman[20965]: 2024-08-28 20:07:18.389064153 +0000 UTC m=+0.358695059 container start e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:07:18.483 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-28T20:07:18.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 bash[20965]: e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 2024-08-28T20:07:18.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 systemd[1]: Started Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: set uid:gid to 167:167 (ceph:ceph) 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: pidfile_write: ignore empty --pid-file 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: load: jerasure load: lrc 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: RocksDB version: 7.9.2 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Git sha 0 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: DB SUMMARY 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: DB Session ID: GZEIYIAC3VOFWBEHMNFL 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: CURRENT file: CURRENT 2024-08-28T20:07:18.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: IDENTITY file: IDENTITY 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95295 ; 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.error_if_exists: 0 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.create_if_missing: 0 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.paranoid_checks: 1 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.env: 0x55db77d135a0 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.fs: PosixFileSystem 2024-08-28T20:07:18.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.info_log: 0x55db9e52f4a0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_file_opening_threads: 16 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.statistics: (nil) 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.use_fsync: 0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_log_file_size: 0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.keep_log_file_num: 1000 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.recycle_log_file_num: 0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.allow_fallocate: 1 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.allow_mmap_reads: 0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.allow_mmap_writes: 0 2024-08-28T20:07:18.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.use_direct_reads: 0 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.create_missing_column_families: 0 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.db_log_dir: 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.wal_dir: 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-28T20:07:18.732 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.advise_random_on_open: 1 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.db_write_buffer_size: 0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.write_buffer_manager: 0x55db9e5335e0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.rate_limiter: (nil) 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.wal_recovery_mode: 2 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.enable_thread_tracking: 0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.enable_pipelined_write: 0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.unordered_write: 0 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-28T20:07:18.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.row_cache: None 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.wal_filter: None 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.allow_ingest_behind: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.two_write_queues: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.manual_wal_flush: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.wal_compression: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.atomic_flush: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-28T20:07:18.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.log_readahead_size: 0 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.best_efforts_recovery: 0 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.allow_data_in_errors: 0 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.db_host_id: __hostname__ 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_background_jobs: 2 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_background_compactions: -1 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_subcompactions: 1 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-28T20:07:18.735 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_total_wal_size: 0 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_open_files: -1 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bytes_per_sync: 0 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_readahead_size: 0 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_background_flushes: -1 2024-08-28T20:07:18.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Compression algorithms supported: 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kZSTD supported: 0 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kXpressCompression supported: 0 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kBZip2Compression supported: 0 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kLZ4Compression supported: 1 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kZlibCompression supported: 1 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kLZ4HCCompression supported: 1 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: kSnappyCompression supported: 1 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-28T20:07:18.737 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.merge_operator: 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_filter: None 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_filter_factory: None 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.sst_partitioner_factory: None 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55db9e52f0e0) 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-08-28T20:07:18.738 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x55db9a4f2850 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-08-28T20:07:18.739 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-08-28T20:07:18.740 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.write_buffer_size: 33554432 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_write_buffer_number: 2 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression: NoCompression 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression: Disabled 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.prefix_extractor: nullptr 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.num_levels: 7 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-28T20:07:18.741 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-28T20:07:18.742 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-28T20:07:18.742 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-28T20:07:18.742 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.level: 32767 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.strategy: 0 2024-08-28T20:07:18.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.enabled: false 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.target_file_size_base: 67108864 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-28T20:07:18.744 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.arena_block_size: 1048576 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-28T20:07:18.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.disable_auto_compactions: 0 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-28T20:07:18.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.inplace_update_support: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.bloom_locality: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.max_successive_merges: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.paranoid_file_checks: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.force_consistency_checks: 1 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.report_bg_io_stats: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.ttl: 2592000 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-28T20:07:18.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.enable_blob_files: false 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.min_blob_size: 0 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.blob_file_size: 268435456 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.blob_file_starting_level: 0 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-28T20:07:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 70fa9271-3fd3-49b5-94ed-9fd332d7e107 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875638499531, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875638502493, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91416, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89457, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11722, "raw_average_key_size": 48, "raw_value_size": 82875, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724875638, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "70fa9271-3fd3-49b5-94ed-9fd332d7e107", "db_session_id": "GZEIYIAC3VOFWBEHMNFL", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875638502796, "job": 1, "event": "recovery_finished"} 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55db9e554a80 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: DB pointer 0x55db9f2f6000 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-08-28T20:07:18.749 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 91.13 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 50.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 91.13 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 50.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-28T20:07:18.750 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 50.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 50.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-28T20:07:18.751 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 9.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 9.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x55db9a4f2850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???) e1 preinit fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).mds e1 new map 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).mds e1 print_map 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-08-28T20:07:12:747850+0000 2024-08-28T20:07:18.752 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: monmap epoch 1 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:18.753 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: last_changed 2024-08-28T20:07:08.826838+0000 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: min_mon_release 19 (squid) 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: election_strategy: 1 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: fsmap 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: osdmap e1: 0 total, 0 up, 0 in 2024-08-28T20:07:18.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:18 smithi001 ceph-mon[20984]: mgrmap e1: no daemons active 2024-08-28T20:07:19.843 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-28T20:07:19.869 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:07:19.869 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-08-28T20:07:19.869 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-28T20:07:19.870 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-28T20:07:20.237 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x 2024-08-28T20:07:20.238 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-28T20:07:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:20 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2846179308' entity='client.admin' 2024-08-28T20:07:20.483 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9e93946-6578-11ef-bcd4-c7b262605968.target.wants/ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-f9e93946-6578-11ef-bcd4-c7b262605968@.service. 2024-08-28T20:07:21.099 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:21 smithi001 podman[21203]: 2024-08-28 20:07:21.098158121 +0000 UTC m=+0.395235277 container init 05838921b52c64c8d2668ea64485683e4f33ae0681d4816de9e06e02c2eb30f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-28T20:07:21.234 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T20:07:21.235 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-08-28T20:07:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T20:07:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-08-28T20:07:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-08-28T20:07:21.249 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-08-28T20:07:21.266 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T20:07:21.266 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-08-28T20:07:21.280 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T20:07:21.280 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-08-28T20:07:21.281 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-08-28T20:07:21.281 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-28T20:07:21.281 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-08-28T20:07:21.281 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-08-28T20:07:21.424 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:21 smithi001 podman[21203]: 2024-08-28 20:07:21.104283272 +0000 UTC m=+0.401360407 container start 05838921b52c64c8d2668ea64485683e4f33ae0681d4816de9e06e02c2eb30f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:07:21.424 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:21 smithi001 bash[21203]: 05838921b52c64c8d2668ea64485683e4f33ae0681d4816de9e06e02c2eb30f8 2024-08-28T20:07:21.424 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:21 smithi001 systemd[1]: Started Ceph mgr.x for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:07:22.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:21 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/601560736' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-28T20:07:22.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:22.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:07:22.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:07:22.574 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-28T20:07:22.575 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-28T20:07:22.576 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-28T20:07:22.577 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-08-28T20:07:12:747850+0000", 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-28T20:07:22.578 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-08-28T20:07:12.749313+0000", 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:07:22.579 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-08-28T20:07:25.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:25 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/510667723' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-28T20:07:26.046 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-28T20:07:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-08-28T20:07:26.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:26.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-28T20:07:26.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-28T20:07:26.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:26.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-28T20:07:26.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-28T20:07:26.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-28T20:07:26.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-28T20:07:26.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:26.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-08-28T20:07:12:747850+0000", 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-28T20:07:26.053 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-28T20:07:26.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:26.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-08-28T20:07:12.749313+0000", 2024-08-28T20:07:26.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T20:07:26.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:26.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-28T20:07:26.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:07:26.055 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (2/15)... 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: Activating manager daemon x 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: mgrmap e2: x(active, starting, since 0.00511212s) 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:07:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T20:07:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: Manager daemon x is now available 2024-08-28T20:07:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T20:07:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T20:07:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' 2024-08-28T20:07:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' 2024-08-28T20:07:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:27 smithi001 ceph-mon[20984]: from='mgr.14100 172.21.15.1:0/2505441045' entity='mgr.x' 2024-08-28T20:07:29.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:29 smithi001 ceph-mon[20984]: mgrmap e3: x(active, since 1.00991s) 2024-08-28T20:07:29.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:29 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3007042237' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-28T20:07:29.705 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:29.711 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:07:29.711 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:07:29.711 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-08-28T20:07:29.711 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-28T20:07:29.711 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-28T20:07:29.711 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-28T20:07:29.712 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-28T20:07:29.713 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-08-28T20:07:12:747850+0000", 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-28T20:07:29.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-08-28T20:07:12.749313+0000", 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T20:07:29.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-08-28T20:07:29.716 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-28T20:07:29.716 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:07:29.716 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-08-28T20:07:30.814 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:30 smithi001 ceph-mon[20984]: mgrmap e4: x(active, since 2s) 2024-08-28T20:07:30.814 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:30 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2367078144' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:31.147 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-28T20:07:31.148 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-08-28T20:07:32.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:32 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1442366772' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-28T20:07:32.378 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: ignoring --setuser ceph since I am not root 2024-08-28T20:07:32.378 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: ignoring --setgroup ceph since I am not root 2024-08-28T20:07:33.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:33 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1442366772' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-28T20:07:33.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:33 smithi001 ceph-mon[20984]: mgrmap e5: x(active, since 4s) 2024-08-28T20:07:34.136 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:34 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3293033374' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-28T20:07:34.426 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:07:34.426 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-28T20:07:34.426 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-28T20:07:34.426 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-28T20:07:34.426 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-28T20:07:34.427 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:07:34.427 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-08-28T20:07:34.427 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: Active manager daemon x restarted 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: Activating manager daemon x 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: osdmap e2: 0 total, 0 up, 0 in 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: mgrmap e6: x(active, starting, since 0.00405846s) 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T20:07:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T20:07:38.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:38 smithi001 ceph-mon[20984]: Manager daemon x is now available 2024-08-28T20:07:40.126 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:07:40.126 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-28T20:07:40.126 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-28T20:07:40.126 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:07:40.126 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-08-28T20:07:40.127 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: mgrmap e7: x(active, since 1.0071s) 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: Found migration_current of "None". Setting to last migration. 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T20:07:40.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:40 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T20:07:41.308 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:07:41.229+0000 7f87f1800640 -1 log_channel(cephadm) log [ERR] : [28/Aug/2024:20:07:41] ENGINE Error in HTTPServer.serve 2024-08-28T20:07:41.308 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: Traceback (most recent call last): 2024-08-28T20:07:41.308 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T20:07:41.308 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self._connections.run(self.expiration_interval) 2024-08-28T20:07:41.308 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self._run(expiration_interval) 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: s = self.context.wrap_socket( 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: return self.sslsocket_class._create( 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self.do_handshake() 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self._sslobj.do_handshake() 2024-08-28T20:07:41.309 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T20:07:41.310 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: mgrmap e8: x(active, since 2s) 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: [28/Aug/2024:20:07:41] ENGINE Bus STARTING 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: [28/Aug/2024:20:07:41] ENGINE Serving on http://172.21.15.1:8765 2024-08-28T20:07:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:41 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:07:43.064 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:42 smithi001 ceph-mon[20984]: [28/Aug/2024:20:07:41] ENGINE Serving on https://172.21.15.1:7150 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:42 smithi001 ceph-mon[20984]: [28/Aug/2024:20:07:41] ENGINE Bus STARTED 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:42 smithi001 ceph-mon[20984]: [28/Aug/2024:20:07:41] ENGINE Error in HTTPServer.serve 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-08-28T20:07:43.065 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T20:07:43.066 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-08-28T20:07:43.066 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T20:07:43.066 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-08-28T20:07:43.066 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T20:07:43.066 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-08-28T20:07:43.066 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T20:07:43.071 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-28T20:07:43.071 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-08-28T20:07:44.325 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:43 smithi001 ceph-mon[20984]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:44.705 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: Generating public/private rsa key pair. 2024-08-28T20:07:44.705 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: Your identification has been saved in /tmp/tmpi3fzft57/key 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: Your public key has been saved in /tmp/tmpi3fzft57/key.pub 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: The key fingerprint is: 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: SHA256:RehGZARS2u5I3Uk+e4TZovIu7Zdlj536nUUz2R9rA7s ceph-f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: The key's randomart image is: 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: +---[RSA 3072]----+ 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | ..o++.. | 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | + .o. | 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | . .o. . | 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | o +o* o| 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | . o.S o . =o| 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | . o . =o o.*| 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | o.o .+.+ o +o| 2024-08-28T20:07:44.706 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | .o. o.. +.oo.| 2024-08-28T20:07:44.707 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: | ++. .o.Eo | 2024-08-28T20:07:44.707 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: +----[SHA256]-----+ 2024-08-28T20:07:45.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-mon[20984]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:45.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-mon[20984]: Generating ssh key... 2024-08-28T20:07:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:44 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:46.444 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:46 smithi001 ceph-mon[20984]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:46.452 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:07:46.452 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-28T20:07:46.452 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-08-28T20:07:46.460 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-08-28T20:07:48.427 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:48 smithi001 ceph-mon[20984]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:49 smithi001 ceph-mon[20984]: Deploying cephadm binary to smithi001 2024-08-28T20:07:52.482 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-08-28T20:07:52.482 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-08-28T20:07:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:52 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:52 smithi001 ceph-mon[20984]: Added host smithi001 2024-08-28T20:07:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:52 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:07:54.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:54 smithi001 ceph-mon[20984]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:54.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:54 smithi001 ceph-mon[20984]: Saving service mon spec with placement count:5 2024-08-28T20:07:54.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:54 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:54.507 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-28T20:07:54.508 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-08-28T20:07:56.325 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-28T20:07:56.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:56 smithi001 ceph-mon[20984]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:07:56.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:56 smithi001 ceph-mon[20984]: Saving service mgr spec with placement count:2 2024-08-28T20:07:56.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:56 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:56.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:56 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:56.862 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:56 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:58.426 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:58 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2981622477' entity='client.admin' 2024-08-28T20:07:58.427 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:58 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:07:59.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:59 smithi001 ceph-mon[20984]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:07:59.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:07:59 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2738628702' entity='client.admin' 2024-08-28T20:08:00.004 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-08-28T20:08:00.889 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:00 smithi001 ceph-mon[20984]: from='mgr.14118 172.21.15.1:0/942584646' entity='mgr.x' 2024-08-28T20:08:01.782 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:01 smithi001 ceph-mon[20984]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:01.782 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:01 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2644842401' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-28T20:08:02.121 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:01 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: ignoring --setuser ceph since I am not root 2024-08-28T20:08:02.121 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:01 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: ignoring --setgroup ceph since I am not root 2024-08-28T20:08:02.719 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:02 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2644842401' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-28T20:08:02.719 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:02 smithi001 ceph-mon[20984]: mgrmap e9: x(active, since 23s) 2024-08-28T20:08:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:03 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/823021512' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-28T20:08:04.013 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-08-28T20:08:04.014 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-08-28T20:08:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: Active manager daemon x restarted 2024-08-28T20:08:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: Activating manager daemon x 2024-08-28T20:08:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: osdmap e3: 0 total, 0 up, 0 in 2024-08-28T20:08:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: mgrmap e10: x(active, starting, since 0.00500017s) 2024-08-28T20:08:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:08:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T20:08:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T20:08:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T20:08:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T20:08:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:08 smithi001 ceph-mon[20984]: Manager daemon x is now available 2024-08-28T20:08:09.417 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:09.417 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T20:08:09.417 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T20:08:09.417 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-mon[20984]: mgrmap e11: x(active, since 1.0107s) 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:08:09.603+0000 7fb8f7600640 -1 log_channel(cephadm) log [ERR] : [28/Aug/2024:20:08:09] ENGINE Error in HTTPServer.serve 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: Traceback (most recent call last): 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self._connections.run(self.expiration_interval) 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self._run(expiration_interval) 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T20:08:09.726 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: s = self.context.wrap_socket( 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: return self.sslsocket_class._create( 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self.do_handshake() 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: self._sslobj.do_handshake() 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T20:08:09.727 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:08:09.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-08-28T20:08:09.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-28T20:08:09.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-28T20:08:09.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-08-28T20:08:09.730 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-08-28T20:08:09.730 INFO:teuthology.orchestra.run.smithi001.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-28T20:08:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:10 smithi001 ceph-mon[20984]: [28/Aug/2024:20:08:09] ENGINE Bus STARTING 2024-08-28T20:08:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:10 smithi001 ceph-mon[20984]: [28/Aug/2024:20:08:09] ENGINE Serving on https://172.21.15.1:7150 2024-08-28T20:08:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:10 smithi001 ceph-mon[20984]: [28/Aug/2024:20:08:09] ENGINE Error in HTTPServer.serve 2024-08-28T20:08:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-08-28T20:08:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T20:08:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T20:08:10.478 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-08-28T20:08:10.479 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T20:08:10.479 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-08-28T20:08:10.479 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T20:08:10.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:10 smithi001 ceph-mon[20984]: [28/Aug/2024:20:08:09] ENGINE Serving on http://172.21.15.1:8765 2024-08-28T20:08:10.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:10 smithi001 ceph-mon[20984]: [28/Aug/2024:20:08:09] ENGINE Bus STARTED 2024-08-28T20:08:11.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:11 smithi001 ceph-mon[20984]: mgrmap e12: x(active, since 2s) 2024-08-28T20:08:11.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:11 smithi001 ceph-mon[20984]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:12.437 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:12 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:12.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUAsT7P/MXA1exlR+KIm7/UQDdFCIwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgyODIwMDgxMVoXDTM0\nMDgyOTIwMDgxMVowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjEwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQC6iER2WOm8m8FVAQV0I6i1v8917qLQIA0eOrTe\nARR5kuR/3ctSjsPWROfCTmXYQOXeQJDKLGONLS0kioYc9B47hZNhHwR3OE9Eue7u\nlWTzOQvrqgQXCJi3k/BJhk7W06x24CGXvXf/+5DpEnql636UXFidsZq92Cslp2f4\naPC/rD4tEcqxYs9zYDxi2qgo6f43B6GGxZ/7HvxcNGOzbp7mls7KPkbgkxnN8MHF\n5oLN8DPxgFHMivTsCrRu0Q7WKCDTgsBMFUnJ/FmdG+ibAZXwJBMsentrQPJLsT7Q\nhDo1kZ/TcTFLdKpzd5vpvNFF61pWVQF9Q4veHN+62KCUo/mVoCmQZKDjCYaayBYL\nfBqZtHouqUR0Gpb35VOyELSB4WikiYF0b05zyxoEFJQsuB25DroTRVMsssGIXLEa\nt614SuDF5QQQY1TQG5dx/gHbjR690wV8bxn3Rs8gsti0pR78kpXJTm4ykPkrY5Na\nYUPYCEDLUsQpIJ303tZi1S6nsUeTND8ZqOadfQB/0gqF33FW0RuixXBHT1ZyGsDY\nZbuwwkJzVpaUh245Yi342GaLEnn7oSfWXs3voILPr0EIBlJLs0yFubnC4hnZKecT\nSp4s2s0qH52zI0IOgPC3YBKLQLaaffzRZnNVmUu6HUYTTPAccjP79pr/X6QEv8sp\nScT+FwIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDGCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8BMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAEW4\n+00RoRx3GHAyyGOGUAQUmqWoGhAcDbIhCLSRoIY5KtRh7TsspTkkO/AdGmqs5c1Q\n8+/IICoB1PA41HwyChFEttfbKmR5bsyZbjCOvWqFw4GR8IUq7SwDpLOpnXX1cv2y\navlEaQNxRukeCONmwm6ebbtodFS+UYCMoOR6G6JRNLff1RRR/9/uT35mqlEXh1HF\nZRZR+yzIXZSm7YZR0tqJpxpIWk15qIaED87hPmSQS086k6vP4O2/jWUlMr/xs6Tj\nyytQw05CZRoDjV88fDcxXm+DUdG7lexWDxeaGHlMgbOfdwYSbQMCTqzmUIJHWoHx\n9OD8RCavXrit7t0jqW9lGdwjmJzgGhTVQ3RqxeT3v3mTQIhRIvtP2ek999ut7ZZp\npWxcjsESkd9ux9V2lRdrHqFpbXX2zp2TU23P93L+3pYmPYQ1z6KYzQ6G41/BHL5Y\nuV0HFOt7PHZGlw/gVecgWKFdSgoLhfDAPvyfJp1IzcOFSlplp4JfJuR5SPgPYg+k\n5pT9O5Oyi8WWSt4hzceD0PH6R/dvEh78v+D726OBIITnpOzZUUFkF25a2tUA/8pN\ngjeI3yew6KQuQJ3uHOJ9V9Ng1cC/w9WVFSG7AmLDqmm/kOdL0kpJ7ghuoEEr7qSu\nz477TfgUn+twilDTp0O9ogaFP0TWYZshF/gCv/Tk\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAuohEdljpvJvBVQEFdCOotb/Pde6i0CANHjq03gEUeZLkf93L\nUo7D1kTnwk5l2EDl3kCQyixjjS0tJIqGHPQeO4WTYR8EdzhPRLnu7pVk8zkL66oE\nFwiYt5PwSYZO1tOsduAhl713//uQ6RJ6pet+lFxYnbGavdgrJadn+Gjwv6w+LRHK\nsWLPc2A8YtqoKOn+NwehhsWf+x78XDRjs26e5pbOyj5G4JMZzfDBxeaCzfAz8YBR\nzIr07Aq0btEO1igg04LATBVJyfxZnRvomwGV8CQTLHp7a0DyS7E+0IQ6NZGf03Ex\nS3Sqc3eb6bzRRetaVlUBfUOL3hzfutiglKP5laApkGSg4wmGmsgWC3wambR6LqlE\ndBqW9+VTshC0geFopImBdG9Oc8saBBSULLgduQ66E0VTLLLBiFyxGreteErgxeUE\nEGNU0BuXcf4B240evdMFfG8Z90bPILLYtKUe/JKVyU5uMpD5K2OTWmFD2AhAy1LE\nKSCd9N7WYtUup7FHkzQ/GajmnX0Af9IKhd9xVtEbosVwR09WchrA2GW7sMJCc1aW\nlIduOWIt+NhmixJ5+6En1l7N76CCz69BCAZSS7NMhbm5wuIZ2SnnE0qeLNrNKh+d\nsyNCDoDwt2ASi0C2mn380WZzVZlLuh1GE0zwHHIz+/aa/1+kBL/LKUnE/hcCAwEA\nAQKCAgAsJQ++ynAWuO3aRjGaOM42pTxd9qoFg3BXVSF04OCNnRwCvuTdlvf1/7yx\nmYg007cTEEiz8ClnQefLHBV9SLDW+VfVxldyN5ta8n3/bM/FWBzgGw54vQoXeCWH\n4QdLhDDuuUB5/tcld83luv/XwJHmXqyCNYQfpccgVCwg+ATx97uHQwyrSm06Ku5f\nnsvpUudc8qthj+e6sKyczbFCx81HWS17Y522jFmxCWdyhIk0X8KLRwkU1VX9ftMQ\n3t0aBckvBWSpHOinqtcyfWZhONDZUlBPWHVY/rfY/guVoZV9FAe1LLaz2tp0FTyK\n5qrIV1i70cZWdOPnHwI74ASw6NWqEV63AKwy8zeOcWteUHZQxZ1Yh4FVfYMSadsg\nts18/sx+PxpFM8moR3IKyimIW9W4sPa4U5cguDjOgNUqB3nKUYXmO/oEM3y9JCEX\nH20ToBaS6g2sN4TCEqL+BLFIK8YKywosLWO/hmM9h+GsnraSoOzSQgYMBouG+HOH\njd1WTDY0xDiKViIhaSXvLNIEa4HozBTHyecm8bl+01mZkTqEABqY5bnnttsZ4lKp\nYoM8shc+tbXinvFBBYEnQnTnTz9tDHqH6UYo7yf0jHGHiUeFo/VPkVujyKRDppAH\nLpQqhUPGB8qFbekd4VxwQKtJ3fOaML1ROodJOUJkB+owKbB9wQKCAQEA9lBYnbqQ\n/CuIx2t5Xsp0kj3BgNNcmrCdm0ui7B2YObh4WSXiBhErsKRwbmrMaav/8ShuhoM8\nVvcqd5XX5aLRgxsLg6ojH058SbS5EBK7iK6y7kv/gYd92RPhCAG6/yM3mBA6oj2U\nRUyG5F8aaADrSXCxvRF53TJd2g1RlKEKOY/E1uPVSXtPE/b+n0Ye7J24m8tadkY+\n705rzAWSo3I5ByvZvJxajIss/jiP3Mg+P5Quy1/Y6c4XTnfTsIX5R8DhkNsF2WeQ\nNK1H/3HoU2dbQdZD0J+jq6oSZ6i01y+u+7Aph6vHM5rUme+l7JMdzVjahnD1ggsX\nS1lFCcJdgqTQBwKCAQEAwd4Y6/vy7Jm7EZIuGBZBqAcLmLbcTAfC0dAphRPDdOSL\nM3w2+EL9z3xwbEnAWILhT8FbKKeHQywRN2iGg/DOqz9PuVJD7XzLG24j1+mYSkCn\nwE3EzmTLPWLEvV7VhFd/X6a/CnhvYoFd1b0rzC6I7bKRkM6tVsWm3UNXA6qQI3+r\n3HXMdz7QpoOsQ+FVEH+ARHj8s+5eMGwa04+EkKuOVUXKBfFr+qRyiS+c/SBoy5H4\n2x6Bnod81aeb1y5NfuknH7Xb2RcrwaUnGFVYeXU6L1BNF/nqSswJyN80TiMuPsf/\nA/lXs4NwJ24CnDC4zcUCI1xDOyXHyRlxNLoQRxC9cQKCAQBAnUMh3Vc7T5BJ//+O\nxj1eP6ULTmb0jXBK1MSgfAL64VFw0WdBgC+d3wU/cfS9o8k4UgrsbnDdv2j8hepk\n6xla8zVKDM+53rTsAOSrOr7HVEzMBlO4fvqcf4KAvzN2yp5C3b8D4HOM2k5oiio7\nLkKKuW1m07bMN/I2yVelTbmI8BYK6SmCZT6RVjHlRlfGanmLJQVOEY9g54mPs8aL\n6eLb5rzvpXR7eecLqXrTyBPMSescnsAgVVf31adKn1qNYCPMBCi8p1ZE+0/vysnP\nV0WxN6wChl5BIhRB7RfDe1bD36qFVKKk/vDWkO9N6CnhPHXW3rsIqjAqK/jYXox5\nQRLxAoIBABkk6S6SOuuc9LpOr1PIbzOP1l00OlZSG16DFR+BdLRQgA1paufAKJMk\nnKAu4JeaQgbKGTyonc6EhKcfE3NBZEyppXlvxgejS+R+4H88eNgIkrlKXOA4CnQn\nv0SgbCkCAC8zvUtqW2f3R2hVZLzSvEe4BVE2vRyn/gBsn3iGQrOX935ceOxuZTlz\nkoArVZESOFypJH1hyS2Wl9QgpRzuY0OEDbO/oDWd5o0Mc9wQvAbLI++ngUBCalp7\npqa+BqcTLlPajm0VqEMxXGS3jQYTwjwouhcF/vE8jXhUGsCXp4PVBKpLSKirv3wd\ntJD1cMKfbquPZ9jgCY13k0s3Zq0Q6sECggEAUdck2n2X8imqvfM1rOq4fF2kAzqP\n2Si5fapj8PILmFbsMQcKKOfr4oqNqcMr930FiUPfmHsIIHt1Wupbb4epIhJ00GCt\nIks4MtTnAU1Ua+wOPIkKceqcVzBAdZOtFbJ9gCLwoU/oZjCbJc6OnlG3068tspax\nlkxjl7r4eMkmGIVWY/c3lF8MbEYvGCQChn5TmdDcWHH6UhIPSAj2870MDKn38MSH\nUmFB///apG5Q0YRUCuQLA/Hp5fVyS6QpPs5qP5i1+zfWpoyK6YFtjxFjNiOoX157\n1S8yTrHiTq9VDz0oj3+DaTfvDD2zeKuFSw9Qqr96A7we3IMHcoV938UrMw==\n-----END RSA PRIVATE KEY-----\n"} 2024-08-28T20:08:13.792 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:13.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:14.419 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-28T20:08:14.695 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:14 smithi001 ceph-mon[20984]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-28T20:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-08-28T20:08:16.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:16 smithi001 ceph-mon[20984]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:16.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:17.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$422IXyyrg8ZXUtRk.0dw6.5vM7gF5Y7eENmNaYDSm/DNqqAxKVzDq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724875697, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-28T20:08:17.818 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-08-28T20:08:18.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:18 smithi001 ceph-mon[20984]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:18.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:19.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:19 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2170151227' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-28T20:08:19.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-08-28T20:08:19.275 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T20:08:19.275 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-08-28T20:08:19.289 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T20:08:19.289 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-08-28T20:08:19.289 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-08-28T20:08:19.289 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-28T20:08:19.291 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-08-28T20:08:19.292 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:19.292 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-08-28T20:08:19.292 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-08-28T20:08:19.292 INFO:teuthology.orchestra.run.smithi001.stdout: Password: g2toukbm4l 2024-08-28T20:08:19.292 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:19.292 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config directory 2024-08-28T20:08:20.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-28T20:08:20.838 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-28T20:08:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-28T20:08:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:20.840 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-08-28T20:08:20.914 INFO:tasks.cephadm:Fetching config... 2024-08-28T20:08:20.914 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:08:20.914 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-28T20:08:20.951 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-28T20:08:20.952 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:08:20.952 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-28T20:08:21.029 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-28T20:08:21.029 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:08:21.029 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-28T20:08:21.127 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-28T20:08:21.127 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:08:21.127 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-28T20:08:21.202 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-28T20:08:21.203 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-28T20:08:21.330 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:21.348 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:21 smithi001 ceph-mon[20984]: mgrmap e13: x(active, since 12s) 2024-08-28T20:08:21.349 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:21 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1314210305' entity='client.admin' 2024-08-28T20:08:21.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-28T20:08:21.401 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:21.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-28T20:08:21.457 INFO:teuthology.orchestra.run.smithi121.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiutUL+CxJcelxtFojDMWDQdbtJ67mSkmy/m3XXUT+PlevphHtoEnrZhwcZmspiU8aaSpCLg8ohJRWXrFo6scuU8IiqWNjOAZyazCtYo0IU1pkPktCptNSrTOmVDjBN7H9Qf3xHQU6WEFLt0ZCkNrQyjp6XmqAWZJC+B1onK5vrOlQjDkXKRwmOpDgdoi1u8R+26IF0UmDBa3oWFBpBv5GVFiVLFBxDphlhuLJooYV5LH0rmv4RAWsAwcu2jATKAOP/bMe1LBGFr6V9KyNHILRyLK7FwW5Y01AFKR7sALnQxwI8qTnEH22bw7+RgS9AG36o8+OsJ1Vxmd4KjQaiu7KoT81oPWgp1bHcwE/E+1fS8zvXNLfEZgNgJB4DFArpKeZjlIa81T9f4SjWI+BqlhFBi1+vlWkU9CVoRYtLOsQKL8EXOy+eDobwIJBDr0u58oBU92dyxM+MkpDQhSrO77WAA6269mV58ayySWUkm4J2LaoOwOUcdeV9AbmSwCBsh0= ceph-f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:21.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-28T20:08:21.849 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:23.440 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-28T20:08:23.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-28T20:08:23.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:23 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3622820376' entity='client.admin' 2024-08-28T20:08:23.998 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:25.133 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:25.133 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:25.133 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:25.133 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:25.133 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:25.134 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:25.885 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi007 2024-08-28T20:08:25.885 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:08:25.885 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/etc/ceph/ceph.conf 2024-08-28T20:08:25.904 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:08:25.904 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:25.962 INFO:tasks.cephadm:Adding host smithi007 to orchestrator... 2024-08-28T20:08:25.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch host add smithi007 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: Updating smithi001:/etc/ceph/ceph.conf 2024-08-28T20:08:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:26 smithi001 ceph-mon[20984]: Updating smithi001:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:26.712 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:27.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:27 smithi001 ceph-mon[20984]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:27.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:27 smithi001 ceph-mon[20984]: Updating smithi001:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:27.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:27.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:27.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:28 smithi001 ceph-mon[20984]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:29 smithi001 ceph-mon[20984]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:29 smithi001 ceph-mon[20984]: Deploying cephadm binary to smithi007 2024-08-28T20:08:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:31 smithi001 ceph-mon[20984]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:31.555 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi007' with addr '172.21.15.7' 2024-08-28T20:08:32.292 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-28T20:08:32.662 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:32.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:32.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:32 smithi001 ceph-mon[20984]: Added host smithi007 2024-08-28T20:08:32.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:32.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:32.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:33.653 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:33.653 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}] 2024-08-28T20:08:33.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:33 smithi001 ceph-mon[20984]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:33.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:34.390 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi121 2024-08-28T20:08:34.390 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:08:34.390 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.conf 2024-08-28T20:08:34.409 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:08:34.409 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:34.468 INFO:tasks.cephadm:Adding host smithi121 to orchestrator... 2024-08-28T20:08:34.468 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch host add smithi121 2024-08-28T20:08:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:34 smithi001 ceph-mon[20984]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:08:34.833 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:35.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:35 smithi001 ceph-mon[20984]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:35.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:35.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: Updating smithi007:/etc/ceph/ceph.conf 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:36.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:36.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:37 smithi001 ceph-mon[20984]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:37 smithi001 ceph-mon[20984]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:37 smithi001 ceph-mon[20984]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:37 smithi001 ceph-mon[20984]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:38 smithi001 ceph-mon[20984]: Deploying cephadm binary to smithi121 2024-08-28T20:08:39.563 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi121' with addr '172.21.15.121' 2024-08-28T20:08:39.934 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:39 smithi001 ceph-mon[20984]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:39.935 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:39.935 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:40.296 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-28T20:08:40.663 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:40.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:40 smithi001 ceph-mon[20984]: Added host smithi121 2024-08-28T20:08:40.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:40 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:40.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:40 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:41.534 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:08:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}] 2024-08-28T20:08:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:41 smithi001 ceph-mon[20984]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:42.302 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-28T20:08:42.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-28T20:08:42.667 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:08:42.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:42 smithi001 ceph-mon[20984]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:08:43.573 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-08-28T20:08:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:43 smithi001 ceph-mon[20984]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:43 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1772210345' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-28T20:08:44.494 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-08-28T20:08:44.494 INFO:tasks.cephadm:Adding mon.b on smithi007 2024-08-28T20:08:44.495 INFO:tasks.cephadm:Adding mon.c on smithi121 2024-08-28T20:08:44.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c' 2024-08-28T20:08:44.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1772210345' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-28T20:08:44.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:08:44.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:44.728 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:45.358 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mon update... 2024-08-28T20:08:45.955 DEBUG:teuthology.orchestra.run.smithi007:mon.b> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.b.service 2024-08-28T20:08:45.958 DEBUG:teuthology.orchestra.run.smithi121:mon.c> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.c.service 2024-08-28T20:08:45.961 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T20:08:45.961 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:45.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:45.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:45.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:08:45.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:46.700 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:46.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:46 smithi001 ceph-mon[20984]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:46.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:46 smithi001 ceph-mon[20984]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c;count:3 2024-08-28T20:08:46.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:46 smithi001 ceph-mon[20984]: Deploying daemon mon.c on smithi121 2024-08-28T20:08:47.366 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:08:47.366 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":1,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","modified":"2024-08-28T20:07:08.826838Z","created":"2024-08-28T20:07:08.826838Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-28T20:08:47.367 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 1 2024-08-28T20:08:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:47 smithi001 ceph-mon[20984]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:47 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/2957807340' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:48.953 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T20:08:48.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T20:08:49.329 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:08:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:49 smithi001 ceph-mon[20984]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:50.155 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:49 smithi121 systemd[1]: Starting Ceph mon.c for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:08:50.170 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:08:50.170 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":1,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","modified":"2024-08-28T20:07:08.826838Z","created":"2024-08-28T20:07:08.826838Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-28T20:08:50.171 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 1 2024-08-28T20:08:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 podman[25214]: 2024-08-28 20:08:50.056558306 +0000 UTC m=+0.015498686 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:08:50.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 podman[25214]: 2024-08-28 20:08:50.166509611 +0000 UTC m=+0.125449987 container create eaf4fc6c27992fef57c4aed477d4f50668eb012294a98551fd05aebfab3fa4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-28T20:08:50.945 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 podman[25214]: 2024-08-28 20:08:50.906009795 +0000 UTC m=+0.864950181 container init eaf4fc6c27992fef57c4aed477d4f50668eb012294a98551fd05aebfab3fa4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-28T20:08:50.945 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 podman[25214]: 2024-08-28 20:08:50.909633082 +0000 UTC m=+0.868573456 container start eaf4fc6c27992fef57c4aed477d4f50668eb012294a98551fd05aebfab3fa4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-28T20:08:50.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:50 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/2811057474' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: set uid:gid to 167:167 (ceph:ceph) 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pidfile_write: ignore empty --pid-file 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: load: jerasure load: lrc 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: RocksDB version: 7.9.2 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Git sha 0 2024-08-28T20:08:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: DB SUMMARY 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: DB Session ID: QF2XG8PBCU44FU0ESFVV 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: CURRENT file: CURRENT 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: IDENTITY file: IDENTITY 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.error_if_exists: 0 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.create_if_missing: 0 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.paranoid_checks: 1 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-28T20:08:51.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.env: 0x55a9fba975a0 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.fs: PosixFileSystem 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.info_log: 0x55aa00e554e0 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_file_opening_threads: 16 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.statistics: (nil) 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.use_fsync: 0 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_log_file_size: 0 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.keep_log_file_num: 1000 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.recycle_log_file_num: 0 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.allow_fallocate: 1 2024-08-28T20:08:51.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.allow_mmap_reads: 0 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.allow_mmap_writes: 0 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.use_direct_reads: 0 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.create_missing_column_families: 0 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.db_log_dir: 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.wal_dir: 2024-08-28T20:08:51.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.advise_random_on_open: 1 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.db_write_buffer_size: 0 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.write_buffer_manager: 0x55aa00e595e0 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-28T20:08:51.235 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.rate_limiter: (nil) 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.wal_recovery_mode: 2 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.enable_thread_tracking: 0 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.enable_pipelined_write: 0 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.unordered_write: 0 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-28T20:08:51.236 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.row_cache: None 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.wal_filter: None 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.allow_ingest_behind: 0 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.two_write_queues: 0 2024-08-28T20:08:51.237 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.manual_wal_flush: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.wal_compression: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.atomic_flush: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.log_readahead_size: 0 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-28T20:08:51.238 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.best_efforts_recovery: 0 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.allow_data_in_errors: 0 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.db_host_id: __hostname__ 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_background_jobs: 2 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_background_compactions: -1 2024-08-28T20:08:51.239 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_subcompactions: 1 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_total_wal_size: 0 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-28T20:08:51.240 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_open_files: -1 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bytes_per_sync: 0 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_readahead_size: 0 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_background_flushes: -1 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Compression algorithms supported: 2024-08-28T20:08:51.241 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kZSTD supported: 0 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kXpressCompression supported: 0 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kBZip2Compression supported: 0 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kLZ4Compression supported: 1 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kZlibCompression supported: 1 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kLZ4HCCompression supported: 1 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: kSnappyCompression supported: 1 2024-08-28T20:08:51.242 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.merge_operator: 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_filter: None 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_filter_factory: None 2024-08-28T20:08:51.243 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.sst_partitioner_factory: None 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55aa00e55100) 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout: cache_index_and_filter_blocks: 1 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout: pin_top_level_index_and_filter: 1 2024-08-28T20:08:51.244 INFO:journalctl@ceph.mon.c.smithi121.stdout: index_type: 0 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: data_block_index_type: 0 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: index_shortening: 1 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: checksum: 4 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: no_block_cache: 0 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache: 0x55a9fce18850 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache_name: BinnedLRUCache 2024-08-28T20:08:51.245 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache_options: 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: capacity : 536870912 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: num_shard_bits : 4 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: strict_capacity_limit : 0 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: high_pri_pool_ratio: 0.000 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache_compressed: (nil) 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: persistent_cache: (nil) 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_size: 4096 2024-08-28T20:08:51.246 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_size_deviation: 10 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_restart_interval: 16 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: index_block_restart_interval: 1 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: metadata_block_size: 4096 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: partition_filters: 0 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: use_delta_encoding: 1 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: filter_policy: bloomfilter 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: whole_key_filtering: 1 2024-08-28T20:08:51.247 INFO:journalctl@ceph.mon.c.smithi121.stdout: verify_compression: 0 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: read_amp_bytes_per_bit: 0 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: format_version: 5 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: enable_index_compression: 1 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_align: 0 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: max_auto_readahead_size: 262144 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: prepopulate_block_cache: 0 2024-08-28T20:08:51.248 INFO:journalctl@ceph.mon.c.smithi121.stdout: initial_auto_readahead_size: 8192 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout: num_file_reads_for_auto_readahead: 2 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.write_buffer_size: 33554432 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_write_buffer_number: 2 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression: NoCompression 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression: Disabled 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.prefix_extractor: nullptr 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-28T20:08:51.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.num_levels: 7 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-28T20:08:51.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.level: 32767 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.strategy: 0 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.enabled: false 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-28T20:08:51.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.target_file_size_base: 67108864 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-28T20:08:51.252 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.arena_block_size: 1048576 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.disable_auto_compactions: 0 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-28T20:08:51.253 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.inplace_update_support: 0 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.bloom_locality: 0 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.max_successive_merges: 0 2024-08-28T20:08:51.254 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.paranoid_file_checks: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.force_consistency_checks: 1 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.report_bg_io_stats: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.ttl: 2592000 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.enable_blob_files: false 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.min_blob_size: 0 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.blob_file_size: 268435456 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-28T20:08:51.255 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.blob_file_starting_level: 0 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8cb68b6e-d4ec-4bbf-a9c0-2543052ecf8f 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875730949683, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875730950133, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724875730, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8cb68b6e-d4ec-4bbf-a9c0-2543052ecf8f", "db_session_id": "QF2XG8PBCU44FU0ESFVV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875730950230, "job": 1, "event": "recovery_finished"} 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-28T20:08:51.256 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55aa00e78a80 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: DB pointer 0x55aa01c1a000 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** DB Stats ** 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T20:08:51.257 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-28T20:08:51.258 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Block cache BinnedLRUCache@0x55a9fce18850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-08-28T20:08:51.259 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: using public_addr v2:172.21.15.121:0/0 -> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: starting mon.c rank -1 at public addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] at bind addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(???) e0 preinit fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).mds e1 new map 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: e1 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: btime 2024-08-28T20:07:12:747850+0000 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: legacy client fscid: -1 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-08-28T20:08:51.260 INFO:journalctl@ceph.mon.c.smithi121.stdout: No filesystems configured 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Added host smithi007 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:51.261 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi007:/etc/ceph/ceph.conf 2024-08-28T20:08:51.262 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Deploying cephadm binary to smithi121 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Added host smithi121 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.263 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1772210345' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1772210345' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:51.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:51.265 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c;count:3 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: Deploying daemon mon.c on smithi121 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/2957807340' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/2811057474' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 ceph-mon[25248]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 bash[25214]: eaf4fc6c27992fef57c4aed477d4f50668eb012294a98551fd05aebfab3fa4fa 2024-08-28T20:08:51.266 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:50 smithi121 systemd[1]: Started Ceph mon.c for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:08:51.785 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T20:08:51.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T20:08:52.030 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:08:56.305 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:08:56.305 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","modified":"2024-08-28T20:08:50.981180Z","created":"2024-08-28T20:07:08.826838Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-28T20:08:56.305 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 2 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: mon.a calling monitor election 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.306 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: mon.c calling monitor election 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: monmap epoch 2 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: last_changed 2024-08-28T20:08:50.981180+0000 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: min_mon_release 19 (squid) 2024-08-28T20:08:56.307 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: election_strategy: 1 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: fsmap 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: mgrmap e13: x(active, since 47s) 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: overall HEALTH_OK 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:56.308 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:56.309 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:08:56.309 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:56.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: mon.a calling monitor election 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: mon.c calling monitor election 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: monmap epoch 2 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: last_changed 2024-08-28T20:08:50.981180+0000 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: min_mon_release 19 (squid) 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: election_strategy: 1 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: fsmap 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: mgrmap e13: x(active, since 47s) 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: overall HEALTH_OK 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:56.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:56.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:56.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:08:56.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:57 smithi001 ceph-mon[20984]: Deploying daemon mon.b on smithi007 2024-08-28T20:08:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:57 smithi001 ceph-mon[20984]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:57 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/1075514371' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:57 smithi121 ceph-mon[25248]: Deploying daemon mon.b on smithi007 2024-08-28T20:08:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:57 smithi121 ceph-mon[25248]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:57.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:57 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/1075514371' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:57.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:57.835 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T20:08:57.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T20:08:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:08:58.477 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:08:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:08:57.981+0000 7fb937c00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-28T20:08:58.731 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:08:58.731 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","modified":"2024-08-28T20:08:50.981180Z","created":"2024-08-28T20:07:08.826838Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-28T20:08:58.731 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 2 2024-08-28T20:08:59.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:59 smithi001 ceph-mon[20984]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:08:59 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/2755056566' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:59.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:59 smithi121 ceph-mon[25248]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:08:59 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/2755056566' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:59.555 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 podman[25338]: 2024-08-28 20:08:59.522410694 +0000 UTC m=+0.311125581 container start ac8898ed341a0089675ec3d592741641eed37bc66249ebc4cd938b12d2e6d91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-b, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:08:59.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: set uid:gid to 167:167 (ceph:ceph) 2024-08-28T20:08:59.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-28T20:08:59.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pidfile_write: ignore empty --pid-file 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: load: jerasure load: lrc 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: RocksDB version: 7.9.2 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Git sha 0 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: DB SUMMARY 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: DB Session ID: ETHS1EZV5ZUNH37G8VQZ 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: CURRENT file: CURRENT 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: IDENTITY file: IDENTITY 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.error_if_exists: 0 2024-08-28T20:08:59.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.create_if_missing: 0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.paranoid_checks: 1 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.env: 0x560e761805a0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.fs: PosixFileSystem 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.info_log: 0x560e7c0ad4e0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_file_opening_threads: 16 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.statistics: (nil) 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.use_fsync: 0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_log_file_size: 0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-28T20:08:59.817 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.keep_log_file_num: 1000 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.recycle_log_file_num: 0 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.allow_fallocate: 1 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.allow_mmap_reads: 0 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.allow_mmap_writes: 0 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.use_direct_reads: 0 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.create_missing_column_families: 0 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.db_log_dir: 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.wal_dir: 2024-08-28T20:08:59.818 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-28T20:08:59.820 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-28T20:08:59.820 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-28T20:08:59.820 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-28T20:08:59.820 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-28T20:08:59.820 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.advise_random_on_open: 1 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.db_write_buffer_size: 0 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.write_buffer_manager: 0x560e7c0b15e0 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.rate_limiter: (nil) 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.wal_recovery_mode: 2 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.enable_thread_tracking: 0 2024-08-28T20:08:59.821 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.enable_pipelined_write: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.unordered_write: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.row_cache: None 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.wal_filter: None 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.allow_ingest_behind: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.two_write_queues: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.manual_wal_flush: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.wal_compression: 0 2024-08-28T20:08:59.822 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.atomic_flush: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.log_readahead_size: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.best_efforts_recovery: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.allow_data_in_errors: 0 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.db_host_id: __hostname__ 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_background_jobs: 2 2024-08-28T20:08:59.823 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_background_compactions: -1 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_subcompactions: 1 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_total_wal_size: 0 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_open_files: -1 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bytes_per_sync: 0 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-28T20:08:59.824 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_readahead_size: 0 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_background_flushes: -1 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Compression algorithms supported: 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kZSTD supported: 0 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kXpressCompression supported: 0 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kBZip2Compression supported: 0 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kLZ4Compression supported: 1 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kZlibCompression supported: 1 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kLZ4HCCompression supported: 1 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: kSnappyCompression supported: 1 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-28T20:08:59.825 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.merge_operator: 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_filter: None 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_filter_factory: None 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.sst_partitioner_factory: None 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560e7c0ad100) 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-08-28T20:08:59.826 INFO:journalctl@ceph.mon.b.smithi007.stdout: index_type: 0 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: data_block_index_type: 0 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: index_shortening: 1 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: checksum: 4 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: no_block_cache: 0 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_cache: 0x560e78070850 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_cache_options: 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: capacity : 536870912 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: num_shard_bits : 4 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: strict_capacity_limit : 0 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-08-28T20:08:59.827 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_cache_compressed: (nil) 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: persistent_cache: (nil) 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_size: 4096 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_size_deviation: 10 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_restart_interval: 16 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: index_block_restart_interval: 1 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: metadata_block_size: 4096 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: partition_filters: 0 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: use_delta_encoding: 1 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: filter_policy: bloomfilter 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: whole_key_filtering: 1 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: verify_compression: 0 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-08-28T20:08:59.828 INFO:journalctl@ceph.mon.b.smithi007.stdout: format_version: 5 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout: enable_index_compression: 1 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout: block_align: 0 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout: max_auto_readahead_size: 262144 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout: prepopulate_block_cache: 0 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout: initial_auto_readahead_size: 8192 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.write_buffer_size: 33554432 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_write_buffer_number: 2 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression: NoCompression 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression: Disabled 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.prefix_extractor: nullptr 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-28T20:08:59.829 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.num_levels: 7 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-28T20:08:59.830 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.level: 32767 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.strategy: 0 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.enabled: false 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.target_file_size_base: 67108864 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-28T20:08:59.831 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.arena_block_size: 1048576 2024-08-28T20:08:59.832 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.disable_auto_compactions: 0 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-28T20:08:59.833 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.inplace_update_support: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.bloom_locality: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.max_successive_merges: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.paranoid_file_checks: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.force_consistency_checks: 1 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.report_bg_io_stats: 0 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.ttl: 2592000 2024-08-28T20:08:59.834 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.enable_blob_files: false 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.min_blob_size: 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.blob_file_size: 268435456 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.blob_file_starting_level: 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-28T20:08:59.835 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e3245cce-1a81-4d97-95f0-26409947e7a2 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875739559452, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875739559885, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724875739, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e3245cce-1a81-4d97-95f0-26409947e7a2", "db_session_id": "ETHS1EZV5ZUNH37G8VQZ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724875739559985, "job": 1, "event": "recovery_finished"} 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560e7c0d0a80 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: DB pointer 0x560e7ce72000 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout: ** DB Stats ** 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T20:08:59.836 INFO:journalctl@ceph.mon.b.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: ** Compaction Stats [default] ** 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:59.837 INFO:journalctl@ceph.mon.b.smithi007.stdout: 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: ** Compaction Stats [default] ** 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-28T20:08:59.838 INFO:journalctl@ceph.mon.b.smithi007.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: Block cache BinnedLRUCache@0x560e78070850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: using public_addr v2:172.21.15.7:0/0 -> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: starting mon.b rank -1 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(???) e0 preinit fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).mds e1 new map 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-28T20:08:59.839 INFO:journalctl@ceph.mon.b.smithi007.stdout: e1 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout: btime 2024-08-28T20:07:12:747850+0000 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout: legacy client fscid: -1 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout: 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout: No filesystems configured 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-28T20:08:59.840 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Added host smithi007 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.841 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi007:/etc/ceph/ceph.conf 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:59.842 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Deploying cephadm binary to smithi121 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Added host smithi121 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1772210345' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-28T20:08:59.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1772210345' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:08:59.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c;count:3 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Deploying daemon mon.c on smithi121 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/2957807340' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/2811057474' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.a calling monitor election 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.c calling monitor election 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.846 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: monmap epoch 2 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: last_changed 2024-08-28T20:08:50.981180+0000 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: min_mon_release 19 (squid) 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: election_strategy: 1 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: fsmap 2024-08-28T20:08:59.847 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mgrmap e13: x(active, since 47s) 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: overall HEALTH_OK 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: Deploying daemon mon.b on smithi007 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/1075514371' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/2755056566' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:08:59.848 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 ceph-mon[25357]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-28T20:08:59.849 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 bash[25338]: ac8898ed341a0089675ec3d592741641eed37bc66249ebc4cd938b12d2e6d91c 2024-08-28T20:08:59.849 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:08:59 smithi007 systemd[1]: Started Ceph mon.b for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:09:00.328 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T20:09:00.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T20:09:00.577 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:09:04.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:09:04.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: mon.a calling monitor election 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: mon.c calling monitor election 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: mon.b calling monitor election 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: monmap epoch 3 2024-08-28T20:09:04.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: last_changed 2024-08-28T20:08:59.590173+0000 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: min_mon_release 19 (squid) 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: election_strategy: 1 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: 2: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.b 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: fsmap 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: mgrmap e13: x(active, since 56s) 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: overall HEALTH_OK 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: mon.a calling monitor election 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: mon.c calling monitor election 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: mon.b calling monitor election 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: monmap epoch 3 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: last_changed 2024-08-28T20:08:59.590173+0000 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: min_mon_release 19 (squid) 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: election_strategy: 1 2024-08-28T20:09:04.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: 2: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.b 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: fsmap 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: mgrmap e13: x(active, since 56s) 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: overall HEALTH_OK 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:04.982 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: mon.a calling monitor election 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: mon.c calling monitor election 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: mon.b calling monitor election 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: monmap epoch 3 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: last_changed 2024-08-28T20:08:59.590173+0000 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: created 2024-08-28T20:07:08.826838+0000 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: min_mon_release 19 (squid) 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: election_strategy: 1 2024-08-28T20:09:05.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: 2: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.b 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: fsmap 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: mgrmap e13: x(active, since 56s) 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: overall HEALTH_OK 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:05.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:05.653 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:09:05.653 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","modified":"2024-08-28T20:08:59.590173Z","created":"2024-08-28T20:07:08.826838Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-28T20:09:05.653 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 3 2024-08-28T20:09:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:05 smithi001 ceph-mon[20984]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:05 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:05 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:05 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/1658980523' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:09:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:05 smithi121 ceph-mon[25248]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:05 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:05 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:05 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/1658980523' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:09:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:05 smithi007 ceph-mon[25357]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:05 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:05 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:09:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:05 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/1658980523' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T20:09:06.332 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-28T20:09:06.333 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-28T20:09:06.709 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: Updating smithi001:/etc/ceph/ceph.conf 2024-08-28T20:09:06.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: Updating smithi007:/etc/ceph/ceph.conf 2024-08-28T20:09:06.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-28T20:09:06.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: Updating smithi001:/etc/ceph/ceph.conf 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: Updating smithi007:/etc/ceph/ceph.conf 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:06.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: Updating smithi001:/etc/ceph/ceph.conf 2024-08-28T20:09:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: Updating smithi007:/etc/ceph/ceph.conf 2024-08-28T20:09:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-28T20:09:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:07.557 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:09:07.557 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-08-28T20:09:07.557 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:09:07.557 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-08-28T20:09:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: Updating smithi001:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:08.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:08.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:08.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:07 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/4199038566' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: Updating smithi001:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:08.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:08.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:08.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:07 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/4199038566' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:08.162 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: Updating smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.162 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: Updating smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: Updating smithi001:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:08.163 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:07 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/4199038566' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:08.555 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-28T20:09:08.556 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:09:08.556 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-08-28T20:09:08.614 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:09:08.614 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:09:08.710 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:09:08.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-08-28T20:09:08.743 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:09:08.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:09:08.813 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:09:08.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.conf 2024-08-28T20:09:08.840 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:09:08.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T20:09:08.905 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-08-28T20:09:08.906 INFO:tasks.cephadm:Adding mgr.y on smithi007 2024-08-28T20:09:08.906 INFO:tasks.cephadm:Adding mgr.z on smithi121 2024-08-28T20:09:08.906 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi001=x;smithi007=y;smithi121=z' 2024-08-28T20:09:08.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:08 smithi001 ceph-mon[20984]: Reconfiguring mon.a (unknown last config time)... 2024-08-28T20:09:08.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:08 smithi001 ceph-mon[20984]: Reconfiguring daemon mon.a on smithi001 2024-08-28T20:09:08.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:08 smithi007 ceph-mon[25357]: Reconfiguring mon.a (unknown last config time)... 2024-08-28T20:09:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:08 smithi007 ceph-mon[25357]: Reconfiguring daemon mon.a on smithi001 2024-08-28T20:09:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:09.088 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:08 smithi121 ceph-mon[25248]: Reconfiguring mon.a (unknown last config time)... 2024-08-28T20:09:09.088 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:08 smithi121 ceph-mon[25248]: Reconfiguring daemon mon.a on smithi001 2024-08-28T20:09:09.088 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:09.182 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:09:09.832 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mgr update... 2024-08-28T20:09:10.018 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:09 smithi007 ceph-mon[25357]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:10.018 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.019 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.019 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:10.019 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:10.019 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:09 smithi001 ceph-mon[20984]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:09 smithi121 ceph-mon[25248]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:10.335 DEBUG:teuthology.orchestra.run.smithi007:mgr.y> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-28T20:09:10.338 DEBUG:teuthology.orchestra.run.smithi121:mgr.z> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-28T20:09:10.341 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-28T20:09:10.341 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-28T20:09:10.345 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-28T20:09:10.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-28T20:09:10.389 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-28T20:09:10.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-28T20:09:10.437 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-28T20:09:10.437 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-28T20:09:10.483 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-28T20:09:10.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-28T20:09:10.531 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-28T20:09:10.531 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-28T20:09:10.578 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-28T20:09:10.579 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-28T20:09:10.626 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-28T20:09:10.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-28T20:09:10.672 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-28T20:09:10.672 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-28T20:09:10.732 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-28T20:09:10.732 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-28T20:09:10.781 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-28T20:09:10.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-28T20:09:10.833 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-28T20:09:10.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-28T20:09:10.887 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-28T20:09:10.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-28T20:09:10.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:10 smithi001 ceph-mon[20984]: Reconfiguring mon.b (monmap changed)... 2024-08-28T20:09:10.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:10 smithi001 ceph-mon[20984]: Reconfiguring daemon mon.b on smithi007 2024-08-28T20:09:10.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:10 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:10.919 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-28T20:09:10.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-28T20:09:10.973 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-28T20:09:10.973 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-28T20:09:11.034 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-28T20:09:11.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-28T20:09:11.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:10 smithi007 ceph-mon[25357]: Reconfiguring mon.b (monmap changed)... 2024-08-28T20:09:11.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:10 smithi007 ceph-mon[25357]: Reconfiguring daemon mon.b on smithi007 2024-08-28T20:09:11.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:10 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:11.070 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:11.088 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-28T20:09:11.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-28T20:09:11.151 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-28T20:09:11.151 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-28T20:09:11.164 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:10 smithi121 ceph-mon[25248]: Reconfiguring mon.b (monmap changed)... 2024-08-28T20:09:11.164 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:10 smithi121 ceph-mon[25248]: Reconfiguring daemon mon.b on smithi007 2024-08-28T20:09:11.164 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:10 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:11.202 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-28T20:09:11.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-28T20:09:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:11.249 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-28T20:09:11.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-28T20:09:11.311 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-28T20:09:11.311 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-28T20:09:11.367 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-28T20:09:11.367 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-28T20:09:11.432 DEBUG:tasks.cephadm:set 22 configs 2024-08-28T20:09:11.432 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi001') 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi007=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: Saving service mgr spec with placement smithi001=x;smithi007=y;smithi121=z;count:3 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: Reconfiguring mon.c (monmap changed)... 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:11.766 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:11 smithi001 ceph-mon[20984]: Reconfiguring daemon mon.c on smithi121 2024-08-28T20:09:12.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi007=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:09:12.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: Saving service mgr spec with placement smithi001=x;smithi007=y;smithi121=z;count:3 2024-08-28T20:09:12.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:12.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:12.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:12.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: Reconfiguring mon.c (monmap changed)... 2024-08-28T20:09:12.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:12.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:12.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:12.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:11 smithi121 ceph-mon[25248]: Reconfiguring daemon mon.c on smithi121 2024-08-28T20:09:12.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi007=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: Saving service mgr spec with placement smithi001=x;smithi007=y;smithi121=z;count:3 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: Reconfiguring mon.c (monmap changed)... 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:11 smithi007 ceph-mon[25357]: Reconfiguring daemon mon.c on smithi121 2024-08-28T20:09:12.426 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:13.272 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:13.273 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:13.381 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:13 smithi001 ceph-mon[20984]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:13.382 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:13.382 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:13.382 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:13.382 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:13 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:13 smithi121 ceph-mon[25248]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:13.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:13 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:13 smithi007 ceph-mon[25357]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:13 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:13.926 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi001') 2024-08-28T20:09:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:14.125 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/460648942' entity='client.admin' 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T20:09:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:14 smithi007 ceph-mon[25357]: Deploying daemon mgr.z on smithi121 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/460648942' entity='client.admin' 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:14.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:14.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:14 smithi001 ceph-mon[20984]: Deploying daemon mgr.z on smithi121 2024-08-28T20:09:14.614 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi001') 2024-08-28T20:09:14.674 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/460648942' entity='client.admin' 2024-08-28T20:09:14.674 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:14.674 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:14.674 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:14.674 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:14.675 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T20:09:14.675 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:14.675 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:14.675 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:14 smithi121 ceph-mon[25248]: Deploying daemon mgr.z on smithi121 2024-08-28T20:09:15.229 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 systemd[1]: Starting Ceph mgr.z for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:09:15.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 -- 172.21.15.1:0/2391356402 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f277c03f280 msgr2=0x7f277c041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 --2- 172.21.15.1:0/2391356402 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f277c03f280 0x7f277c041790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2780000c00 tx=0x7f2780005d50 comp rx=0 tx=0).stop 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 -- 172.21.15.1:0/2391356402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2794103310 msgr2=0x7f27941998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 --2- 172.21.15.1:0/2391356402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2794103310 0x7f27941998e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f278800ebc0 tx=0x7f278800c6a0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 -- 172.21.15.1:0/2391356402 shutdown_connections 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 --2- 172.21.15.1:0/2391356402 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f277c03f280 0x7f277c041790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 --2- 172.21.15.1:0/2391356402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2794104d40 0x7f279419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 --2- 172.21.15.1:0/2391356402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27941043a0 0x7f2794199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 --2- 172.21.15.1:0/2391356402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2794103310 0x7f27941998e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 -- 172.21.15.1:0/2391356402 >> 172.21.15.1:0/2391356402 conn(0x7f27940fec60 msgr2=0x7f27941076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.137+0000 7f279ac00640 1 -- 172.21.15.1:0/2391356402 shutdown_connections 2024-08-28T20:09:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.138+0000 7f279ac00640 1 -- 172.21.15.1:0/2391356402 wait complete. 2024-08-28T20:09:15.613 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:15 smithi121 ceph-mon[25248]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:15.613 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:15 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2391356402' entity='client.admin' 2024-08-28T20:09:15.613 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 podman[26821]: 2024-08-28 20:09:15.308643558 +0000 UTC m=+0.101415092 container create c2c58cce56863aefcf3f17178ff729d8c3859d39e2ca9ce2e123ea0be20d5a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:09:15.614 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 podman[26821]: 2024-08-28 20:09:15.222821608 +0000 UTC m=+0.015593142 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:09:15.614 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 podman[26821]: 2024-08-28 20:09:15.50299996 +0000 UTC m=+0.295771494 container init c2c58cce56863aefcf3f17178ff729d8c3859d39e2ca9ce2e123ea0be20d5a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-28T20:09:15.614 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 podman[26821]: 2024-08-28 20:09:15.506260467 +0000 UTC m=+0.299032013 container start c2c58cce56863aefcf3f17178ff729d8c3859d39e2ca9ce2e123ea0be20d5a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-z, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-28T20:09:15.614 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 ceph-mgr[26840]: -- 172.21.15.121:0/2810630402 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56070700d0e0 con 0x56070702ba80 2024-08-28T20:09:15.614 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 bash[26821]: c2c58cce56863aefcf3f17178ff729d8c3859d39e2ca9ce2e123ea0be20d5a28 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 -- 172.21.15.1:0/1304714900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30103310 msgr2=0x7f8c30103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/1304714900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30103310 0x7f8c30103780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009900 tx=0x7f8c2002a490 comp rx=0 tx=0).stop 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 -- 172.21.15.1:0/1304714900 shutdown_connections 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/1304714900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30104d40 0x7f8c3010b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/1304714900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c301043a0 0x7f8c301047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/1304714900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30103310 0x7f8c30103780 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 -- 172.21.15.1:0/1304714900 >> 172.21.15.1:0/1304714900 conn(0x7f8c300fec60 msgr2=0x7f8c30101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.312+0000 7f8c2fe00640 1 -- 172.21.15.1:0/1304714900 shutdown_connections 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.313+0000 7f8c2fe00640 1 -- 172.21.15.1:0/1304714900 wait complete. 2024-08-28T20:09:15.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.313+0000 7f8c2fe00640 1 Processor -- start 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 -- start start 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 0x7f8c3019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c301043a0 0x7f8c3019c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30104d40 0x7f8c3019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3010ed80 con 0x7f8c30104d40 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3010ec00 con 0x7f8c301043a0 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3010ef00 con 0x7f8c30103310 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 0x7f8c3019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 0x7f8c3019bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40072/0 (socket says 172.21.15.1:40072) 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2ea00640 1 -- 172.21.15.1:0/3503738197 learned_addr learned my addr 172.21.15.1:0/3503738197 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2f400640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30104d40 0x7f8c3019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:15.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.314+0000 7f8c2e000640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c301043a0 0x7f8c3019c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2ea00640 1 -- 172.21.15.1:0/3503738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c301043a0 msgr2=0x7f8c3019c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2ea00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c301043a0 0x7f8c3019c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2ea00640 1 -- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30104d40 msgr2=0x7f8c3019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2ea00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30104d40 0x7f8c3019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2ea00640 1 -- 172.21.15.1:0/3503738197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3019d610 con 0x7f8c30103310 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2f400640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30104d40 0x7f8c3019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c2ea00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 0x7f8c3019bbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8c2002aa80 tx=0x7f8c20003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2003f070 con 0x7f8c30103310 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.315+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f8c20031b20 con 0x7f8c30103310 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.316+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3019d8a0 con 0x7f8c30103310 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.316+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20035030 con 0x7f8c30103310 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.316+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c301a4000 con 0x7f8c30103310 2024-08-28T20:09:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.317+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3010f4e0 con 0x7f8c30103310 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.317+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) ==== 51252+0+0 (secure 0 0 0) 0x7f8c20042070 con 0x7f8c30103310 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.317+0000 7f8c27400640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c1403f280 0x7f8c14041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.317+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8c20074120 con 0x7f8c30103310 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.318+0000 7f8c2e000640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c1403f280 0x7f8c14041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.318+0000 7f8c2e000640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c1403f280 0x7f8c14041790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009bd0 tx=0x7f8c1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.323+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c2003b460 con 0x7f8c30103310 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.524+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f8c301a41d0 con 0x7f8c30103310 2024-08-28T20:09:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.529+0000 7f8c27400640 1 -- 172.21.15.1:0/3503738197 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v13)=0 v13) ==== 106+0+0 (secure 0 0 0) 0x7f8c20042360 con 0x7f8c30103310 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c1403f280 msgr2=0x7f8c14041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c1403f280 0x7f8c14041790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009bd0 tx=0x7f8c1c005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 msgr2=0x7f8c3019bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 0x7f8c3019bbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8c2002aa80 tx=0x7f8c20003c10 comp rx=0 tx=0).stop 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 shutdown_connections 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c1403f280 0x7f8c14041790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c30104d40 0x7f8c3019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c301043a0 0x7f8c3019c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 --2- 172.21.15.1:0/3503738197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c30103310 0x7f8c3019bbe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.531+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 >> 172.21.15.1:0/3503738197 conn(0x7f8c300fec60 msgr2=0x7f8c30075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.532+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 shutdown_connections 2024-08-28T20:09:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:15.532+0000 7f8c2fe00640 1 -- 172.21.15.1:0/3503738197 wait complete. 2024-08-28T20:09:15.726 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:15 smithi001 ceph-mon[20984]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:15.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:15 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2391356402' entity='client.admin' 2024-08-28T20:09:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:15 smithi007 ceph-mon[25357]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:15 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2391356402' entity='client.admin' 2024-08-28T20:09:15.979 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:09:15 smithi121 systemd[1]: Started Ceph mgr.z for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:09:16.385 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 -- 172.21.15.1:0/1513677205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 msgr2=0x7f60d41047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 --2- 172.21.15.1:0/1513677205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 0x7f60d41047d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009900 tx=0x7f60c002a480 comp rx=0 tx=0).stop 2024-08-28T20:09:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 -- 172.21.15.1:0/1513677205 shutdown_connections 2024-08-28T20:09:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 --2- 172.21.15.1:0/1513677205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 0x7f60d410b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 --2- 172.21.15.1:0/1513677205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 0x7f60d41047d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 --2- 172.21.15.1:0/1513677205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 -- 172.21.15.1:0/1513677205 >> 172.21.15.1:0/1513677205 conn(0x7f60d40feca0 msgr2=0x7f60d4101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 -- 172.21.15.1:0/1513677205 shutdown_connections 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.557+0000 7f60dac00640 1 -- 172.21.15.1:0/1513677205 wait complete. 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.558+0000 7f60dac00640 1 Processor -- start 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.558+0000 7f60dac00640 1 -- start start 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.558+0000 7f60dac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d4076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.558+0000 7f60dac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 0x7f60d40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.558+0000 7f60dac00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 0x7f60d40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60dac00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f60d410eda0 con 0x7f60d4104d60 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60dac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60d410ec20 con 0x7f60d41043c0 2024-08-28T20:09:16.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60dac00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60d410ef20 con 0x7f60d4103330 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d4076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d4076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40084/0 (socket says 172.21.15.1:40084) 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 -- 172.21.15.1:0/3251185808 learned_addr learned my addr 172.21.15.1:0/3251185808 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60da200640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 0x7f60d40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d8e00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 0x7f60d40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 -- 172.21.15.1:0/3251185808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 msgr2=0x7f60d40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 0x7f60d40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 -- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 msgr2=0x7f60d40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 0x7f60d40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60d9800640 1 -- 172.21.15.1:0/3251185808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d40760f0 con 0x7f60d4103330 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.559+0000 7f60da200640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 0x7f60d40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:16.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.560+0000 7f60d9800640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d4076be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f60c800e9f0 tx=0x7f60c800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.560+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c800cd80 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.560+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f60c8005490 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.560+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8010430 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.560+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d41a3ac0 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.560+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d41a3f20 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.561+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d41037a0 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.561+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) ==== 51252+0+0 (secure 0 0 0) 0x7f60c80046c0 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.562+0000 7f60d2000640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f60bc03f280 0x7f60bc041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.562+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f60c8053e50 con 0x7f60d4103330 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.562+0000 7f60d8e00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f60bc03f280 0x7f60bc041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.563+0000 7f60d8e00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f60bc03f280 0x7f60bc041790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60c0000c00 tx=0x7f60c0005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:16.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.567+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60c8016330 con 0x7f60d4103330 2024-08-28T20:09:16.710 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:16.710 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.710 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.710 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.711 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:16.711 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T20:09:16.711 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:16.711 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:16.711 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:16 smithi007 ceph-mon[25357]: Deploying daemon mgr.y on smithi007 2024-08-28T20:09:16.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:16.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:16 smithi001 ceph-mon[20984]: Deploying daemon mgr.y on smithi007 2024-08-28T20:09:16.728 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:16.729 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:16.734 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:16.736 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:16.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.804+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f60d4063d60 con 0x7f60d4103330 2024-08-28T20:09:16.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.809+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f60c801f900 con 0x7f60d4103330 2024-08-28T20:09:16.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.809+0000 7f60d2000640 1 -- 172.21.15.1:0/3251185808 <== mon.1 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f60c801c1c0 con 0x7f60d4103330 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f60bc03f280 msgr2=0x7f60bc041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f60bc03f280 0x7f60bc041790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60c0000c00 tx=0x7f60c0005ef0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 msgr2=0x7f60d4076be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d4076be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f60c800e9f0 tx=0x7f60c800edf0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 shutdown_connections 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f60bc03f280 0x7f60bc041790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60d4104d60 0x7f60d40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d41043c0 0x7f60d40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 --2- 172.21.15.1:0/3251185808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d4103330 0x7f60d4076be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 >> 172.21.15.1:0/3251185808 conn(0x7f60d40feca0 msgr2=0x7f60d41076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 shutdown_connections 2024-08-28T20:09:16.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:16.812+0000 7f60dac00640 1 -- 172.21.15.1:0/3251185808 wait complete. 2024-08-28T20:09:16.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:16.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:16.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:16 smithi121 ceph-mon[25248]: Deploying daemon mgr.y on smithi007 2024-08-28T20:09:17.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 -- 172.21.15.1:0/2089398322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c1045c0 msgr2=0x7fe60c1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 --2- 172.21.15.1:0/2089398322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c1045c0 0x7fe60c1049d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009860 tx=0x7fe5f402a3d0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 -- 172.21.15.1:0/2089398322 shutdown_connections 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 --2- 172.21.15.1:0/2089398322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c104f60 0x7fe60c10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 --2- 172.21.15.1:0/2089398322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c1045c0 0x7fe60c1049d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 --2- 172.21.15.1:0/2089398322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe60c103530 0x7fe60c1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 -- 172.21.15.1:0/2089398322 >> 172.21.15.1:0/2089398322 conn(0x7fe60c0feec0 msgr2=0x7fe60c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 -- 172.21.15.1:0/2089398322 shutdown_connections 2024-08-28T20:09:17.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.309+0000 7fe612c00640 1 -- 172.21.15.1:0/2089398322 wait complete. 2024-08-28T20:09:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.310+0000 7fe612c00640 1 Processor -- start 2024-08-28T20:09:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.310+0000 7fe612c00640 1 -- start start 2024-08-28T20:09:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.310+0000 7fe612c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe60c103530 0x7fe60c19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:17.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe612c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c1045c0 0x7fe60c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe612c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104f60 0x7fe60c19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe612c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c10f070 con 0x7fe60c103530 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe612c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c10eef0 con 0x7fe60c104f60 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe612c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c10f1f0 con 0x7fe60c1045c0 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe603e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c1045c0 0x7fe60c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe60be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe60c103530 0x7fe60c19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe610c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104f60 0x7fe60c19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe603e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c1045c0 0x7fe60c19c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:52318/0 (socket says 172.21.15.1:52318) 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe603e00640 1 -- 172.21.15.1:0/2158483886 learned_addr learned my addr 172.21.15.1:0/2158483886 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe610c00640 1 -- 172.21.15.1:0/2158483886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c1045c0 msgr2=0x7fe60c19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe610c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c1045c0 0x7fe60c19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe610c00640 1 -- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe60c103530 msgr2=0x7fe60c19bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe610c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe60c103530 0x7fe60c19bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.311+0000 7fe610c00640 1 -- 172.21.15.1:0/2158483886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c19d900 con 0x7fe60c104f60 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.312+0000 7fe610c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104f60 0x7fe60c19d0e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe604009fd0 tx=0x7fe60400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.312+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60400ce20 con 0x7fe60c104f60 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.312+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe604005020 con 0x7fe60c104f60 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.312+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604010690 con 0x7fe60c104f60 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.312+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c19dbf0 con 0x7fe60c104f60 2024-08-28T20:09:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.312+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c1a42f0 con 0x7fe60c104f60 2024-08-28T20:09:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.313+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 51252+0+0 (secure 0 0 0) 0x7fe604010830 con 0x7fe60c104f60 2024-08-28T20:09:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.313+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c1a44c0 con 0x7fe60c104f60 2024-08-28T20:09:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.314+0000 7fe609600640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe5f003f280 0x7fe5f0041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.314+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe604054110 con 0x7fe60c104f60 2024-08-28T20:09:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.314+0000 7fe60be00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe5f003f280 0x7fe5f0041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.315+0000 7fe60be00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe5f003f280 0x7fe5f0041790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009530 tx=0x7fe5fc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:17.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.319+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe604016370 con 0x7fe60c104f60 2024-08-28T20:09:17.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.522+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fe60c1a4690 con 0x7fe60c104f60 2024-08-28T20:09:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.527+0000 7fe609600640 1 -- 172.21.15.1:0/2158483886 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7fe60401fe40 con 0x7fe60c104f60 2024-08-28T20:09:17.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe5f003f280 msgr2=0x7fe5f0041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe5f003f280 0x7fe5f0041790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009530 tx=0x7fe5fc009260 comp rx=0 tx=0).stop 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104f60 msgr2=0x7fe60c19d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104f60 0x7fe60c19d0e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe604009fd0 tx=0x7fe60400ef10 comp rx=0 tx=0).stop 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 shutdown_connections 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe5f003f280 0x7fe5f0041790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104f60 0x7fe60c19d0e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe60c1045c0 0x7fe60c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 --2- 172.21.15.1:0/2158483886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe60c103530 0x7fe60c19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 >> 172.21.15.1:0/2158483886 conn(0x7fe60c0feec0 msgr2=0x7fe60c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 shutdown_connections 2024-08-28T20:09:17.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:17.530+0000 7fe612c00640 1 -- 172.21.15.1:0/2158483886 wait complete. 2024-08-28T20:09:17.565 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 systemd[1]: Starting Ceph mgr.y for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:09:17.870 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:17 smithi007 ceph-mon[25357]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:17.870 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:17 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:17.870 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:17 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:17.871 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 podman[26480]: 2024-08-28 20:09:17.518131195 +0000 UTC m=+0.015460918 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:09:17.871 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 podman[26480]: 2024-08-28 20:09:17.629434071 +0000 UTC m=+0.126763824 container create afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-28T20:09:17.871 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 podman[26480]: 2024-08-28 20:09:17.831547683 +0000 UTC m=+0.328877392 container init afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:09:17.871 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 podman[26480]: 2024-08-28 20:09:17.834850481 +0000 UTC m=+0.332180192 container start afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-08-28T20:09:17.871 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 ceph-mgr[26500]: -- 172.21.15.7:0/3576803106 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e187a010e0 con 0x55e18c7a0000 2024-08-28T20:09:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:17 smithi001 ceph-mon[20984]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:17 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:17 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:17 smithi121 ceph-mon[25248]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:17 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:17 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:18.315 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 bash[26480]: afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 2024-08-28T20:09:18.315 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:09:17 smithi007 systemd[1]: Started Ceph mgr.y for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:09:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 -- 172.21.15.1:0/731326974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9441043a0 msgr2=0x7fa9441047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 --2- 172.21.15.1:0/731326974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9441043a0 0x7fa9441047b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009900 tx=0x7fa92c02a480 comp rx=0 tx=0).stop 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 -- 172.21.15.1:0/731326974 shutdown_connections 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 --2- 172.21.15.1:0/731326974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa9441043a0 0x7fa9441047b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 --2- 172.21.15.1:0/731326974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa944104d40 0x7fa94410b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 --2- 172.21.15.1:0/731326974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa944103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 -- 172.21.15.1:0/731326974 >> 172.21.15.1:0/731326974 conn(0x7fa9440fec60 msgr2=0x7fa944101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 -- 172.21.15.1:0/731326974 shutdown_connections 2024-08-28T20:09:18.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.428+0000 7fa943e00640 1 -- 172.21.15.1:0/731326974 wait complete. 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.429+0000 7fa943e00640 1 Processor -- start 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.429+0000 7fa943e00640 1 -- start start 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.429+0000 7fa943e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa94419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9441043a0 0x7fa94419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa944104d40 0x7fa94419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410ee50 con 0x7fa944104d40 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410ecd0 con 0x7fa944103310 2024-08-28T20:09:18.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410efd0 con 0x7fa9441043a0 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa942a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa94419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa93be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9441043a0 0x7fa94419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa942a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa94419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59842/0 (socket says 172.21.15.1:59842) 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa942a00640 1 -- 172.21.15.1:0/3285545696 learned_addr learned my addr 172.21.15.1:0/3285545696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa944104d40 0x7fa94419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943400640 1 -- 172.21.15.1:0/3285545696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9441043a0 msgr2=0x7fa94419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943400640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9441043a0 0x7fa94419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943400640 1 -- 172.21.15.1:0/3285545696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 msgr2=0x7fa94419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943400640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa94419bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa943400640 1 -- 172.21.15.1:0/3285545696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94419d730 con 0x7fa944104d40 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.430+0000 7fa942a00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa94419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:18.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.431+0000 7fa943400640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa944104d40 0x7fa94419cf10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009fd0 tx=0x7fa93c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.431+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00ce20 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.431+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa93c005020 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.431+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94419da20 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.431+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c010690 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.431+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9441a4120 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.433+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 51252+0+0 (secure 0 0 0) 0x7fa93c010830 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.433+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9200052c0 con 0x7fa944104d40 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.433+0000 7fa93b400640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa92803f280 0x7fa928041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.433+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa93c053ec0 con 0x7fa944104d40 2024-08-28T20:09:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.434+0000 7fa942a00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa92803f280 0x7fa928041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.434+0000 7fa942a00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa92803f280 0x7fa928041790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa934005fd0 tx=0x7fa93400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:18.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.438+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa93c01fe40 con 0x7fa944104d40 2024-08-28T20:09:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.324+0000 7f301a000640 1 -- 172.21.15.1:0/1359490187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3014103310 msgr2=0x7f3014103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.324+0000 7f301a000640 1 --2- 172.21.15.1:0/1359490187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3014103310 0x7f3014103780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3008009900 tx=0x7f300802a480 comp rx=0 tx=0).stop 2024-08-28T20:09:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 -- 172.21.15.1:0/1359490187 shutdown_connections 2024-08-28T20:09:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 --2- 172.21.15.1:0/1359490187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30141043a0 0x7f30141047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 --2- 172.21.15.1:0/1359490187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301410b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 --2- 172.21.15.1:0/1359490187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3014103310 0x7f3014103780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 -- 172.21.15.1:0/1359490187 >> 172.21.15.1:0/1359490187 conn(0x7f30140fec60 msgr2=0x7f3014101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 -- 172.21.15.1:0/1359490187 shutdown_connections 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.325+0000 7f301a000640 1 -- 172.21.15.1:0/1359490187 wait complete. 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 Processor -- start 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 -- start start 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3014103310 0x7f301419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 0x7f301419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f301410ee50 con 0x7f3014103310 2024-08-28T20:09:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f301410ecd0 con 0x7f30141043a0 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f301a000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f301410efd0 con 0x7f3014104d40 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f3018c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3014103310 0x7f301419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f3019600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f3013e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 0x7f301419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f3013e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 0x7f301419c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59828/0 (socket says 172.21.15.1:59828) 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 -- 172.21.15.1:0/2701341866 learned_addr learned my addr 172.21.15.1:0/2701341866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.326+0000 7f3019600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301419cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:52338/0 (socket says 172.21.15.1:52338) 2024-08-28T20:09:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 -- 172.21.15.1:0/2701341866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 msgr2=0x7f301419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 -- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3014103310 msgr2=0x7f301419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3014103310 0x7f301419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 -- 172.21.15.1:0/2701341866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301419d720 con 0x7f30141043a0 2024-08-28T20:09:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3019600640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.327+0000 7f3013e00640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 0x7f301419c360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f300000e9f0 tx=0x7f300000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.328+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300000cd80 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.328+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f30000108c0 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.328+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000187d0 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.328+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301419da10 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.328+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141a4110 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.329+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014103780 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.330+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 51252+0+0 (secure 0 0 0) 0x7f3000010430 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.330+0000 7f3011600640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2ffc03f280 0x7f2ffc041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.330+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3000053e30 con 0x7f30141043a0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.330+0000 7f3018c00640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2ffc03f280 0x7f2ffc041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.331+0000 7f3018c00640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2ffc03f280 0x7f2ffc041790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3008000c00 tx=0x7f3008031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.340+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3000014230 con 0x7f30141043a0 2024-08-28T20:09:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.541+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f30141a4880 con 0x7f30141043a0 2024-08-28T20:09:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.546+0000 7f3011600640 1 -- 172.21.15.1:0/2701341866 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v16)=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7f3000010d50 con 0x7f30141043a0 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2ffc03f280 msgr2=0x7f2ffc041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2ffc03f280 0x7f2ffc041790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3008000c00 tx=0x7f3008031400 comp rx=0 tx=0).stop 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 msgr2=0x7f301419c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 0x7f301419c360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f300000e9f0 tx=0x7f300000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 shutdown_connections 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2ffc03f280 0x7f2ffc041790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014104d40 0x7f301419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30141043a0 0x7f301419c360 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 --2- 172.21.15.1:0/2701341866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3014103310 0x7f301419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 >> 172.21.15.1:0/2701341866 conn(0x7f30140fec60 msgr2=0x7f3014075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.549+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 shutdown_connections 2024-08-28T20:09:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.550+0000 7f301a000640 1 -- 172.21.15.1:0/2701341866 wait complete. 2024-08-28T20:09:18.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.647+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fa9200055b0 con 0x7fa944104d40 2024-08-28T20:09:18.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.651+0000 7fa93b400640 1 -- 172.21.15.1:0/3285545696 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7fa93c016370 con 0x7fa944104d40 2024-08-28T20:09:18.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa92803f280 msgr2=0x7fa928041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa92803f280 0x7fa928041790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa934005fd0 tx=0x7fa93400b480 comp rx=0 tx=0).stop 2024-08-28T20:09:18.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa944104d40 msgr2=0x7fa94419cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:18.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa944104d40 0x7fa94419cf10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009fd0 tx=0x7fa93c00ef10 comp rx=0 tx=0).stop 2024-08-28T20:09:18.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 shutdown_connections 2024-08-28T20:09:18.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa92803f280 0x7fa928041790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa944104d40 0x7fa94419cf10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9441043a0 0x7fa94419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 --2- 172.21.15.1:0/3285545696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa944103310 0x7fa94419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:18.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.653+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 >> 172.21.15.1:0/3285545696 conn(0x7fa9440fec60 msgr2=0x7fa944075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:18.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.654+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 shutdown_connections 2024-08-28T20:09:18.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:18.654+0000 7fa943e00640 1 -- 172.21.15.1:0/3285545696 wait complete. 2024-08-28T20:09:18.733 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:18 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3285545696' entity='client.admin' 2024-08-28T20:09:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:18 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3285545696' entity='client.admin' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:19.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:18 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3285545696' entity='client.admin' 2024-08-28T20:09:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 -- 172.21.15.1:0/1053488767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8107150 msgr2=0x7f40b810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 --2- 172.21.15.1:0/1053488767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8107150 0x7f40b810daf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009ca0 tx=0x7f40b002a950 comp rx=0 tx=0).stop 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 -- 172.21.15.1:0/1053488767 shutdown_connections 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 --2- 172.21.15.1:0/1053488767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b81067b0 0x7f40b8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 --2- 172.21.15.1:0/1053488767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8107150 0x7f40b810daf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 --2- 172.21.15.1:0/1053488767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40b8105720 0x7f40b8105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 -- 172.21.15.1:0/1053488767 >> 172.21.15.1:0/1053488767 conn(0x7f40b8101090 msgr2=0x7f40b8103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 -- 172.21.15.1:0/1053488767 shutdown_connections 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.902+0000 7f40bca00640 1 -- 172.21.15.1:0/1053488767 wait complete. 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 Processor -- start 2024-08-28T20:09:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 -- start start 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 0x7f40b819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40b81067b0 0x7f40b819c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b8107150 0x7f40b819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8111260 con 0x7f40b8107150 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81110e0 con 0x7f40b8105720 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40bca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81113e0 con 0x7f40b81067b0 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 0x7f40b819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 0x7f40b819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59866/0 (socket says 172.21.15.1:59866) 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40b5e00640 1 -- 172.21.15.1:0/3665051600 learned_addr learned my addr 172.21.15.1:0/3665051600 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40ad400640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40b81067b0 0x7f40b819c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.904+0000 7f40b6800640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b8107150 0x7f40b819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40b5e00640 1 -- 172.21.15.1:0/3665051600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40b81067b0 msgr2=0x7f40b819c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40b5e00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40b81067b0 0x7f40b819c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40b5e00640 1 -- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b8107150 msgr2=0x7f40b819d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40b5e00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b8107150 0x7f40b819d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40b5e00640 1 -- 172.21.15.1:0/3665051600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b819d880 con 0x7f40b8105720 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40b5e00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 0x7f40b819be50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40a800e9f0 tx=0x7f40a800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a800cd80 con 0x7f40b8105720 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f40a80108c0 con 0x7f40b8105720 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b819db70 con 0x7f40b8105720 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a80187d0 con 0x7f40b8105720 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.905+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b81a4270 con 0x7f40b8105720 2024-08-28T20:09:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.907+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b810c900 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.907+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 51252+0+0 (secure 0 0 0) 0x7f40a8010430 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.907+0000 7f40af400640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f409c03f280 0x7f409c041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.907+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f40a8053ef0 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.908+0000 7f40ad400640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f409c03f280 0x7f409c041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.908+0000 7f40ad400640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f409c03f280 0x7f409c041790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009bd0 tx=0x7f40a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:19.912+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40a8014230 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.138+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f40b802e430 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.143+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a8055070 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.143+0000 7f40af400640 1 -- 172.21.15.1:0/3665051600 <== mon.2 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f40a8010d50 con 0x7f40b8105720 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f409c03f280 msgr2=0x7f409c041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f409c03f280 0x7f409c041790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009bd0 tx=0x7f40a0005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 msgr2=0x7f40b819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 0x7f40b819be50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40a800e9f0 tx=0x7f40a800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 shutdown_connections 2024-08-28T20:09:20.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f409c03f280 0x7f409c041790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b8107150 0x7f40b819d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40b81067b0 0x7f40b819c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 --2- 172.21.15.1:0/3665051600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40b8105720 0x7f40b819be50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 >> 172.21.15.1:0/3665051600 conn(0x7f40b8101090 msgr2=0x7f40b8109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 shutdown_connections 2024-08-28T20:09:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:20.146+0000 7f40bca00640 1 -- 172.21.15.1:0/3665051600 wait complete. 2024-08-28T20:09:20.174 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.175 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.187 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: Reconfiguring mgr.x (unknown last config time)... 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: Reconfiguring daemon mgr.x on smithi001 2024-08-28T20:09:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:20 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: Reconfiguring mgr.x (unknown last config time)... 2024-08-28T20:09:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: Reconfiguring daemon mgr.x on smithi001 2024-08-28T20:09:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:20 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:20.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: Reconfiguring mgr.x (unknown last config time)... 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: Reconfiguring daemon mgr.x on smithi001 2024-08-28T20:09:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:20 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:21.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-08-28T20:09:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:21 smithi001 ceph-mon[20984]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:21 smithi001 ceph-mon[20984]: Standby manager daemon z started 2024-08-28T20:09:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:21 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-28T20:09:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:21 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T20:09:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:21 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-28T20:09:21.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:21 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T20:09:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:21 smithi007 ceph-mon[25357]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:21 smithi007 ceph-mon[25357]: Standby manager daemon z started 2024-08-28T20:09:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:21 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-28T20:09:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:21 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T20:09:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:21 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-28T20:09:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:21 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T20:09:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:21 smithi121 ceph-mon[25248]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:21 smithi121 ceph-mon[25248]: Standby manager daemon z started 2024-08-28T20:09:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:21 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-28T20:09:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:21 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T20:09:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:21 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-28T20:09:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:21 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.121:0/4146412879' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T20:09:21.972 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi001') 2024-08-28T20:09:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:22 smithi007 ceph-mon[25357]: mgrmap e14: x(active, since 73s), standbys: z 2024-08-28T20:09:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-28T20:09:22.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:22 smithi001 ceph-mon[20984]: mgrmap e14: x(active, since 73s), standbys: z 2024-08-28T20:09:22.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-28T20:09:22.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:22 smithi121 ceph-mon[25248]: mgrmap e14: x(active, since 73s), standbys: z 2024-08-28T20:09:22.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-28T20:09:23.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.174+0000 7f5575c00640 1 -- 172.21.15.1:0/1153343779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55701067a0 msgr2=0x7f5570106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.174+0000 7f5575c00640 1 --2- 172.21.15.1:0/1153343779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55701067a0 0x7f5570106bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f555c009900 tx=0x7f555c02a480 comp rx=0 tx=0).stop 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 -- 172.21.15.1:0/1153343779 shutdown_connections 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 --2- 172.21.15.1:0/1153343779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55701067a0 0x7f5570106bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 --2- 172.21.15.1:0/1153343779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 0x7f557010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 --2- 172.21.15.1:0/1153343779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5570105710 0x7f5570105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 -- 172.21.15.1:0/1153343779 >> 172.21.15.1:0/1153343779 conn(0x7f5570101060 msgr2=0x7f5570103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 -- 172.21.15.1:0/1153343779 shutdown_connections 2024-08-28T20:09:23.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.175+0000 7f5575c00640 1 -- 172.21.15.1:0/1153343779 wait complete. 2024-08-28T20:09:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 Processor -- start 2024-08-28T20:09:23.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 -- start start 2024-08-28T20:09:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570105710 0x7f557006de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 0x7f557006e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557006ef50 0x7f557006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5570111390 con 0x7f5570105710 2024-08-28T20:09:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5570111210 con 0x7f5570107140 2024-08-28T20:09:23.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.177+0000 7f5575c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5570111510 con 0x7f557006ef50 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 0x7f557006e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 0x7f557006e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59900/0 (socket says 172.21.15.1:59900) 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556e000640 1 -- 172.21.15.1:0/4149978438 learned_addr learned my addr 172.21.15.1:0/4149978438 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556ea00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570105710 0x7f557006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556f400640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557006ef50 0x7f557006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556f400640 1 -- 172.21.15.1:0/4149978438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 msgr2=0x7f557006e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556f400640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 0x7f557006e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556f400640 1 -- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570105710 msgr2=0x7f557006de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.178+0000 7f556f400640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570105710 0x7f557006de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f556f400640 1 -- 172.21.15.1:0/4149978438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557006fc50 con 0x7f557006ef50 2024-08-28T20:09:23.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f556ea00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570105710 0x7f557006de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f556f400640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557006ef50 0x7f557006f430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5568009fd0 tx=0x7f556800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556800ce20 con 0x7f557006ef50 2024-08-28T20:09:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5568005020 con 0x7f557006ef50 2024-08-28T20:09:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568010690 con 0x7f557006ef50 2024-08-28T20:09:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.179+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5570073ff0 con 0x7f557006ef50 2024-08-28T20:09:23.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.180+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55700744b0 con 0x7f557006ef50 2024-08-28T20:09:23.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.181+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5570074770 con 0x7f557006ef50 2024-08-28T20:09:23.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.183+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 14) ==== 101886+0+0 (secure 0 0 0) 0x7f55680054d0 con 0x7f557006ef50 2024-08-28T20:09:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.184+0000 7f5567400640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5554079e90 0x7f555407c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.184+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f556809bc00 con 0x7f557006ef50 2024-08-28T20:09:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.185+0000 7f556ea00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5554079e90 0x7f555407c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.185+0000 7f556ea00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5554079e90 0x7f555407c3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5560009fc0 tx=0x7f5560005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:23.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.189+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5568064b00 con 0x7f557006ef50 2024-08-28T20:09:23.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.309+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f5568060690 con 0x7f557006ef50 2024-08-28T20:09:23.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.400+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5570074990 con 0x7f557006ef50 2024-08-28T20:09:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.406+0000 7f5567400640 1 -- 172.21.15.1:0/4149978438 <== mon.1 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7f55680b14d0 con 0x7f557006ef50 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5554079e90 msgr2=0x7f555407c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5554079e90 0x7f555407c3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5560009fc0 tx=0x7f5560005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557006ef50 msgr2=0x7f557006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557006ef50 0x7f557006f430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5568009fd0 tx=0x7f556800ef10 comp rx=0 tx=0).stop 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 shutdown_connections 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5554079e90 0x7f555407c3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557006ef50 0x7f557006f430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5570107140 0x7f557006e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 --2- 172.21.15.1:0/4149978438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570105710 0x7f557006de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 >> 172.21.15.1:0/4149978438 conn(0x7f5570101060 msgr2=0x7f55700795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 shutdown_connections 2024-08-28T20:09:23.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.408+0000 7f5575c00640 1 -- 172.21.15.1:0/4149978438 wait complete. 2024-08-28T20:09:23.431 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:23.431 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: Standby manager daemon y started 2024-08-28T20:09:23.431 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-28T20:09:23.431 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T20:09:23.431 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-28T20:09:23.431 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T20:09:23.432 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:23 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: Standby manager daemon y started 2024-08-28T20:09:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-28T20:09:23.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T20:09:23.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-28T20:09:23.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T20:09:23.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:23 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: Standby manager daemon y started 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: from='mgr.? 172.21.15.7:0/2250752551' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T20:09:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:23 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 -- 172.21.15.1:0/4257575970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c106780 msgr2=0x7fd60c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 --2- 172.21.15.1:0/4257575970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c106780 0x7fd60c106b90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009900 tx=0x7fd5f402a480 comp rx=0 tx=0).stop 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 -- 172.21.15.1:0/4257575970 shutdown_connections 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 --2- 172.21.15.1:0/4257575970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c106780 0x7fd60c106b90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 --2- 172.21.15.1:0/4257575970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd60c107120 0x7fd60c10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 --2- 172.21.15.1:0/4257575970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 -- 172.21.15.1:0/4257575970 >> 172.21.15.1:0/4257575970 conn(0x7fd60c101060 msgr2=0x7fd60c103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 -- 172.21.15.1:0/4257575970 shutdown_connections 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.869+0000 7fd612600640 1 -- 172.21.15.1:0/4257575970 wait complete. 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 Processor -- start 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 -- start start 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c19bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd60c106780 0x7fd60c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c107120 0x7fd60c19d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c111320 con 0x7fd60c107120 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1111a0 con 0x7fd60c1056f0 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.870+0000 7fd612600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1114a0 con 0x7fd60c106780 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c19bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c107120 0x7fd60c19d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c19bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59910/0 (socket says 172.21.15.1:59910) 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 -- 172.21.15.1:0/2250668500 learned_addr learned my addr 172.21.15.1:0/2250668500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd603e00640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd60c106780 0x7fd60c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 -- 172.21.15.1:0/2250668500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd60c106780 msgr2=0x7fd60c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd60c106780 0x7fd60c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 -- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c107120 msgr2=0x7fd60c19d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c107120 0x7fd60c19d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 -- 172.21.15.1:0/2250668500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c19d9a0 con 0x7fd60c1056f0 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.871+0000 7fd60b400640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c19bf70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00e9f0 tx=0x7fd5fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.872+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00cd80 con 0x7fd60c1056f0 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.872+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5fc0108e0 con 0x7fd60c1056f0 2024-08-28T20:09:23.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.872+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c19dc90 con 0x7fd60c1056f0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.872+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc018980 con 0x7fd60c1056f0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.872+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1a4390 con 0x7fd60c1056f0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.873+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c10c8b0 con 0x7fd60c1056f0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.875+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7fd5fc010430 con 0x7fd60c1056f0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.876+0000 7fd608c00640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd5f00b4b20 0x7fd5f00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.876+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd5fc0e3aa0 con 0x7fd60c1056f0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.877+0000 7fd603e00640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd5f00b4b20 0x7fd5f00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.877+0000 7fd603e00640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd5f00b4b20 0x7fd5f00b7030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4000c00 tx=0x7fd5f4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:23.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.878+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd5fc0ac1b0 con 0x7fd60c1056f0 2024-08-28T20:09:24.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.078+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd60c02e430 con 0x7fd60c1056f0 2024-08-28T20:09:24.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.084+0000 7fd608c00640 1 -- 172.21.15.1:0/2250668500 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fd5fc0b0970 con 0x7fd60c1056f0 2024-08-28T20:09:24.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd5f00b4b20 msgr2=0x7fd5f00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd5f00b4b20 0x7fd5f00b7030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4000c00 tx=0x7fd5f4031400 comp rx=0 tx=0).stop 2024-08-28T20:09:24.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 msgr2=0x7fd60c19bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c19bf70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00e9f0 tx=0x7fd5fc00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 shutdown_connections 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd5f00b4b20 0x7fd5f00b7030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd60c107120 0x7fd60c19d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd60c106780 0x7fd60c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 --2- 172.21.15.1:0/2250668500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd60c1056f0 0x7fd60c19bf70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 >> 172.21.15.1:0/2250668500 conn(0x7fd60c101060 msgr2=0x7fd60c109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 shutdown_connections 2024-08-28T20:09:24.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.087+0000 7fd612600640 1 -- 172.21.15.1:0/2250668500 wait complete. 2024-08-28T20:09:24.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 -- 172.21.15.1:0/3964784194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c104580 msgr2=0x7f028c104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 --2- 172.21.15.1:0/3964784194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c104580 0x7f028c104990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0278009900 tx=0x7f027802a480 comp rx=0 tx=0).stop 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 -- 172.21.15.1:0/3964784194 shutdown_connections 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 --2- 172.21.15.1:0/3964784194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f028c104f20 0x7f028c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 --2- 172.21.15.1:0/3964784194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c104580 0x7f028c104990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 --2- 172.21.15.1:0/3964784194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028c1034f0 0x7f028c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 -- 172.21.15.1:0/3964784194 >> 172.21.15.1:0/3964784194 conn(0x7f028c0fee80 msgr2=0x7f028c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 -- 172.21.15.1:0/3964784194 shutdown_connections 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.067+0000 7f0292e00640 1 -- 172.21.15.1:0/3964784194 wait complete. 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.068+0000 7f0292e00640 1 Processor -- start 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 -- start start 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 0x7f028c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f028c104580 0x7f028c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028c104f20 0x7f028c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f028c10f170 con 0x7f028c104580 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f028c10eff0 con 0x7f028c1034f0 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f0292e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f028c10f2f0 con 0x7f028c104f20 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f028be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 0x7f028c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f028be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 0x7f028c199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59882/0 (socket says 172.21.15.1:59882) 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f028be00640 1 -- 172.21.15.1:0/15172607 learned_addr learned my addr 172.21.15.1:0/15172607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.069+0000 7f028b400640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f028c104580 0x7f028c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f028be00640 1 -- 172.21.15.1:0/15172607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028c104f20 msgr2=0x7f028c19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f028be00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028c104f20 0x7f028c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f028be00640 1 -- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f028c104580 msgr2=0x7f028c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f028be00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f028c104580 0x7f028c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f028be00640 1 -- 172.21.15.1:0/15172607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c19b790 con 0x7f028c1034f0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f028be00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 0x7f028c199d60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e9f0 tx=0x7f027c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.070+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c00cd80 con 0x7f028c1034f0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.071+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f027c0108e0 con 0x7f028c1034f0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.071+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c018980 con 0x7f028c1034f0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.071+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028c19ba80 con 0x7f028c1034f0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.071+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028c1a2180 con 0x7f028c1034f0 2024-08-28T20:09:24.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.072+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028c10a6b0 con 0x7f028c1034f0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.074+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 14) ==== 101886+0+0 (secure 0 0 0) 0x7f027c010430 con 0x7f028c1034f0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.075+0000 7f0288c00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0270079e90 0x7f027007c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.075+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f027c09baa0 con 0x7f028c1034f0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.076+0000 7f028b400640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0270079e90 0x7f027007c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.076+0000 7f028b400640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0270079e90 0x7f027007c3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0278004770 tx=0x7f02780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.080+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f027c064390 con 0x7f028c1034f0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.290+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f028c19bcb0 con 0x7f028c1034f0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.296+0000 7f0288c00640 1 -- 172.21.15.1:0/15172607 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f027c068b50 con 0x7f028c1034f0 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.298+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0270079e90 msgr2=0x7f027007c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.298+0000 7f0292e00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0270079e90 0x7f027007c3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0278004770 tx=0x7f02780314a0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.298+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 msgr2=0x7f028c199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.298+0000 7f0292e00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 0x7f028c199d60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e9f0 tx=0x7f027c00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 shutdown_connections 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0270079e90 0x7f027007c3a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f028c104580 0x7f028c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028c104f20 0x7f028c19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 --2- 172.21.15.1:0/15172607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f028c1034f0 0x7f028c199d60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 >> 172.21.15.1:0/15172607 conn(0x7f028c0fee80 msgr2=0x7f028c107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 shutdown_connections 2024-08-28T20:09:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:23.299+0000 7f0292e00640 1 -- 172.21.15.1:0/15172607 wait complete. 2024-08-28T20:09:24.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:24 smithi001 ceph-mon[20984]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-28T20:09:24.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-28T20:09:24.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:24 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:24.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:24 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:24.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:24 smithi121 ceph-mon[25248]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-28T20:09:24.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-28T20:09:24.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:24 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:24.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:24 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:24 smithi007 ceph-mon[25357]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-28T20:09:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-28T20:09:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:24 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:24 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 -- 172.21.15.1:0/579164179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 msgr2=0x7f9d04105b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 --2- 172.21.15.1:0/579164179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d04105b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009900 tx=0x7f9cf402a480 comp rx=0 tx=0).stop 2024-08-28T20:09:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 -- 172.21.15.1:0/579164179 shutdown_connections 2024-08-28T20:09:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 --2- 172.21.15.1:0/579164179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d04107150 0x7f9d0410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 --2- 172.21.15.1:0/579164179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 0x7f9d04106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 --2- 172.21.15.1:0/579164179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d04105b90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 -- 172.21.15.1:0/579164179 >> 172.21.15.1:0/579164179 conn(0x7f9d04101090 msgr2=0x7f9d04103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 -- 172.21.15.1:0/579164179 shutdown_connections 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.470+0000 7f9d09c00640 1 -- 172.21.15.1:0/579164179 wait complete. 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.471+0000 7f9d09c00640 1 Processor -- start 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.471+0000 7f9d09c00640 1 -- start start 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d09c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d0419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d09c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 0x7f9d0419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d09c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d04107150 0x7f9d0419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d09c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04111360 con 0x7f9d04105720 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d09c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041111e0 con 0x7f9d04107150 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d09c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041114e0 con 0x7f9d041067b0 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d0419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:25.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d0419bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51040/0 (socket says 172.21.15.1:51040) 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 -- 172.21.15.1:0/642291503 learned_addr learned my addr 172.21.15.1:0/642291503 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d03400640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d04107150 0x7f9d0419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9cfbe00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 0x7f9d0419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 -- 172.21.15.1:0/642291503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 msgr2=0x7f9d0419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 0x7f9d0419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 -- 172.21.15.1:0/642291503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d04107150 msgr2=0x7f9d0419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d04107150 0x7f9d0419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9d02a00640 1 -- 172.21.15.1:0/642291503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0419d9c0 con 0x7f9d04105720 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.472+0000 7f9cfbe00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 0x7f9d0419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.473+0000 7f9d02a00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d0419bf90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4006010 tx=0x7f9cf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.473+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf403f030 con 0x7f9d04105720 2024-08-28T20:09:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.473+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cf4031910 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.473+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0419dc50 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.473+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4035070 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.473+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d041a43b0 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.474+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d04105b90 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.476+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f9cf4042030 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.478+0000 7f9cfb400640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f9ce80b4b20 0x7f9ce80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.478+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9cf4103a40 con 0x7f9d04105720 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.478+0000 7f9cfbe00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f9ce80b4b20 0x7f9ce80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.479+0000 7f9cfbe00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f9ce80b4b20 0x7f9ce80b7030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009c20 tx=0x7f9cec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.482+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9cf40cc7a0 con 0x7f9d04105720 2024-08-28T20:09:25.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.680+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f9d04063d60 con 0x7f9d04105720 2024-08-28T20:09:25.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:25 smithi001 ceph-mon[20984]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:25.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:25 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/696284850' entity='client.admin' 2024-08-28T20:09:25.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.684+0000 7f9cfb400640 1 -- 172.21.15.1:0/642291503 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f9cf40cc0a0 con 0x7f9d04105720 2024-08-28T20:09:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f9ce80b4b20 msgr2=0x7f9ce80b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f9ce80b4b20 0x7f9ce80b7030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009c20 tx=0x7f9cec005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 msgr2=0x7f9d0419bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d0419bf90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4006010 tx=0x7f9cf40042f0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 shutdown_connections 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f9ce80b4b20 0x7f9ce80b7030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d04107150 0x7f9d0419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d041067b0 0x7f9d0419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 --2- 172.21.15.1:0/642291503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d04105720 0x7f9d0419bf90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 >> 172.21.15.1:0/642291503 conn(0x7f9d04101090 msgr2=0x7f9d04109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 shutdown_connections 2024-08-28T20:09:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:25.687+0000 7f9d09c00640 1 -- 172.21.15.1:0/642291503 wait complete. 2024-08-28T20:09:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:25 smithi007 ceph-mon[25357]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:25 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/696284850' entity='client.admin' 2024-08-28T20:09:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:25 smithi121 ceph-mon[25248]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:25 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/696284850' entity='client.admin' 2024-08-28T20:09:26.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/642291503' entity='client.admin' 2024-08-28T20:09:26.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/642291503' entity='client.admin' 2024-08-28T20:09:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 -- 172.21.15.1:0/1695919031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 msgr2=0x7fe01810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 --2- 172.21.15.1:0/1695919031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01810b8c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe010009ca0 tx=0x7fe01002a950 comp rx=0 tx=0).stop 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 -- 172.21.15.1:0/1695919031 shutdown_connections 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 --2- 172.21.15.1:0/1695919031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01810b8c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 --2- 172.21.15.1:0/1695919031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe018104580 0x7fe018104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 --2- 172.21.15.1:0/1695919031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0181034f0 0x7fe018103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 -- 172.21.15.1:0/1695919031 >> 172.21.15.1:0/1695919031 conn(0x7fe0180fee60 msgr2=0x7fe018101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 -- 172.21.15.1:0/1695919031 shutdown_connections 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.312+0000 7fe020600640 1 -- 172.21.15.1:0/1695919031 wait complete. 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 Processor -- start 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 -- start start 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0181034f0 0x7fe018199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe018104580 0x7fe01819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810f130 con 0x7fe018104f20 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810efb0 con 0x7fe018104580 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.313+0000 7fe020600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810f2b0 con 0x7fe0181034f0 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01819af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51022/0 (socket says 172.21.15.1:51022) 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 -- 172.21.15.1:0/696284850 learned_addr learned my addr 172.21.15.1:0/696284850 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01d200640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe018104580 0x7fe01819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01dc00640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0181034f0 0x7fe018199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 -- 172.21.15.1:0/696284850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0181034f0 msgr2=0x7fe018199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0181034f0 0x7fe018199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 -- 172.21.15.1:0/696284850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe018104580 msgr2=0x7fe01819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe018104580 0x7fe01819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 -- 172.21.15.1:0/696284850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01819b720 con 0x7fe018104f20 2024-08-28T20:09:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.314+0000 7fe01e600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01819af00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe010006010 tx=0x7fe01002fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.315+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010034040 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.315+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0100308f0 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.315+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01819b9b0 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.315+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010039450 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.315+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0181a2110 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.316+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe018103960 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.319+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7fe010037020 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.320+0000 7fe016000640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0000b4ba0 0x7fe0000b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.321+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe0101042e0 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.321+0000 7fe01dc00640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0000b4ba0 0x7fe0000b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.322+0000 7fe01dc00640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0000b4ba0 0x7fe0000b70b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009bd0 tx=0x7fe00c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.326+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe0100cd0d0 con 0x7fe018104f20 2024-08-28T20:09:27.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.524+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fe018063d60 con 0x7fe018104f20 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.529+0000 7fe016000640 1 -- 172.21.15.1:0/696284850 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fe010030ac0 con 0x7fe018104f20 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0000b4ba0 msgr2=0x7fe0000b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0000b4ba0 0x7fe0000b70b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009bd0 tx=0x7fe00c005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 msgr2=0x7fe01819af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01819af00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe010006010 tx=0x7fe01002fc20 comp rx=0 tx=0).stop 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 shutdown_connections 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0000b4ba0 0x7fe0000b70b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe018104f20 0x7fe01819af00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe018104580 0x7fe01819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 --2- 172.21.15.1:0/696284850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0181034f0 0x7fe018199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 >> 172.21.15.1:0/696284850 conn(0x7fe0180fee60 msgr2=0x7fe0181078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 shutdown_connections 2024-08-28T20:09:27.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:24.532+0000 7fe020600640 1 -- 172.21.15.1:0/696284850 wait complete. 2024-08-28T20:09:27.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/642291503' entity='client.admin' 2024-08-28T20:09:27.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.851+0000 7f8a62a00640 1 -- 172.21.15.1:0/2623249871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c106f60 msgr2=0x7f8a5c10d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 --2- 172.21.15.1:0/2623249871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c106f60 0x7f8a5c10d900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009ca0 tx=0x7f8a5402a950 comp rx=0 tx=0).stop 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 -- 172.21.15.1:0/2623249871 shutdown_connections 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 --2- 172.21.15.1:0/2623249871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c106f60 0x7f8a5c10d900 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 --2- 172.21.15.1:0/2623249871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a5c1065c0 0x7f8a5c1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 --2- 172.21.15.1:0/2623249871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a5c105530 0x7f8a5c1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 -- 172.21.15.1:0/2623249871 >> 172.21.15.1:0/2623249871 conn(0x7f8a5c100ea0 msgr2=0x7f8a5c103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 -- 172.21.15.1:0/2623249871 shutdown_connections 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.852+0000 7f8a62a00640 1 -- 172.21.15.1:0/2623249871 wait complete. 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 Processor -- start 2024-08-28T20:09:27.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 -- start start 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 0x7f8a5c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a5c1065c0 0x7f8a5c19c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a5c106f60 0x7f8a5c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c111180 con 0x7f8a5c105530 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c111000 con 0x7f8a5c106f60 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a62a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c111300 con 0x7f8a5c1065c0 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.853+0000 7f8a61600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 0x7f8a5c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 0x7f8a5c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37288/0 (socket says 172.21.15.1:37288) 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 -- 172.21.15.1:0/947904481 learned_addr learned my addr 172.21.15.1:0/947904481 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a60c00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a5c1065c0 0x7f8a5c19c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a62000640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a5c106f60 0x7f8a5c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 -- 172.21.15.1:0/947904481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a5c1065c0 msgr2=0x7f8a5c19c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a5c1065c0 0x7f8a5c19c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 -- 172.21.15.1:0/947904481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a5c106f60 msgr2=0x7f8a5c19cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a5c106f60 0x7f8a5c19cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 -- 172.21.15.1:0/947904481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c19d770 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.854+0000 7f8a61600640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 0x7f8a5c19bd40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000d770 tx=0x7f8a5000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.855+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50017070 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.855+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a500054d0 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.855+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50004c30 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.855+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c19da60 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.855+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c1a4160 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.856+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c10c710 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.858+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f8a50004e10 con 0x7f8a5c105530 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.860+0000 7f8a5a000640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8a440b4b20 0x7f8a440b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:27.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.860+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8a500e2ea0 con 0x7f8a5c105530 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.860+0000 7f8a60c00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8a440b4b20 0x7f8a440b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.861+0000 7f8a60c00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8a440b4b20 0x7f8a440b7030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009bd0 tx=0x7f8a48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:26.864+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8a500ab5b0 con 0x7f8a5c105530 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.062+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f8a5c19dc90 con 0x7f8a5c105530 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.066+0000 7f8a5a000640 1 -- 172.21.15.1:0/947904481 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v24)=0 v24) ==== 127+0+0 (secure 0 0 0) 0x7f8a500afd70 con 0x7f8a5c105530 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8a440b4b20 msgr2=0x7f8a440b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8a440b4b20 0x7f8a440b7030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009bd0 tx=0x7f8a48005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 msgr2=0x7f8a5c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 0x7f8a5c19bd40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000d770 tx=0x7f8a5000dc30 comp rx=0 tx=0).stop 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 shutdown_connections 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8a440b4b20 0x7f8a440b7030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a5c106f60 0x7f8a5c19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a5c1065c0 0x7f8a5c19c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 --2- 172.21.15.1:0/947904481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a5c105530 0x7f8a5c19bd40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:27.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 >> 172.21.15.1:0/947904481 conn(0x7f8a5c100ea0 msgr2=0x7f8a5c1098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:27.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 shutdown_connections 2024-08-28T20:09:27.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:27.069+0000 7f8a62a00640 1 -- 172.21.15.1:0/947904481 wait complete. 2024-08-28T20:09:27.958 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:27 smithi001 ceph-mon[20984]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:27.958 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:27 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/947904481' entity='client.admin' 2024-08-28T20:09:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:27 smithi121 ceph-mon[25248]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:27 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/947904481' entity='client.admin' 2024-08-28T20:09:27.997 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:27 smithi007 ceph-mon[25357]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:27.997 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:27 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/947904481' entity='client.admin' 2024-08-28T20:09:28.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.272+0000 7f4ff1200640 1 -- 172.21.15.1:0/4189208396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 msgr2=0x7f4fec103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:28.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.272+0000 7f4ff1200640 1 --2- 172.21.15.1:0/4189208396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec103780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc02a480 comp rx=0 tx=0).stop 2024-08-28T20:09:28.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.272+0000 7f4ff1200640 1 -- 172.21.15.1:0/4189208396 shutdown_connections 2024-08-28T20:09:28.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.272+0000 7f4ff1200640 1 --2- 172.21.15.1:0/4189208396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec104d40 0x7f4fec10b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.272+0000 7f4ff1200640 1 --2- 172.21.15.1:0/4189208396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fec1043a0 0x7f4fec1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.273+0000 7f4ff1200640 1 --2- 172.21.15.1:0/4189208396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec103780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.273+0000 7f4ff1200640 1 -- 172.21.15.1:0/4189208396 >> 172.21.15.1:0/4189208396 conn(0x7f4fec0fec60 msgr2=0x7f4fec101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:28.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.273+0000 7f4ff1200640 1 -- 172.21.15.1:0/4189208396 shutdown_connections 2024-08-28T20:09:28.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.273+0000 7f4ff1200640 1 -- 172.21.15.1:0/4189208396 wait complete. 2024-08-28T20:09:28.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 Processor -- start 2024-08-28T20:09:28.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 -- start start 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec1043a0 0x7f4fec0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fec104d40 0x7f4fec0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec10efc0 con 0x7f4fec103310 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec10ee40 con 0x7f4fec1043a0 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4ff1200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec10f140 con 0x7f4fec104d40 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4feb400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4feb400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37312/0 (socket says 172.21.15.1:37312) 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4feb400640 1 -- 172.21.15.1:0/1476562007 learned_addr learned my addr 172.21.15.1:0/1476562007 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.274+0000 7f4feaa00640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec1043a0 0x7f4fec0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4febe00640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fec104d40 0x7f4fec0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feb400640 1 -- 172.21.15.1:0/1476562007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fec104d40 msgr2=0x7f4fec0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:28.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feb400640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fec104d40 0x7f4fec0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feb400640 1 -- 172.21.15.1:0/1476562007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec1043a0 msgr2=0x7f4fec0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:28.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feb400640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec1043a0 0x7f4fec0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feb400640 1 -- 172.21.15.1:0/1476562007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec0760f0 con 0x7f4fec103310 2024-08-28T20:09:28.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feaa00640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec1043a0 0x7f4fec0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:28.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.275+0000 7f4feb400640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec076be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc031440 tx=0x7f4fdc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:28.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.276+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc03f070 con 0x7f4fec103310 2024-08-28T20:09:28.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.276+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fdc031c50 con 0x7f4fec103310 2024-08-28T20:09:28.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.276+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec1a3c90 con 0x7f4fec103310 2024-08-28T20:09:28.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.276+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc035030 con 0x7f4fec103310 2024-08-28T20:09:28.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.276+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec1a4030 con 0x7f4fec103310 2024-08-28T20:09:28.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.277+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec10a4f0 con 0x7f4fec103310 2024-08-28T20:09:28.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.279+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f4fdc042070 con 0x7f4fec103310 2024-08-28T20:09:28.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.280+0000 7f4fe3e00640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4fd00b4b20 0x7f4fd00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:28.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.281+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fdc103c00 con 0x7f4fec103310 2024-08-28T20:09:28.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.281+0000 7f4feaa00640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4fd00b4b20 0x7f4fd00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:28.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.282+0000 7f4feaa00640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4fd00b4b20 0x7f4fd00b7030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009fc0 tx=0x7f4fd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:28.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.285+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4fdc0cc960 con 0x7f4fec103310 2024-08-28T20:09:28.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.490+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f4fec063dd0 con 0x7f4fec103310 2024-08-28T20:09:28.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.494+0000 7f4fe3e00640 1 -- 172.21.15.1:0/1476562007 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v25)=0 v25) ==== 125+0+0 (secure 0 0 0) 0x7f4fdc0cc260 con 0x7f4fec103310 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.496+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4fd00b4b20 msgr2=0x7f4fd00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.496+0000 7f4ff1200640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4fd00b4b20 0x7f4fd00b7030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009fc0 tx=0x7f4fd8005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.496+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 msgr2=0x7f4fec076be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.496+0000 7f4ff1200640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec076be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc031440 tx=0x7f4fdc003c10 comp rx=0 tx=0).stop 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 shutdown_connections 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4fd00b4b20 0x7f4fd00b7030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fec104d40 0x7f4fec0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fec1043a0 0x7f4fec0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 --2- 172.21.15.1:0/1476562007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fec103310 0x7f4fec076be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:28.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 >> 172.21.15.1:0/1476562007 conn(0x7f4fec0fec60 msgr2=0x7f4fec1076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:28.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 shutdown_connections 2024-08-28T20:09:28.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.497+0000 7f4ff1200640 1 -- 172.21.15.1:0/1476562007 wait complete. 2024-08-28T20:09:29.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:29 smithi001 ceph-mon[20984]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:29.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:29 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1476562007' entity='client.admin' 2024-08-28T20:09:29.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:29 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:29 smithi007 ceph-mon[25357]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:29 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1476562007' entity='client.admin' 2024-08-28T20:09:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:29 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:29.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:29 smithi121 ceph-mon[25248]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:29.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:29 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1476562007' entity='client.admin' 2024-08-28T20:09:29.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:29 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 -- 172.21.15.1:0/4280864855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 msgr2=0x7fe10c10b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 --2- 172.21.15.1:0/4280864855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c10b720 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe104009ca0 tx=0x7fe10402a950 comp rx=0 tx=0).stop 2024-08-28T20:09:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 -- 172.21.15.1:0/4280864855 shutdown_connections 2024-08-28T20:09:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 --2- 172.21.15.1:0/4280864855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c10b720 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 --2- 172.21.15.1:0/4280864855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c1043e0 0x7fe10c1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 --2- 172.21.15.1:0/4280864855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c103350 0x7fe10c1037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.709+0000 7fe112e00640 1 -- 172.21.15.1:0/4280864855 >> 172.21.15.1:0/4280864855 conn(0x7fe10c0fecc0 msgr2=0x7fe10c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.710+0000 7fe112e00640 1 -- 172.21.15.1:0/4280864855 shutdown_connections 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.710+0000 7fe112e00640 1 -- 172.21.15.1:0/4280864855 wait complete. 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 Processor -- start 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 -- start start 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 0x7fe10c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c1043e0 0x7fe10c19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c10efb0 con 0x7fe10c104d80 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c10ee30 con 0x7fe10c1043e0 2024-08-28T20:09:30.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c10f130 con 0x7fe10c103350 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.711+0000 7fe112400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 0x7fe10c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c1043e0 0x7fe10c19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 0x7fe10c19bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:48902/0 (socket says 172.21.15.1:48902) 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe112400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c19cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37348/0 (socket says 172.21.15.1:37348) 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 -- 172.21.15.1:0/4275267618 learned_addr learned my addr 172.21.15.1:0/4275267618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c1043e0 0x7fe10c19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52576/0 (socket says 172.21.15.1:52576) 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 -- 172.21.15.1:0/4275267618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c1043e0 msgr2=0x7fe10c19c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c1043e0 0x7fe10c19c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 -- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 msgr2=0x7fe10c19cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c19cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 -- 172.21.15.1:0/4275267618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c19d770 con 0x7fe10c103350 2024-08-28T20:09:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe112400640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.712+0000 7fe111a00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 0x7fe10c19bdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe10000ea60 tx=0x7fe10000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.713+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10000cde0 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.713+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1000035f0 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.713+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c19da60 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.713+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100010690 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.713+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1a4160 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.714+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c1037c0 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.716+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7fe1000037a0 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.717+0000 7fe10a000640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0f40b4ba0 0x7fe0f40b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.717+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe1000e3760 con 0x7fe10c103350 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.718+0000 7fe111000640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0f40b4ba0 0x7fe0f40b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.718+0000 7fe111000640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0f40b4ba0 0x7fe0f40b70b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80095f0 tx=0x7fe0f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.721+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe1000ac4c0 con 0x7fe10c103350 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.929+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fe10c1a4330 con 0x7fe10c103350 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.935+0000 7fe10a000640 1 -- 172.21.15.1:0/4275267618 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7fe1000abdc0 con 0x7fe10c103350 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0f40b4ba0 msgr2=0x7fe0f40b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0f40b4ba0 0x7fe0f40b70b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80095f0 tx=0x7fe0f8005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 msgr2=0x7fe10c19bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 0x7fe10c19bdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe10000ea60 tx=0x7fe10000ef20 comp rx=0 tx=0).stop 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 shutdown_connections 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0f40b4ba0 0x7fe0f40b70b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe10c104d80 0x7fe10c19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe10c1043e0 0x7fe10c19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 --2- 172.21.15.1:0/4275267618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c103350 0x7fe10c19bdb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 >> 172.21.15.1:0/4275267618 conn(0x7fe10c0fecc0 msgr2=0x7fe10c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:30.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 shutdown_connections 2024-08-28T20:09:30.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:29.938+0000 7fe112e00640 1 -- 172.21.15.1:0/4275267618 wait complete. 2024-08-28T20:09:30.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 -- 172.21.15.1:0/1058642699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 msgr2=0x7ffaec10d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1058642699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 0x7ffaec10d900 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009ca0 tx=0x7ffae402a950 comp rx=0 tx=0).stop 2024-08-28T20:09:30.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 -- 172.21.15.1:0/1058642699 shutdown_connections 2024-08-28T20:09:30.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1058642699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1058642699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 0x7ffaec10d900 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1058642699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 0x7ffaec1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 -- 172.21.15.1:0/1058642699 >> 172.21.15.1:0/1058642699 conn(0x7ffaec100ea0 msgr2=0x7ffaec103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:30.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.543+0000 7ffaf2400640 1 -- 172.21.15.1:0/1058642699 shutdown_connections 2024-08-28T20:09:30.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.544+0000 7ffaf2400640 1 -- 172.21.15.1:0/1058642699 wait complete. 2024-08-28T20:09:30.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.544+0000 7ffaf2400640 1 Processor -- start 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 -- start start 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 0x7ffaec19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 0x7ffaec19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1111b0 con 0x7ffaec1065c0 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec111030 con 0x7ffaec105530 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf2400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec111330 con 0x7ffaec106f60 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaebe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaebe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec19c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37356/0 (socket says 172.21.15.1:37356) 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaebe00640 1 -- 172.21.15.1:0/1957880723 learned_addr learned my addr 172.21.15.1:0/1957880723 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf1000640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 0x7ffaec19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.545+0000 7ffaf1a00640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 0x7ffaec19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaebe00640 1 -- 172.21.15.1:0/1957880723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 msgr2=0x7ffaec19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaebe00640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 0x7ffaec19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaebe00640 1 -- 172.21.15.1:0/1957880723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 msgr2=0x7ffaec19bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaebe00640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 0x7ffaec19bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaebe00640 1 -- 172.21.15.1:0/1957880723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec19d760 con 0x7ffaec1065c0 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaf1000640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 0x7ffaec19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffaebe00640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec19c410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffad800e9f0 tx=0x7ffad800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad800cd80 con 0x7ffaec1065c0 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffad80108e0 con 0x7ffaec1065c0 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.546+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8018980 con 0x7ffaec1065c0 2024-08-28T20:09:30.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.547+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec19da50 con 0x7ffaec1065c0 2024-08-28T20:09:30.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.547+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec1a4150 con 0x7ffaec1065c0 2024-08-28T20:09:30.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.548+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaec10c710 con 0x7ffaec1065c0 2024-08-28T20:09:30.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.550+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7ffad8010430 con 0x7ffaec1065c0 2024-08-28T20:09:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.551+0000 7ffae9600640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffad40b4b20 0x7ffad40b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.552+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffad80e3750 con 0x7ffaec1065c0 2024-08-28T20:09:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.552+0000 7ffaf1000640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffad40b4b20 0x7ffad40b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.553+0000 7ffaf1000640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffad40b4b20 0x7ffad40b7030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009fc0 tx=0x7ffae0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:30.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.556+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffad80abe60 con 0x7ffaec1065c0 2024-08-28T20:09:30.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.755+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ffaec19dc80 con 0x7ffaec1065c0 2024-08-28T20:09:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.760+0000 7ffae9600640 1 -- 172.21.15.1:0/1957880723 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7ffad80b0620 con 0x7ffaec1065c0 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.762+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffad40b4b20 msgr2=0x7ffad40b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.762+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffad40b4b20 0x7ffad40b7030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009fc0 tx=0x7ffae0005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 msgr2=0x7ffaec19c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec19c410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffad800e9f0 tx=0x7ffad800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 shutdown_connections 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffad40b4b20 0x7ffad40b7030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaec1065c0 0x7ffaec19c410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaec106f60 0x7ffaec19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 --2- 172.21.15.1:0/1957880723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaec105530 0x7ffaec19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:30.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 >> 172.21.15.1:0/1957880723 conn(0x7ffaec100ea0 msgr2=0x7ffaec1098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:30.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 shutdown_connections 2024-08-28T20:09:30.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:30.763+0000 7ffaf2400640 1 -- 172.21.15.1:0/1957880723 wait complete. 2024-08-28T20:09:30.793 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:30.836 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi001') 2024-08-28T20:09:30.836 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi001') 2024-08-28T20:09:30.836 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi001') 2024-08-28T20:09:30.836 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi001') 2024-08-28T20:09:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.774+0000 7f5d82800640 1 -- 172.21.15.1:0/1627435289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c1056f0 msgr2=0x7f5d7c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.774+0000 7f5d82800640 1 --2- 172.21.15.1:0/1627435289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c1056f0 0x7f5d7c105b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009860 tx=0x7f5d6c02a3d0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 -- 172.21.15.1:0/1627435289 shutdown_connections 2024-08-28T20:09:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 --2- 172.21.15.1:0/1627435289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d7c107120 0x7f5d7c10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 --2- 172.21.15.1:0/1627435289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c106780 0x7f5d7c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 --2- 172.21.15.1:0/1627435289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c1056f0 0x7f5d7c105b60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 -- 172.21.15.1:0/1627435289 >> 172.21.15.1:0/1627435289 conn(0x7f5d7c101060 msgr2=0x7f5d7c103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 -- 172.21.15.1:0/1627435289 shutdown_connections 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.775+0000 7f5d82800640 1 -- 172.21.15.1:0/1627435289 wait complete. 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.776+0000 7f5d82800640 1 Processor -- start 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.776+0000 7f5d82800640 1 -- start start 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d82800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d7c1056f0 0x7f5d7c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d82800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c106780 0x7f5d7c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 0x7f5d7c19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d82800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c111380 con 0x7f5d7c106780 2024-08-28T20:09:31.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d82800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c111200 con 0x7f5d7c107120 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d82800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c111500 con 0x7f5d7c1056f0 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 0x7f5d7c19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 0x7f5d7c19d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52564/0 (socket says 172.21.15.1:52564) 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d7be00640 1 -- 172.21.15.1:0/779064294 learned_addr learned my addr 172.21.15.1:0/779064294 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d7aa00640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c106780 0x7f5d7c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.777+0000 7f5d7b400640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d7c1056f0 0x7f5d7c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d7be00640 1 -- 172.21.15.1:0/779064294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d7c1056f0 msgr2=0x7f5d7c19bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d7be00640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d7c1056f0 0x7f5d7c19bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d7be00640 1 -- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c106780 msgr2=0x7f5d7c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d7be00640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c106780 0x7f5d7c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d7be00640 1 -- 172.21.15.1:0/779064294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c19d970 con 0x7f5d7c107120 2024-08-28T20:09:31.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d7be00640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 0x7f5d7c19d150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400eb10 tx=0x7f5d7400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74004b20 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d74004cc0 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c19dc60 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74010670 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.778+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c1a4360 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.779+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c10c8d0 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.781+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f5d74005020 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.783+0000 7f5d73e00640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5d600b4aa0 0x7f5d600b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.783+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5d740e3a50 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.783+0000 7f5d7b400640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5d600b4aa0 0x7f5d600b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.784+0000 7f5d7b400640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5d600b4aa0 0x7f5d600b6fb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c02a9c0 tx=0x7f5d6c030980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.787+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5d740ac7b0 con 0x7f5d7c107120 2024-08-28T20:09:31.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.985+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f5d7c02e430 con 0x7f5d7c107120 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.991+0000 7f5d73e00640 1 -- 172.21.15.1:0/779064294 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v26)=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f5d740ac0b0 con 0x7f5d7c107120 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5d600b4aa0 msgr2=0x7f5d600b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5d600b4aa0 0x7f5d600b6fb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c02a9c0 tx=0x7f5d6c030980 comp rx=0 tx=0).stop 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 msgr2=0x7f5d7c19d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 0x7f5d7c19d150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400eb10 tx=0x7f5d7400c2d0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 shutdown_connections 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5d600b4aa0 0x7f5d600b6fb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d7c106780 0x7f5d7c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d7c107120 0x7f5d7c19d150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 --2- 172.21.15.1:0/779064294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d7c1056f0 0x7f5d7c19bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 >> 172.21.15.1:0/779064294 conn(0x7f5d7c101060 msgr2=0x7f5d7c109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 shutdown_connections 2024-08-28T20:09:31.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:28.994+0000 7f5d82800640 1 -- 172.21.15.1:0/779064294 wait complete. 2024-08-28T20:09:31.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:30 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:31.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:30 smithi001 ceph-mon[20984]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:31.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:30 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1957880723' entity='client.admin' 2024-08-28T20:09:31.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:30 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:31.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:30 smithi121 ceph-mon[25248]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:31.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:30 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1957880723' entity='client.admin' 2024-08-28T20:09:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:31.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:30 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:31.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:30 smithi007 ceph-mon[25357]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:31.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:30 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1957880723' entity='client.admin' 2024-08-28T20:09:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 -- 172.21.15.1:0/2150078322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104f20 msgr2=0x7f2d1410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/2150078322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104f20 0x7f2d1410b8c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009ca0 tx=0x7f2d0c02a950 comp rx=0 tx=0).stop 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 -- 172.21.15.1:0/2150078322 shutdown_connections 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/2150078322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104f20 0x7f2d1410b8c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/2150078322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d14104580 0x7f2d14104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/2150078322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d141034f0 0x7f2d14103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 -- 172.21.15.1:0/2150078322 >> 172.21.15.1:0/2150078322 conn(0x7f2d140fee60 msgr2=0x7f2d14101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 -- 172.21.15.1:0/2150078322 shutdown_connections 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.398+0000 7f2d1bc00640 1 -- 172.21.15.1:0/2150078322 wait complete. 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.399+0000 7f2d1bc00640 1 Processor -- start 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 -- start start 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d141034f0 0x7f2d1419bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 0x7f2d1419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d14104f20 0x7f2d1419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1410f190 con 0x7f2d14104580 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1410f010 con 0x7f2d14104f20 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d1bc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1410f310 con 0x7f2d141034f0 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d13e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 0x7f2d1419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d13e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 0x7f2d1419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37374/0 (socket says 172.21.15.1:37374) 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d13e00640 1 -- 172.21.15.1:0/1645397565 learned_addr learned my addr 172.21.15.1:0/1645397565 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d19200640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d141034f0 0x7f2d1419bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.400+0000 7f2d19c00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d14104f20 0x7f2d1419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d13e00640 1 -- 172.21.15.1:0/1645397565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d141034f0 msgr2=0x7f2d1419bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d13e00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d141034f0 0x7f2d1419bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d13e00640 1 -- 172.21.15.1:0/1645397565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d14104f20 msgr2=0x7f2d1419d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d13e00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d14104f20 0x7f2d1419d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d13e00640 1 -- 172.21.15.1:0/1645397565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1419d970 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d13e00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 0x7f2d1419c5b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000e9f0 tx=0x7f2d0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000cd80 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d000054d0 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00010690 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1419dc60 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.401+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d141a4360 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.403+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d141a4530 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.405+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f2d00004e90 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.408+0000 7f2d11600640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2cfc0b4b20 0x7f2cfc0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.408+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2d000e3840 con 0x7f2d14104580 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.408+0000 7f2d19200640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2cfc0b4b20 0x7f2cfc0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.409+0000 7f2d19200640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2cfc0b4b20 0x7f2cfc0b7030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009bd0 tx=0x7f2d08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.409+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2d000ac5a0 con 0x7f2d14104580 2024-08-28T20:09:32.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.609+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f2d141a4700 con 0x7f2d14104580 2024-08-28T20:09:32.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.613+0000 7f2d11600640 1 -- 172.21.15.1:0/1645397565 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f2d000abea0 con 0x7f2d14104580 2024-08-28T20:09:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2cfc0b4b20 msgr2=0x7f2cfc0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2cfc0b4b20 0x7f2cfc0b7030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009bd0 tx=0x7f2d08005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 msgr2=0x7f2d1419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 0x7f2d1419c5b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000e9f0 tx=0x7f2d0000edf0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 shutdown_connections 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2cfc0b4b20 0x7f2cfc0b7030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d14104580 0x7f2d1419c5b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d14104f20 0x7f2d1419d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 --2- 172.21.15.1:0/1645397565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d141034f0 0x7f2d1419bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 >> 172.21.15.1:0/1645397565 conn(0x7f2d140fee60 msgr2=0x7f2d14075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 shutdown_connections 2024-08-28T20:09:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:32.616+0000 7f2d1bc00640 1 -- 172.21.15.1:0/1645397565 wait complete. 2024-08-28T20:09:33.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:33 smithi001 ceph-mon[20984]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:33.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:33 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1645397565' entity='client.admin' 2024-08-28T20:09:33.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:33 smithi121 ceph-mon[25248]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:33.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:33 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1645397565' entity='client.admin' 2024-08-28T20:09:34.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:33 smithi007 ceph-mon[25357]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:34.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:33 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1645397565' entity='client.admin' 2024-08-28T20:09:34.233 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi001') 2024-08-28T20:09:34.233 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi001') 2024-08-28T20:09:35.525 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi001') 2024-08-28T20:09:35.525 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi001') 2024-08-28T20:09:35.525 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi001') 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:35.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:35.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:35.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:09:35.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:35.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:09:35.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:09:36.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 -- 172.21.15.1:0/548236269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308075a30 msgr2=0x7f0308075e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:36.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 --2- 172.21.15.1:0/548236269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308075a30 0x7f0308075e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009900 tx=0x7f02f002a410 comp rx=0 tx=0).stop 2024-08-28T20:09:36.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 -- 172.21.15.1:0/548236269 shutdown_connections 2024-08-28T20:09:36.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 --2- 172.21.15.1:0/548236269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308075a30 0x7f0308075e40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 --2- 172.21.15.1:0/548236269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f030810b4f0 0x7f030810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 --2- 172.21.15.1:0/548236269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0308076e20 0x7f03080754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 -- 172.21.15.1:0/548236269 >> 172.21.15.1:0/548236269 conn(0x7f03080fee60 msgr2=0x7f0308101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:36.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 -- 172.21.15.1:0/548236269 shutdown_connections 2024-08-28T20:09:36.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.121+0000 7f030ea00640 1 -- 172.21.15.1:0/548236269 wait complete. 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 Processor -- start 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 -- start start 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0308075a30 0x7f030819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 0x7f030819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030810b4f0 0x7f030819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0308111360 con 0x7f0308076e20 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03081111e0 con 0x7f030810b4f0 2024-08-28T20:09:36.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.122+0000 7f030ea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f03081114e0 con 0x7f0308075a30 2024-08-28T20:09:36.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 0x7f030819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:36.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 0x7f030819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37400/0 (socket says 172.21.15.1:37400) 2024-08-28T20:09:36.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 -- 172.21.15.1:0/3914695534 learned_addr learned my addr 172.21.15.1:0/3914695534 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:36.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f0307e00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0308075a30 0x7f030819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:36.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f030ca00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030810b4f0 0x7f030819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 -- 172.21.15.1:0/3914695534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0308075a30 msgr2=0x7f030819bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0308075a30 0x7f030819bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 -- 172.21.15.1:0/3914695534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030810b4f0 msgr2=0x7f030819d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030810b4f0 0x7f030819d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f02ff400640 1 -- 172.21.15.1:0/3914695534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030819d9c0 con 0x7f0308076e20 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.123+0000 7f0307e00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0308075a30 0x7f030819bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.124+0000 7f02ff400640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 0x7f030819c600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02f0031440 tx=0x7f02f0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.124+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f003f070 con 0x7f0308076e20 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.124+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02f0031c50 con 0x7f0308076e20 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.124+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0035030 con 0x7f0308076e20 2024-08-28T20:09:36.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.124+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030819dc50 con 0x7f0308076e20 2024-08-28T20:09:36.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.124+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03081a41e0 con 0x7f0308076e20 2024-08-28T20:09:36.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.125+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030810a300 con 0x7f0308076e20 2024-08-28T20:09:36.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.129+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f02f0042070 con 0x7f0308076e20 2024-08-28T20:09:36.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.131+0000 7f0305600640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02ec0b4aa0 0x7f02ec0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:36.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.131+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f02f0103ff0 con 0x7f0308076e20 2024-08-28T20:09:36.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.131+0000 7f0307e00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02ec0b4aa0 0x7f02ec0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:36.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.132+0000 7f0307e00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02ec0b4aa0 0x7f02ec0b6fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009fc0 tx=0x7f02f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:36.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.133+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02f00ccd50 con 0x7f0308076e20 2024-08-28T20:09:36.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.329+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f030802e430 con 0x7f0308076e20 2024-08-28T20:09:36.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.333+0000 7f0305600640 1 -- 172.21.15.1:0/3914695534 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7f02f00cc650 con 0x7f0308076e20 2024-08-28T20:09:36.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02ec0b4aa0 msgr2=0x7f02ec0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:36.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02ec0b4aa0 0x7f02ec0b6fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009fc0 tx=0x7f02f8005f90 comp rx=0 tx=0).stop 2024-08-28T20:09:36.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 msgr2=0x7f030819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:36.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 0x7f030819c600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02f0031440 tx=0x7f02f0003c10 comp rx=0 tx=0).stop 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 shutdown_connections 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02ec0b4aa0 0x7f02ec0b6fb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0308076e20 0x7f030819c600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f030810b4f0 0x7f030819d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 --2- 172.21.15.1:0/3914695534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0308075a30 0x7f030819bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 >> 172.21.15.1:0/3914695534 conn(0x7f03080fee60 msgr2=0x7f03081074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 shutdown_connections 2024-08-28T20:09:36.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:36.336+0000 7f030ea00640 1 -- 172.21.15.1:0/3914695534 wait complete. 2024-08-28T20:09:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:37 smithi001 ceph-mon[20984]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:37 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3914695534' entity='client.admin' 2024-08-28T20:09:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:37 smithi121 ceph-mon[25248]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:37 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3914695534' entity='client.admin' 2024-08-28T20:09:37.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:37 smithi007 ceph-mon[25357]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:37.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:37 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3914695534' entity='client.admin' 2024-08-28T20:09:38.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 -- 172.21.15.1:0/3667077460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a01065c0 msgr2=0x7f93a01069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 --2- 172.21.15.1:0/3667077460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a01065c0 0x7f93a01069d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9388009900 tx=0x7f938802a480 comp rx=0 tx=0).stop 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 -- 172.21.15.1:0/3667077460 shutdown_connections 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 --2- 172.21.15.1:0/3667077460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93a0106f60 0x7f93a010d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 --2- 172.21.15.1:0/3667077460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a01065c0 0x7f93a01069d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 --2- 172.21.15.1:0/3667077460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93a0105530 0x7f93a01059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 -- 172.21.15.1:0/3667077460 >> 172.21.15.1:0/3667077460 conn(0x7f93a0100ea0 msgr2=0x7f93a0103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 -- 172.21.15.1:0/3667077460 shutdown_connections 2024-08-28T20:09:38.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.005+0000 7f939fe00640 1 -- 172.21.15.1:0/3667077460 wait complete. 2024-08-28T20:09:38.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 Processor -- start 2024-08-28T20:09:38.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 -- start start 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 0x7f93a019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93a01065c0 0x7f93a019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93a0106f60 0x7f93a019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01111d0 con 0x7f93a01065c0 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f93a0111050 con 0x7f93a0106f60 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.006+0000 7f939fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f93a0111350 con 0x7f93a0105530 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 0x7f93a019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f9396000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93a01065c0 0x7f93a019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 0x7f93a019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35760/0 (socket says 172.21.15.1:35760) 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 -- 172.21.15.1:0/3409686310 learned_addr learned my addr 172.21.15.1:0/3409686310 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:38.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939f400640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93a0106f60 0x7f93a019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:38.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 -- 172.21.15.1:0/3409686310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93a0106f60 msgr2=0x7f93a019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:38.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93a0106f60 0x7f93a019cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 -- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93a01065c0 msgr2=0x7f93a019c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:38.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93a01065c0 0x7f93a019c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 -- 172.21.15.1:0/3409686310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a019d7e0 con 0x7f93a0105530 2024-08-28T20:09:38.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.007+0000 7f939ea00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 0x7f93a019be20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f939000e9f0 tx=0x7f939000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:38.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.008+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939000cd80 con 0x7f93a0105530 2024-08-28T20:09:38.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.008+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93900108e0 con 0x7f93a0105530 2024-08-28T20:09:38.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.008+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390018980 con 0x7f93a0105530 2024-08-28T20:09:38.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.008+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a019dad0 con 0x7f93a0105530 2024-08-28T20:09:38.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.008+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a01a41d0 con 0x7f93a0105530 2024-08-28T20:09:38.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.009+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a01059a0 con 0x7f93a0105530 2024-08-28T20:09:38.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.011+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f9390010430 con 0x7f93a0105530 2024-08-28T20:09:38.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.013+0000 7f9397e00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93840b4ba0 0x7f93840b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:38.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.013+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f93900e3750 con 0x7f93a0105530 2024-08-28T20:09:38.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.013+0000 7f9396000640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93840b4ba0 0x7f93840b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:38.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.014+0000 7f9396000640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93840b4ba0 0x7f93840b70b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9388004770 tx=0x7f93880314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.017+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f93900abe60 con 0x7f93a0105530 2024-08-28T20:09:38.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.211+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f93a002e430 con 0x7f93a0105530 2024-08-28T20:09:38.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.217+0000 7f9397e00640 1 -- 172.21.15.1:0/3409686310 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f93900b0620 con 0x7f93a0105530 2024-08-28T20:09:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93840b4ba0 msgr2=0x7f93840b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93840b4ba0 0x7f93840b70b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9388004770 tx=0x7f93880314a0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 msgr2=0x7f93a019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 0x7f93a019be20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f939000e9f0 tx=0x7f939000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 shutdown_connections 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93840b4ba0 0x7f93840b70b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93a01065c0 0x7f93a019c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93a0106f60 0x7f93a019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 --2- 172.21.15.1:0/3409686310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93a0105530 0x7f93a019be20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 >> 172.21.15.1:0/3409686310 conn(0x7f93a0100ea0 msgr2=0x7f93a01098c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 shutdown_connections 2024-08-28T20:09:38.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:38.220+0000 7f939fe00640 1 -- 172.21.15.1:0/3409686310 wait complete. 2024-08-28T20:09:39.088 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.088 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.088 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.088 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.088 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.089 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.089 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f9e93946-6578-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi001') 2024-08-28T20:09:39.089 INFO:tasks.cephadm:Deploying OSDs... 2024-08-28T20:09:39.089 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:09:39.089 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-08-28T20:09:39.126 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-28T20:09:39.126 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-08-28 20:08:25.346783882 +0000 2024-08-28T20:09:39.201 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-08-28 20:02:41.741627770 +0000 2024-08-28T20:09:39.202 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-08-28 20:02:41.741627770 +0000 2024-08-28T20:09:39.202 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-08-28 20:02:41.741627770 +0000 2024-08-28T20:09:39.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-28T20:09:39.289 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:39 smithi001 ceph-mon[20984]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:39.290 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:39 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' 2024-08-28T20:09:39.296 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-08-28T20:09:39.296 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-08-28T20:09:39.296 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000174608 s, 2.9 MB/s 2024-08-28T20:09:39.299 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-28T20:09:39.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:39 smithi007 ceph-mon[25357]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:39.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:39 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' 2024-08-28T20:09:39.336 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-08-28 20:08:25.390783328 +0000 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-08-28 20:02:42.203621933 +0000 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-08-28 20:02:42.203621933 +0000 2024-08-28T20:09:39.412 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-08-28 20:02:42.203621933 +0000 2024-08-28T20:09:39.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-28T20:09:39.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:39 smithi121 ceph-mon[25248]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:39.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:39 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' 2024-08-28T20:09:39.504 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-08-28T20:09:39.504 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-08-28T20:09:39.504 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000165074 s, 3.1 MB/s 2024-08-28T20:09:39.506 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-28T20:09:39.543 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-08-28T20:09:39.619 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-28T20:09:39.619 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:39.619 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-28T20:09:39.619 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:39.620 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:39.620 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-08-28 20:08:25.434782773 +0000 2024-08-28T20:09:39.620 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-08-28 20:02:42.791614505 +0000 2024-08-28T20:09:39.620 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-08-28 20:02:42.791614505 +0000 2024-08-28T20:09:39.620 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-08-28 20:02:42.791614505 +0000 2024-08-28T20:09:39.620 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-28T20:09:39.712 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-08-28T20:09:39.713 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-08-28T20:09:39.713 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000196737 s, 2.6 MB/s 2024-08-28T20:09:39.716 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-28T20:09:39.752 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-08-28 20:08:25.477782232 +0000 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-08-28 20:02:43.263608543 +0000 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-08-28 20:02:43.263608543 +0000 2024-08-28T20:09:39.828 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-08-28 20:02:43.263608543 +0000 2024-08-28T20:09:39.828 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-28T20:09:39.921 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-08-28T20:09:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-08-28T20:09:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000181733 s, 2.8 MB/s 2024-08-28T20:09:39.924 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-28T20:09:39.960 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-08-28T20:09:39.961 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-08-28T20:09:39.980 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-28T20:09:39.980 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-28 20:09:17.343353124 +0000 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-28 20:03:03.352290766 +0000 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-28 20:03:03.352290766 +0000 2024-08-28T20:09:40.039 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-28 20:03:03.352290766 +0000 2024-08-28T20:09:40.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-28T20:09:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-28T20:09:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-28T20:09:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.00012435 s, 4.1 MB/s 2024-08-28T20:09:40.110 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-28T20:09:40.169 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-28 20:09:17.343353124 +0000 2024-08-28T20:09:40.226 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-28 20:03:03.674285570 +0000 2024-08-28T20:09:40.227 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-28 20:03:03.674285570 +0000 2024-08-28T20:09:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-28 20:03:03.674285570 +0000 2024-08-28T20:09:40.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-28T20:09:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-28T20:09:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-28T20:09:40.292 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000116413 s, 4.4 MB/s 2024-08-28T20:09:40.293 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-28T20:09:40.350 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-28 20:09:17.343353124 +0000 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-28 20:03:03.986280536 +0000 2024-08-28T20:09:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-28 20:03:03.986280536 +0000 2024-08-28T20:09:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-28 20:03:03.986280536 +0000 2024-08-28T20:09:40.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-28T20:09:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-28T20:09:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-28T20:09:40.470 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000107177 s, 4.8 MB/s 2024-08-28T20:09:40.471 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-28T20:09:40.528 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-08-28T20:09:40.583 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-28T20:09:40.583 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:40.583 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-28T20:09:40.584 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:40.584 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:40.584 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-08-28 20:09:17.344353109 +0000 2024-08-28T20:09:40.584 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-08-28 20:03:04.312275276 +0000 2024-08-28T20:09:40.584 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-08-28 20:03:04.312275276 +0000 2024-08-28T20:09:40.584 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-08-28 20:03:04.312275276 +0000 2024-08-28T20:09:40.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-28T20:09:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-08-28T20:09:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-08-28T20:09:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000107088 s, 4.8 MB/s 2024-08-28T20:09:40.649 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-28T20:09:40.705 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-28T20:09:40.705 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-08-28T20:09:40.726 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-28T20:09:40.726 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-08-28T20:09:40.784 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-28 20:09:15.052476600 +0000 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-28 20:03:03.104028528 +0000 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-28 20:03:03.104028528 +0000 2024-08-28T20:09:40.785 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-28 20:03:03.104028528 +0000 2024-08-28T20:09:40.785 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-28T20:09:40.854 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-28T20:09:40.854 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-28T20:09:40.854 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000352424 s, 1.5 MB/s 2024-08-28T20:09:40.856 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-28T20:09:40.914 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-08-28T20:09:40.971 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-28T20:09:40.971 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:40.971 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-28T20:09:40.971 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:40.972 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:40.972 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-28 20:09:15.052476600 +0000 2024-08-28T20:09:40.972 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-28 20:03:03.422023924 +0000 2024-08-28T20:09:40.972 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-28 20:03:03.422023924 +0000 2024-08-28T20:09:40.972 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-28 20:03:03.422023924 +0000 2024-08-28T20:09:40.972 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-28T20:09:41.036 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-28T20:09:41.036 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-28T20:09:41.037 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000197984 s, 2.6 MB/s 2024-08-28T20:09:41.038 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-28T20:09:41.095 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-28 20:09:15.053476585 +0000 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-28 20:03:03.755019104 +0000 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-28 20:03:03.755019104 +0000 2024-08-28T20:09:41.152 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-28 20:03:03.755019104 +0000 2024-08-28T20:09:41.153 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-28T20:09:41.216 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-28T20:09:41.217 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-28T20:09:41.217 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000209903 s, 2.4 MB/s 2024-08-28T20:09:41.218 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-28T20:09:41.275 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-08-28T20:09:41.312 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:41 smithi001 ceph-mon[20984]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:41.331 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-28T20:09:41.331 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T20:09:41.331 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-28T20:09:41.331 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T20:09:41.331 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T20:09:41.332 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-28 20:09:15.053476585 +0000 2024-08-28T20:09:41.332 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-28 20:03:04.091014239 +0000 2024-08-28T20:09:41.332 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-28 20:03:04.091014239 +0000 2024-08-28T20:09:41.332 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-28 20:03:04.091014239 +0000 2024-08-28T20:09:41.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-28T20:09:41.395 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-28T20:09:41.395 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-28T20:09:41.395 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000206978 s, 2.5 MB/s 2024-08-28T20:09:41.397 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-28T20:09:41.452 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-08-28T20:09:41.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-28T20:09:41.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:41 smithi121 ceph-mon[25248]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:41.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:41 smithi007 ceph-mon[25357]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:43.459 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:43 smithi001 ceph-mon[20984]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:43.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:43 smithi121 ceph-mon[25248]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:43.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:43 smithi007 ceph-mon[25357]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:44.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:09:44.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-08-28T20:09:45.253 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:09:45.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:45 smithi121 ceph-mon[25248]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:45 smithi007 ceph-mon[25357]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:45.654 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:45 smithi001 ceph-mon[20984]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 -- 172.21.15.1:0/2883346214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 msgr2=0x7f01e8104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 --2- 172.21.15.1:0/2883346214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e8104990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009900 tx=0x7f01d402a480 comp rx=0 tx=0).stop 2024-08-28T20:09:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 -- 172.21.15.1:0/2883346214 shutdown_connections 2024-08-28T20:09:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 --2- 172.21.15.1:0/2883346214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e8104990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 --2- 172.21.15.1:0/2883346214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 0x7f01e810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 --2- 172.21.15.1:0/2883346214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e8103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.000+0000 7f01ece00640 1 -- 172.21.15.1:0/2883346214 >> 172.21.15.1:0/2883346214 conn(0x7f01e80fee60 msgr2=0x7f01e8101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.001+0000 7f01ece00640 1 -- 172.21.15.1:0/2883346214 shutdown_connections 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.001+0000 7f01ece00640 1 -- 172.21.15.1:0/2883346214 wait complete. 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.002+0000 7f01ece00640 1 Processor -- start 2024-08-28T20:09:46.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.002+0000 7f01ece00640 1 -- start start 2024-08-28T20:09:46.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01ece00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01ece00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01ece00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 0x7f01e819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01ece00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f01e810f130 con 0x7f01e8104580 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01ece00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01e810efb0 con 0x7f01e8104f20 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01ece00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01e810f2b0 con 0x7f01e81034f0 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e819bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35790/0 (socket says 172.21.15.1:35790) 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e819c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41880/0 (socket says 172.21.15.1:41880) 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 -- 172.21.15.1:0/3640455937 learned_addr learned my addr 172.21.15.1:0/3640455937 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:09:46.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e6800640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 0x7f01e819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:46.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 -- 172.21.15.1:0/3640455937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 msgr2=0x7f01e819d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:46.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 0x7f01e819d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:46.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 -- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 msgr2=0x7f01e819c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:09:46.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e819c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:09:46.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e5e00640 1 -- 172.21.15.1:0/3640455937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e819d9f0 con 0x7f01e81034f0 2024-08-28T20:09:46.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.003+0000 7f01e6800640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 0x7f01e819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.004+0000 7f01e5e00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e819bfc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f01d800e9f0 tx=0x7f01d800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.004+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d800cd80 con 0x7f01e81034f0 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.004+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80054d0 con 0x7f01e81034f0 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.004+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8010690 con 0x7f01e81034f0 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.004+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e819dce0 con 0x7f01e81034f0 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.004+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e81a43e0 con 0x7f01e81034f0 2024-08-28T20:09:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.005+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e81a45b0 con 0x7f01e81034f0 2024-08-28T20:09:46.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.008+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f01d8004e30 con 0x7f01e81034f0 2024-08-28T20:09:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.009+0000 7f01dea00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01cc0b4aa0 0x7f01cc0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:09:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.009+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f01d80e3bb0 con 0x7f01e81034f0 2024-08-28T20:09:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.009+0000 7f01e5400640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01cc0b4aa0 0x7f01cc0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:09:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.010+0000 7f01e5400640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01cc0b4aa0 0x7f01cc0b6fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000c00 tx=0x7f01d4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:09:46.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.011+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f01d8056130 con 0x7f01e81034f0 2024-08-28T20:09:46.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:09:46.219+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f01e8076ab0 con 0x7f01cc0b4aa0 2024-08-28T20:09:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:46 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:09:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:46 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:09:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:46 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:09:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:46 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:09:46.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:46 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:09:46.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:46 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:09:47.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:47 smithi001 ceph-mon[20984]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:47.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:47 smithi001 ceph-mon[20984]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:09:47.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:47 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:47.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:47 smithi007 ceph-mon[25357]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:47.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:47 smithi007 ceph-mon[25357]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:09:47.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:47 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:47.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:47 smithi121 ceph-mon[25248]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:47.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:47 smithi121 ceph-mon[25248]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:09:47.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:47 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:49.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:49 smithi121 ceph-mon[25248]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:49.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:49 smithi007 ceph-mon[25357]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:49.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:49 smithi001 ceph-mon[20984]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:50 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/471803786' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1b3b5c1-9a16-483f-944f-6e8e933cd76a"} : dispatch 2024-08-28T20:09:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:50 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/471803786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1b3b5c1-9a16-483f-944f-6e8e933cd76a"}]': finished 2024-08-28T20:09:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:50 smithi007 ceph-mon[25357]: osdmap e5: 1 total, 0 up, 1 in 2024-08-28T20:09:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:09:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:50 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/471803786' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1b3b5c1-9a16-483f-944f-6e8e933cd76a"} : dispatch 2024-08-28T20:09:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:50 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/471803786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1b3b5c1-9a16-483f-944f-6e8e933cd76a"}]': finished 2024-08-28T20:09:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:50 smithi001 ceph-mon[20984]: osdmap e5: 1 total, 0 up, 1 in 2024-08-28T20:09:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:09:50.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/471803786' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1b3b5c1-9a16-483f-944f-6e8e933cd76a"} : dispatch 2024-08-28T20:09:50.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/471803786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1b3b5c1-9a16-483f-944f-6e8e933cd76a"}]': finished 2024-08-28T20:09:50.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:50 smithi121 ceph-mon[25248]: osdmap e5: 1 total, 0 up, 1 in 2024-08-28T20:09:50.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:09:51.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:51 smithi007 ceph-mon[25357]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:51.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:51 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3099631455' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:09:51.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:51 smithi001 ceph-mon[20984]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:51.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:51 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3099631455' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:09:51.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:51 smithi121 ceph-mon[25248]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:51.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:51 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3099631455' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:09:53.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:53 smithi007 ceph-mon[25357]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:53.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:53 smithi001 ceph-mon[20984]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:53.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:53 smithi121 ceph-mon[25248]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:55 smithi007 ceph-mon[25357]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:55.670 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:55 smithi001 ceph-mon[20984]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:55.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:55 smithi121 ceph-mon[25248]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:57 smithi007 ceph-mon[25357]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:57.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:57 smithi001 ceph-mon[20984]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:57 smithi121 ceph-mon[25248]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:59.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:59 smithi001 ceph-mon[20984]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:59.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:59 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-28T20:09:59.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:09:59 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:59 smithi007 ceph-mon[25357]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-28T20:09:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:09:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:09:59.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:59 smithi121 ceph-mon[25248]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:09:59.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:59 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-28T20:09:59.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:09:59 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:00.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:00 smithi001 ceph-mon[20984]: Deploying daemon osd.0 on smithi001 2024-08-28T20:10:00.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:00 smithi001 ceph-mon[20984]: overall HEALTH_OK 2024-08-28T20:10:00.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:00 smithi007 ceph-mon[25357]: Deploying daemon osd.0 on smithi001 2024-08-28T20:10:00.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:00 smithi007 ceph-mon[25357]: overall HEALTH_OK 2024-08-28T20:10:00.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:00 smithi121 ceph-mon[25248]: Deploying daemon osd.0 on smithi001 2024-08-28T20:10:00.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:00 smithi121 ceph-mon[25248]: overall HEALTH_OK 2024-08-28T20:10:01.517 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:01 smithi001 ceph-mon[20984]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:01.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:01 smithi007 ceph-mon[25357]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:01.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:01 smithi121 ceph-mon[25248]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:03 smithi007 ceph-mon[25357]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:03.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:03 smithi001 ceph-mon[20984]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:03.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:03 smithi121 ceph-mon[25248]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:05.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:05 smithi001 ceph-mon[20984]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:05 smithi007 ceph-mon[25357]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:05 smithi121 ceph-mon[25248]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:07.532 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:07 smithi121 ceph-mon[25248]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:07.532 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:07.532 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:07.532 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:07 smithi007 ceph-mon[25357]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:07 smithi001 ceph-mon[20984]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:07.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:07.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:09 smithi001 ceph-mon[20984]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:09.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:09.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:09.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:09 smithi007 ceph-mon[25357]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:09 smithi121 ceph-mon[25248]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:11.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:11 smithi001 ceph-mon[20984]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:11.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:11 smithi007 ceph-mon[25357]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:11 smithi121 ceph-mon[25248]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:11.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.916+0000 7f01dea00640 1 -- 172.21.15.1:0/3640455937 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f01e8076ab0 con 0x7f01cc0b4aa0 2024-08-28T20:10:11.917 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01cc0b4aa0 msgr2=0x7f01cc0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01cc0b4aa0 0x7f01cc0b6fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000c00 tx=0x7f01d4031400 comp rx=0 tx=0).stop 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 msgr2=0x7f01e819bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e819bfc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f01d800e9f0 tx=0x7f01d800edf0 comp rx=0 tx=0).stop 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 shutdown_connections 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01cc0b4aa0 0x7f01cc0b6fb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e8104580 0x7f01e819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e8104f20 0x7f01e819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:11.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.918+0000 7f01ece00640 1 --2- 172.21.15.1:0/3640455937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e81034f0 0x7f01e819bfc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.919+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 >> 172.21.15.1:0/3640455937 conn(0x7f01e80fee60 msgr2=0x7f01e8075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:10:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.919+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 shutdown_connections 2024-08-28T20:10:11.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:10:11.919+0000 7f01ece00640 1 -- 172.21.15.1:0/3640455937 wait complete. 2024-08-28T20:10:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:12 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:12 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:12 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:12 smithi007 ceph-mon[25357]: from='osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T20:10:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:12 smithi007 ceph-mon[25357]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T20:10:12.714 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:12 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:12.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:12 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:12.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:12 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:12.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:12 smithi001 ceph-mon[20984]: from='osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T20:10:12.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:12 smithi001 ceph-mon[20984]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T20:10:12.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:12 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:12.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:12 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:12.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:12 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:12.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:12 smithi121 ceph-mon[25248]: from='osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T20:10:12.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:12 smithi121 ceph-mon[25248]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T20:10:12.750 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.0.service 2024-08-28T20:10:12.754 INFO:tasks.cephadm:Deploying osd.1 on smithi007 with /dev/vg_nvme/lv_4... 2024-08-28T20:10:12.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-28T20:10:13.018 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:10:13.467 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:13 smithi007 ceph-mon[25357]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:13.468 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:13 smithi007 ceph-mon[25357]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-28T20:10:13.468 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:13 smithi007 ceph-mon[25357]: osdmap e6: 1 total, 0 up, 1 in 2024-08-28T20:10:13.468 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:13.468 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:13 smithi007 ceph-mon[25357]: from='osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:10:13.468 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:13 smithi007 ceph-mon[25357]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:10:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-mon[20984]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-mon[20984]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-28T20:10:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-mon[20984]: osdmap e6: 1 total, 0 up, 1 in 2024-08-28T20:10:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:13.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-mon[20984]: from='osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:10:13.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-mon[20984]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:10:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:13 smithi121 ceph-mon[25248]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:13 smithi121 ceph-mon[25248]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-28T20:10:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:13 smithi121 ceph-mon[25248]: osdmap e6: 1 total, 0 up, 1 in 2024-08-28T20:10:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:13 smithi121 ceph-mon[25248]: from='osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:10:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:13 smithi121 ceph-mon[25248]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:10:14.089 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0[37244]: 2024-08-28T20:10:13.939+0000 7f13a7400640 -1 osd.0 0 waiting for initial osdmap 2024-08-28T20:10:14.089 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:10:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0[37244]: 2024-08-28T20:10:13.943+0000 7f13a2400640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:10:14.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:14 smithi001 ceph-mon[20984]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:10:14.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:14 smithi001 ceph-mon[20984]: osdmap e7: 1 total, 0 up, 1 in 2024-08-28T20:10:14.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:14.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:14.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:14 smithi001 ceph-mon[20984]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:15.020 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:14 smithi007 ceph-mon[25357]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:10:15.020 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:14 smithi007 ceph-mon[25357]: osdmap e7: 1 total, 0 up, 1 in 2024-08-28T20:10:15.020 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:15.020 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:15.020 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:14 smithi007 ceph-mon[25357]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:15.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:14 smithi121 ceph-mon[25248]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:10:15.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:14 smithi121 ceph-mon[25248]: osdmap e7: 1 total, 0 up, 1 in 2024-08-28T20:10:15.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:15.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:15.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:14 smithi121 ceph-mon[25248]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T20:10:15.290 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:10:15.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-08-28T20:10:15.576 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 -- 172.21.15.7:0/2423457509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103e10 msgr2=0x7f6c8410a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 --2- 172.21.15.7:0/2423457509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103e10 0x7f6c8410a7b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009ca0 tx=0x7f6c7c02a950 comp rx=0 tx=0).stop 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 -- 172.21.15.7:0/2423457509 shutdown_connections 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 --2- 172.21.15.7:0/2423457509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103e10 0x7f6c8410a7b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 --2- 172.21.15.7:0/2423457509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c84103470 0x7f6c84103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 --2- 172.21.15.7:0/2423457509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c841023e0 0x7f6c84102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 -- 172.21.15.7:0/2423457509 >> 172.21.15.7:0/2423457509 conn(0x7f6c840fdd50 msgr2=0x7f6c84100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 -- 172.21.15.7:0/2423457509 shutdown_connections 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.027+0000 7f6c8a450640 1 -- 172.21.15.7:0/2423457509 wait complete. 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 Processor -- start 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 -- start start 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c841023e0 0x7f6c84199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 0x7f6c8419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c84103e10 0x7f6c8419af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8410e040 con 0x7f6c841023e0 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8410dec0 con 0x7f6c84103470 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c8a450640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8410e1c0 con 0x7f6c84103e10 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 0x7f6c8419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 0x7f6c8419a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58718/0 (socket says 172.21.15.7:58718) 2024-08-28T20:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c837fe640 1 -- 172.21.15.7:0/4133129231 learned_addr learned my addr 172.21.15.7:0/4133129231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c83fff640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c841023e0 0x7f6c84199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.028+0000 7f6c889ed640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c84103e10 0x7f6c8419af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c837fe640 1 -- 172.21.15.7:0/4133129231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c84103e10 msgr2=0x7f6c8419af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c837fe640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c84103e10 0x7f6c8419af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c837fe640 1 -- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c841023e0 msgr2=0x7f6c84199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c837fe640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c841023e0 0x7f6c84199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c837fe640 1 -- 172.21.15.7:0/4133129231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8419b720 con 0x7f6c84103470 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c837fe640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 0x7f6c8419a360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800d950 tx=0x7f6c7800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78017030 con 0x7f6c84103470 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c78004020 con 0x7f6c84103470 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8419ba10 con 0x7f6c84103470 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c780047a0 con 0x7f6c84103470 2024-08-28T20:10:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.029+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c841a2110 con 0x7f6c84103470 2024-08-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.030+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c84102850 con 0x7f6c84103470 2024-08-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.032+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f6c78009a30 con 0x7f6c84103470 2024-08-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.033+0000 7f6c817fa640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6c6c0b4b20 0x7f6c6c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.033+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f6c780e3770 con 0x7f6c84103470 2024-08-28T20:10:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.033+0000 7f6c83fff640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6c6c0b4b20 0x7f6c6c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.034+0000 7f6c83fff640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6c6c0b4b20 0x7f6c6c0b7030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009bd0 tx=0x7f6c74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:10:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.036+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6c780ac2f0 con 0x7f6c84103470 2024-08-28T20:10:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:15 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:10:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:15 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:10:16.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:15 smithi001 ceph-mon[20984]: osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] boot 2024-08-28T20:10:16.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:15 smithi001 ceph-mon[20984]: osdmap e8: 1 total, 1 up, 1 in 2024-08-28T20:10:16.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:15 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:10:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:15 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:10:16.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:15 smithi121 ceph-mon[25248]: osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] boot 2024-08-28T20:10:16.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:15 smithi121 ceph-mon[25248]: osdmap e8: 1 total, 1 up, 1 in 2024-08-28T20:10:16.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:16.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:16.253+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6c841a22e0 con 0x7f6c6c0b4b20 2024-08-28T20:10:16.255 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:15 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:10:16.255 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:15 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:10:16.255 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:15 smithi007 ceph-mon[25357]: osd.0 [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] boot 2024-08-28T20:10:16.255 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:15 smithi007 ceph-mon[25357]: osdmap e8: 1 total, 1 up, 1 in 2024-08-28T20:10:16.255 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T20:10:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: osdmap e9: 1 total, 1 up, 1 in 2024-08-28T20:10:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:10:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:10:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi001 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi001 to 17094M 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:17.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: osdmap e9: 1 total, 1 up, 1 in 2024-08-28T20:10:17.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:17.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:10:17.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi001 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi001 to 17094M 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: osdmap e9: 1 total, 1 up, 1 in 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi001 2024-08-28T20:10:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi001 to 17094M 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:17.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/972424340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"} : dispatch 2024-08-28T20:10:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"} : dispatch 2024-08-28T20:10:19.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"}]': finished 2024-08-28T20:10:19.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: osdmap e10: 2 total, 1 up, 2 in 2024-08-28T20:10:19.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:19.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:19 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/98396932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:10:19.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:19.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/972424340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"} : dispatch 2024-08-28T20:10:19.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"} : dispatch 2024-08-28T20:10:19.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"}]': finished 2024-08-28T20:10:19.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: osdmap e10: 2 total, 1 up, 2 in 2024-08-28T20:10:19.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:19.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:19 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/98396932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:10:19.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:19.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/972424340' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"} : dispatch 2024-08-28T20:10:19.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"} : dispatch 2024-08-28T20:10:19.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8587b29-15e2-45cc-8929-361b1068c099"}]': finished 2024-08-28T20:10:19.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: osdmap e10: 2 total, 1 up, 2 in 2024-08-28T20:10:19.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:19.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:19 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/98396932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:10:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:21 smithi001 ceph-mon[20984]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:21.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:21 smithi121 ceph-mon[25248]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:21.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:21 smithi007 ceph-mon[25357]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:23.254 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:23 smithi007 ceph-mon[25357]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:23.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:23 smithi001 ceph-mon[20984]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:23.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:23 smithi121 ceph-mon[25248]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:25.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:25 smithi007 ceph-mon[25357]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:25.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:25 smithi001 ceph-mon[20984]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:25.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:25 smithi121 ceph-mon[25248]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:26.350 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-28T20:10:26.350 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-28T20:10:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-28T20:10:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:27.360 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:27 smithi007 ceph-mon[25357]: Deploying daemon osd.1 on smithi007 2024-08-28T20:10:27.361 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:27 smithi007 ceph-mon[25357]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:27.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:27 smithi001 ceph-mon[20984]: Deploying daemon osd.1 on smithi007 2024-08-28T20:10:27.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:27 smithi001 ceph-mon[20984]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:27.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:27 smithi121 ceph-mon[25248]: Deploying daemon osd.1 on smithi007 2024-08-28T20:10:27.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:27 smithi121 ceph-mon[25248]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:29.308 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:29 smithi007 ceph-mon[25357]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:29 smithi001 ceph-mon[20984]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:29.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:29 smithi121 ceph-mon[25248]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:31 smithi001 ceph-mon[20984]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:31.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:31 smithi121 ceph-mon[25248]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:31.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:31.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:31.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:31.504 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:31 smithi007 ceph-mon[25357]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:31.504 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:31.504 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:31.504 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:33 smithi001 ceph-mon[20984]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:33.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:33 smithi121 ceph-mon[25248]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:33 smithi007 ceph-mon[25357]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:34.428 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.428 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.429 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:34.429 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:34.429 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.471+0000 7f6c817fa640 1 -- 172.21.15.7:0/4133129231 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6c841a22e0 con 0x7f6c6c0b4b20 2024-08-28T20:10:34.473 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 1 on host 'smithi007' 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.473+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6c6c0b4b20 msgr2=0x7f6c6c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.473+0000 7f6c8a450640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6c6c0b4b20 0x7f6c6c0b7030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009bd0 tx=0x7f6c74005f90 comp rx=0 tx=0).stop 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.473+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 msgr2=0x7f6c8419a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.473+0000 7f6c8a450640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 0x7f6c8419a360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800d950 tx=0x7f6c7800de10 comp rx=0 tx=0).stop 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 shutdown_connections 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6c6c0b4b20 0x7f6c6c0b7030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c84103e10 0x7f6c8419af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:34.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c84103470 0x7f6c8419a360 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 --2- 172.21.15.7:0/4133129231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c841023e0 0x7f6c84199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 >> 172.21.15.7:0/4133129231 conn(0x7f6c840fdd50 msgr2=0x7f6c840ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:10:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 shutdown_connections 2024-08-28T20:10:34.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:10:34.474+0000 7f6c8a450640 1 -- 172.21.15.7:0/4133129231 wait complete. 2024-08-28T20:10:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:35.044 DEBUG:teuthology.orchestra.run.smithi007:osd.1> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.1.service 2024-08-28T20:10:35.046 INFO:tasks.cephadm:Deploying osd.2 on smithi121 with /dev/vg_nvme/lv_4... 2024-08-28T20:10:35.047 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-28T20:10:35.297 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:10:35.300 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:35 smithi007 ceph-mon[25357]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:35.300 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:35.300 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:35.300 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:35.418 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:35 smithi121 ceph-mon[25248]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:35.418 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:35.418 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:35.418 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:35 smithi001 ceph-mon[20984]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:37.007 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:10:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1[29825]: 2024-08-28T20:10:36.628+0000 7f9780c69640 -1 osd.1 0 log_to_monitors true 2024-08-28T20:10:37.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:37 smithi121 ceph-mon[25248]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:37.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:37 smithi121 ceph-mon[25248]: from='osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T20:10:37.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:37 smithi121 ceph-mon[25248]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T20:10:37.310 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:37 smithi007 ceph-mon[25357]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:37.310 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:37 smithi007 ceph-mon[25357]: from='osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T20:10:37.310 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:37 smithi007 ceph-mon[25357]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T20:10:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:37 smithi001 ceph-mon[20984]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:37 smithi001 ceph-mon[20984]: from='osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T20:10:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:37 smithi001 ceph-mon[20984]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T20:10:37.730 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:10:37.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_4 2024-08-28T20:10:38.005 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: osdmap e11: 2 total, 1 up, 2 in 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi007 2024-08-28T20:10:38.376 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi007 to 17092M 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:38.377 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 -- 172.21.15.121:0/3280956263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c103e10 msgr2=0x7f1f7c10a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/3280956263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c103e10 0x7f1f7c10a7b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009ca0 tx=0x7f1f7402a950 comp rx=0 tx=0).stop 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 -- 172.21.15.121:0/3280956263 shutdown_connections 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/3280956263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103470 0x7f1f7c103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/3280956263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c103e10 0x7f1f7c10a7b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/3280956263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 -- 172.21.15.121:0/3280956263 >> 172.21.15.121:0/3280956263 conn(0x7f1f7c0fdd50 msgr2=0x7f1f7c100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 -- 172.21.15.121:0/3280956263 shutdown_connections 2024-08-28T20:10:38.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.464+0000 7f1f82fbe640 1 -- 172.21.15.121:0/3280956263 wait complete. 2024-08-28T20:10:38.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 Processor -- start 2024-08-28T20:10:38.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 -- start start 2024-08-28T20:10:38.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:38.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7c103470 0x7f1f7c19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:38.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103e10 0x7f1f7c1a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c10e090 con 0x7f1f7c103e10 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c10df10 con 0x7f1f7c103470 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.465+0000 7f1f82fbe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c10e210 con 0x7f1f7c1023e0 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c06c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51950/0 (socket says 172.21.15.121:51950) 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 -- 172.21.15.121:0/2528867234 learned_addr learned my addr 172.21.15.121:0/2528867234 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f7bfff640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7c103470 0x7f1f7c19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f8155b640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103e10 0x7f1f7c1a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 -- 172.21.15.121:0/2528867234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7c103470 msgr2=0x7f1f7c19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7c103470 0x7f1f7c19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:38.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 -- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103e10 msgr2=0x7f1f7c1a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103e10 0x7f1f7c1a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 -- 172.21.15.121:0/2528867234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c1a7df0 con 0x7f1f7c1023e0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f8155b640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103e10 0x7f1f7c1a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f80d5a640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c06c1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000e9f0 tx=0x7f1f7000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000cd80 con 0x7f1f7c1023e0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c1a80e0 con 0x7f1f7c1023e0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f700054d0 con 0x7f1f7c1023e0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.466+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70010690 con 0x7f1f7c1023e0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.467+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c1a85d0 con 0x7f1f7c1023e0 2024-08-28T20:10:38.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.467+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7c1095c0 con 0x7f1f7c1023e0 2024-08-28T20:10:38.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.469+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f1f70004e30 con 0x7f1f7c1023e0 2024-08-28T20:10:38.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.470+0000 7f1f79ffb640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1f6c0b4aa0 0x7f1f6c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:10:38.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.470+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f1f700e3e70 con 0x7f1f7c1023e0 2024-08-28T20:10:38.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.470+0000 7f1f7bfff640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1f6c0b4aa0 0x7f1f6c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:10:38.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.471+0000 7f1f7bfff640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1f6c0b4aa0 0x7f1f6c0b6fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800bbe0 tx=0x7f1f6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:10:38.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.473+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1f70056130 con 0x7f1f7c1023e0 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: osdmap e11: 2 total, 1 up, 2 in 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi007 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:10:38.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi007 to 17092M 2024-08-28T20:10:38.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:38.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:38.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.565 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1[29825]: 2024-08-28T20:10:38.208+0000 7f977cbeb640 -1 osd.1 0 waiting for initial osdmap 2024-08-28T20:10:38.565 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1[29825]: 2024-08-28T20:10:38.213+0000 7f97789e9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:10:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-28T20:10:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:10:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: osdmap e11: 2 total, 1 up, 2 in 2024-08-28T20:10:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi007 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi007 to 17092M 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:38.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:38.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:38.658+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1f7c0635a0 con 0x7f1f6c0b4aa0 2024-08-28T20:10:39.399 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:39.399 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: osdmap e12: 2 total, 1 up, 2 in 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:10:39.400 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:10:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: osdmap e12: 2 total, 1 up, 2 in 2024-08-28T20:10:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:10:39.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:10:39.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:10:39.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: osdmap e12: 2 total, 1 up, 2 in 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:10:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:10:39.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:40 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:10:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:40 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:10:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:40 smithi001 ceph-mon[20984]: osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] boot 2024-08-28T20:10:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:40 smithi001 ceph-mon[20984]: osdmap e13: 2 total, 2 up, 2 in 2024-08-28T20:10:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:40 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:40.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:40 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:10:40.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:40 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:10:40.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:40 smithi121 ceph-mon[25248]: osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] boot 2024-08-28T20:10:40.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:40 smithi121 ceph-mon[25248]: osdmap e13: 2 total, 2 up, 2 in 2024-08-28T20:10:40.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:40 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:40.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:40 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:10:40.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:40 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:10:40.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:40 smithi007 ceph-mon[25357]: osd.1 [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] boot 2024-08-28T20:10:40.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:40 smithi007 ceph-mon[25357]: osdmap e13: 2 total, 2 up, 2 in 2024-08-28T20:10:40.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:40 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T20:10:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: osdmap e14: 2 total, 2 up, 2 in 2024-08-28T20:10:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/1271916585' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"} : dispatch 2024-08-28T20:10:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"} : dispatch 2024-08-28T20:10:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"}]': finished 2024-08-28T20:10:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: osdmap e15: 3 total, 2 up, 3 in 2024-08-28T20:10:41.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:10:41.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:41.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: osdmap e14: 2 total, 2 up, 2 in 2024-08-28T20:10:41.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/1271916585' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"} : dispatch 2024-08-28T20:10:41.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"} : dispatch 2024-08-28T20:10:41.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"}]': finished 2024-08-28T20:10:41.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: osdmap e15: 3 total, 2 up, 3 in 2024-08-28T20:10:41.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: osdmap e14: 2 total, 2 up, 2 in 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/1271916585' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"} : dispatch 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"} : dispatch 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294c27ff-a326-428f-8084-139bf4bf7cad"}]': finished 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: osdmap e15: 3 total, 2 up, 3 in 2024-08-28T20:10:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:10:42.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:42 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/2673680559' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:10:42.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:42 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/2673680559' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:10:42.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:42 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/2673680559' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:10:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:43 smithi007 ceph-mon[25357]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:43.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:43 smithi001 ceph-mon[20984]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:43.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:43 smithi121 ceph-mon[25248]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:45 smithi007 ceph-mon[25357]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:45.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:45 smithi001 ceph-mon[20984]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:45.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:45 smithi121 ceph-mon[25248]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:47.519 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:47 smithi121 ceph-mon[25248]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:47.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:47 smithi007 ceph-mon[25357]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:47.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:47 smithi001 ceph-mon[20984]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:49.443 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:49 smithi121 ceph-mon[25248]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:49.528 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:49 smithi001 ceph-mon[20984]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:49.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:49 smithi007 ceph-mon[25357]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-28T20:10:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:50 smithi121 ceph-mon[25248]: Deploying daemon osd.2 on smithi121 2024-08-28T20:10:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-28T20:10:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:50 smithi007 ceph-mon[25357]: Deploying daemon osd.2 on smithi121 2024-08-28T20:10:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-28T20:10:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:50 smithi001 ceph-mon[20984]: Deploying daemon osd.2 on smithi121 2024-08-28T20:10:51.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:51 smithi007 ceph-mon[25357]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:51.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:51 smithi001 ceph-mon[20984]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:51.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:51 smithi121 ceph-mon[25248]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:53 smithi121 ceph-mon[25248]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:53.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:53 smithi007 ceph-mon[25357]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:53.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:53 smithi001 ceph-mon[20984]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:55.548 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:55 smithi121 ceph-mon[25248]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:55.549 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:55.549 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:55.549 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:55 smithi007 ceph-mon[25357]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:55 smithi001 ceph-mon[20984]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:57 smithi007 ceph-mon[25357]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:57 smithi001 ceph-mon[20984]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:57 smithi121 ceph-mon[25248]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:10:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:10:57.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:58.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.600+0000 7f1f79ffb640 1 -- 172.21.15.121:0/2528867234 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f7c0635a0 con 0x7f1f6c0b4aa0 2024-08-28T20:10:58.603 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 2 on host 'smithi121' 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1f6c0b4aa0 msgr2=0x7f1f6c0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1f6c0b4aa0 0x7f1f6c0b6fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800bbe0 tx=0x7f1f6800b390 comp rx=0 tx=0).stop 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 msgr2=0x7f1f7c06c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c06c1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000e9f0 tx=0x7f1f7000edf0 comp rx=0 tx=0).stop 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 shutdown_connections 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1f6c0b4aa0 0x7f1f6c0b6fb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f7c103e10 0x7f1f7c1a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f7c103470 0x7f1f7c19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:58.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 --2- 172.21.15.121:0/2528867234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f7c1023e0 0x7f1f7c06c1e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:10:58.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 >> 172.21.15.121:0/2528867234 conn(0x7f1f7c0fdd50 msgr2=0x7f1f7c106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:10:58.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 shutdown_connections 2024-08-28T20:10:58.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:10:58.602+0000 7f1f82fbe640 1 -- 172.21.15.121:0/2528867234 wait complete. 2024-08-28T20:10:59.213 DEBUG:teuthology.orchestra.run.smithi121:osd.2> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.2.service 2024-08-28T20:10:59.216 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-08-28T20:10:59.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-28T20:10:59.430 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:59 smithi121 ceph-mon[25248]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:59.430 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:59 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:59.430 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:59 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:59.430 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:10:59 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:59 smithi007 ceph-mon[25357]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:10:59 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:59.596 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:10:59.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:59 smithi001 ceph-mon[20984]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:10:59.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:59 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:10:59.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:59 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:10:59.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:10:59 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:00.537 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2[30206]: 2024-08-28T20:11:00.491+0000 7fbbf5aff640 -1 osd.2 0 log_to_monitors true 2024-08-28T20:11:01.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:01 smithi001 ceph-mon[20984]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:01.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:01 smithi001 ceph-mon[20984]: from='osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T20:11:01.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:01 smithi001 ceph-mon[20984]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T20:11:01.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:01 smithi121 ceph-mon[25248]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:01.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:01 smithi121 ceph-mon[25248]: from='osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T20:11:01.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:01 smithi121 ceph-mon[25248]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T20:11:01.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:01 smithi007 ceph-mon[25357]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:01.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:01 smithi007 ceph-mon[25357]: from='osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T20:11:01.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:01 smithi007 ceph-mon[25357]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T20:11:02.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-28T20:11:02.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: osdmap e16: 3 total, 2 up, 3 in 2024-08-28T20:11:02.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:02.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:11:02.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:11:02.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:02.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:02.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:02.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.472 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:11:02.503 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-08-28T20:11:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-28T20:11:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: osdmap e16: 3 total, 2 up, 3 in 2024-08-28T20:11:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:11:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:02.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-28T20:11:02.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: osdmap e16: 3 total, 2 up, 3 in 2024-08-28T20:11:02.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:02.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:02.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:02.888 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:11:03.444 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi121 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi121 to 17087M 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: osdmap e17: 3 total, 2 up, 3 in 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:03.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:03 smithi001 ceph-mon[20984]: from='osd.2 ' entity='osd.2' 2024-08-28T20:11:03.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2[30206]: 2024-08-28T20:11:03.170+0000 7fbbf1a81640 -1 osd.2 0 waiting for initial osdmap 2024-08-28T20:11:03.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2[30206]: 2024-08-28T20:11:03.350+0000 7fbbe9877640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi121 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi121 to 17087M 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: osdmap e17: 3 total, 2 up, 3 in 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:03.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:03 smithi121 ceph-mon[25248]: from='osd.2 ' entity='osd.2' 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 -- 172.21.15.1:0/3033404046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 msgr2=0x7f1e0c1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 --2- 172.21.15.1:0/3033404046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c1085c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009900 tx=0x7f1dfc02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 -- 172.21.15.1:0/3033404046 shutdown_connections 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 --2- 172.21.15.1:0/3033404046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e0c10b460 0x7f1e0c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 --2- 172.21.15.1:0/3033404046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c108b00 0x7f1e0c10af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 --2- 172.21.15.1:0/3033404046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c1085c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 -- 172.21.15.1:0/3033404046 >> 172.21.15.1:0/3033404046 conn(0x7f1e0c0fdd80 msgr2=0x7f1e0c100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 -- 172.21.15.1:0/3033404046 shutdown_connections 2024-08-28T20:11:03.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.544+0000 7f1e13c00640 1 -- 172.21.15.1:0/3033404046 wait complete. 2024-08-28T20:11:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.545+0000 7f1e13c00640 1 Processor -- start 2024-08-28T20:11:03.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.545+0000 7f1e13c00640 1 -- start start 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e13c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c19bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e13c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e0c108b00 0x7f1e0c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e13c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c10b460 0x7f1e0c19d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e13c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c111380 con 0x7f1e0c06c1b0 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e13c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c111200 con 0x7f1e0c108b00 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e13c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c111500 con 0x7f1e0c10b460 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e11200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c19bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e11200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c19bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50072/0 (socket says 172.21.15.1:50072) 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e11200640 1 -- 172.21.15.1:0/507472160 learned_addr learned my addr 172.21.15.1:0/507472160 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e03e00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e0c108b00 0x7f1e0c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:03.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.546+0000 7f1e11c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c10b460 0x7f1e0c19d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:03.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e11c00640 1 -- 172.21.15.1:0/507472160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e0c108b00 msgr2=0x7f1e0c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:03.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e11c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e0c108b00 0x7f1e0c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:03.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e11c00640 1 -- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 msgr2=0x7f1e0c19bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e11c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c19bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e11c00640 1 -- 172.21.15.1:0/507472160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c19d9a0 con 0x7f1e0c10b460 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e11c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c10b460 0x7f1e0c19d180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009fd0 tx=0x7f1e0400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400ce20 con 0x7f1e0c10b460 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e04005020 con 0x7f1e0c10b460 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04010690 con 0x7f1e0c10b460 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.547+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c19dc90 con 0x7f1e0c10b460 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.548+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c1a4390 con 0x7f1e0c10b460 2024-08-28T20:11:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.549+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c0ff8a0 con 0x7f1e0c10b460 2024-08-28T20:11:03.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.551+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 152520+0+0 (secure 0 0 0) 0x7f1e040054d0 con 0x7f1e0c10b460 2024-08-28T20:11:03.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.552+0000 7f1e0a000640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1df00b4b20 0x7f1df00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:03.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.553+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f1e040e40d0 con 0x7f1e0c10b460 2024-08-28T20:11:03.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.553+0000 7f1e11200640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1df00b4b20 0x7f1df00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:03.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.553+0000 7f1e11200640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1df00b4b20 0x7f1df00b7030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005f70 tx=0x7f1dfc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:11:03.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.556+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1e040ac8b0 con 0x7f1e0c10b460 2024-08-28T20:11:03.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi121 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi121 to 17087M 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: osdmap e17: 3 total, 2 up, 3 in 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:03 smithi007 ceph-mon[25357]: from='osd.2 ' entity='osd.2' 2024-08-28T20:11:03.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:03.772+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1e0c0635a0 con 0x7f1df00b4b20 2024-08-28T20:11:04.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:11:04.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:11:04.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:04.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:04.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:04.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:04.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:04.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:04.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:11:04.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:11:04.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:04.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:04.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:04.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:04.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:05.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:05 smithi001 ceph-mon[20984]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:05.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:05 smithi001 ceph-mon[20984]: osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] boot 2024-08-28T20:11:05.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:05 smithi001 ceph-mon[20984]: osdmap e18: 3 total, 3 up, 3 in 2024-08-28T20:11:05.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:05 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:05.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:05 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:11:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:05 smithi007 ceph-mon[25357]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:05 smithi007 ceph-mon[25357]: osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] boot 2024-08-28T20:11:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:05 smithi007 ceph-mon[25357]: osdmap e18: 3 total, 3 up, 3 in 2024-08-28T20:11:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:05 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:05 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:11:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:05 smithi121 ceph-mon[25248]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-28T20:11:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:05 smithi121 ceph-mon[25248]: osd.2 [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] boot 2024-08-28T20:11:05.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:05 smithi121 ceph-mon[25248]: osdmap e18: 3 total, 3 up, 3 in 2024-08-28T20:11:05.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:05 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T20:11:05.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:05 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:11:06.304 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-28T20:11:06.304 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:06 smithi001 ceph-mon[20984]: osdmap e19: 3 total, 3 up, 3 in 2024-08-28T20:11:06.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:11:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-28T20:11:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:06 smithi007 ceph-mon[25357]: osdmap e19: 3 total, 3 up, 3 in 2024-08-28T20:11:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:11:06.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-28T20:11:06.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:06 smithi121 ceph-mon[25248]: osdmap e19: 3 total, 3 up, 3 in 2024-08-28T20:11:06.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:11:07.187 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42047]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T20:11:07.187 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42047]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.187 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.187 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42047]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.188 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42050]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T20:11:07.188 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42050]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.188 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.188 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:11:06 smithi001 sudo[42050]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34032]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34032]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34032]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34035]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34035]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.300 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34035]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42056]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42056]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42056]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42061]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 sudo[42061]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.465 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: osdmap e20: 3 total, 3 up, 3 in 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1220871086' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"} : dispatch 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"} : dispatch 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"}]': finished 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: osdmap e21: 4 total, 3 up, 4 in 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34272]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T20:11:07.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34272]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34272]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.479 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34275]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T20:11:07.480 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34275]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.480 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.480 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34275]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34278]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T20:11:07.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34278]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34278]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34281]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34281]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 sudo[34281]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-28T20:11:07.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: osdmap e20: 3 total, 3 up, 3 in 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1220871086' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"} : dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"} : dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"}]': finished 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: osdmap e21: 4 total, 3 up, 4 in 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.483 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T20:11:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34038]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 sudo[34041]: pam_unix(sudo:session): session closed for user root 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: osdmap e20: 3 total, 3 up, 3 in 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1220871086' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"} : dispatch 2024-08-28T20:11:07.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d"}]': finished 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: osdmap e21: 4 total, 3 up, 4 in 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:07.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T20:11:07.568 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T20:11:07.568 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T20:11:08.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:08.343+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f1e040a8440 con 0x7f1e0c10b460 2024-08-28T20:11:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:08 smithi007 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:08 smithi007 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:08 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1239925406' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:11:08.656 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:08 smithi121 ceph-mon[25248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:08.656 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:08 smithi121 ceph-mon[25248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:08.656 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:08 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1239925406' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:11:08.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:08 smithi001 ceph-mon[20984]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T20:11:08.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:08 smithi001 ceph-mon[20984]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T20:11:08.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:08 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1239925406' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:11:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:09 smithi001 ceph-mon[20984]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:09 smithi001 ceph-mon[20984]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-28T20:11:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:09 smithi001 ceph-mon[20984]: Cluster is now healthy 2024-08-28T20:11:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:09 smithi001 ceph-mon[20984]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-08-28T20:11:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:09 smithi121 ceph-mon[25248]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:09 smithi121 ceph-mon[25248]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-28T20:11:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:09 smithi121 ceph-mon[25248]: Cluster is now healthy 2024-08-28T20:11:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:09 smithi121 ceph-mon[25248]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-08-28T20:11:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:09 smithi007 ceph-mon[25357]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:09 smithi007 ceph-mon[25357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-28T20:11:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:09 smithi007 ceph-mon[25357]: Cluster is now healthy 2024-08-28T20:11:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:09 smithi007 ceph-mon[25357]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-08-28T20:11:11.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:11 smithi001 ceph-mon[20984]: pgmap v102: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:11 smithi121 ceph-mon[25248]: pgmap v102: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:11.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:11 smithi007 ceph-mon[25357]: pgmap v102: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:13.474 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:13 smithi001 ceph-mon[20984]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:13 smithi121 ceph-mon[25248]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:13.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:13 smithi007 ceph-mon[25357]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:15.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:15 smithi001 ceph-mon[20984]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:15.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:15 smithi121 ceph-mon[25248]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:15 smithi007 ceph-mon[25357]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:17.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:17 smithi001 ceph-mon[20984]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:17.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-28T20:11:17.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:17.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:17 smithi001 ceph-mon[20984]: Deploying daemon osd.3 on smithi001 2024-08-28T20:11:17.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:17 smithi121 ceph-mon[25248]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:17.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-28T20:11:17.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:17.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:17 smithi121 ceph-mon[25248]: Deploying daemon osd.3 on smithi001 2024-08-28T20:11:17.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:17 smithi007 ceph-mon[25357]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:17.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-28T20:11:17.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:17.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:17 smithi007 ceph-mon[25357]: Deploying daemon osd.3 on smithi001 2024-08-28T20:11:19.503 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:19 smithi001 ceph-mon[20984]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:19.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:19 smithi121 ceph-mon[25248]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:19.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:19 smithi007 ceph-mon[25357]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:21.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:21 smithi001 ceph-mon[20984]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:21 smithi121 ceph-mon[25248]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:21 smithi007 ceph-mon[25357]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:23.590 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:23 smithi001 ceph-mon[20984]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:23 smithi121 ceph-mon[25248]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:23 smithi007 ceph-mon[25357]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:24.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:24.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:24.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:24.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:24.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:24.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:25.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:25 smithi001 ceph-mon[20984]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:25.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:25 smithi121 ceph-mon[25248]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:25 smithi007 ceph-mon[25357]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:27 smithi001 ceph-mon[20984]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:27 smithi121 ceph-mon[25248]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:27 smithi007 ceph-mon[25357]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.308+0000 7f1e0a000640 1 -- 172.21.15.1:0/507472160 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e0c0635a0 con 0x7f1df00b4b20 2024-08-28T20:11:29.310 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1df00b4b20 msgr2=0x7f1df00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1df00b4b20 0x7f1df00b7030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005f70 tx=0x7f1dfc0314a0 comp rx=0 tx=0).stop 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c10b460 msgr2=0x7f1e0c19d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c10b460 0x7f1e0c19d180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009fd0 tx=0x7f1e0400ef10 comp rx=0 tx=0).stop 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 shutdown_connections 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1df00b4b20 0x7f1df00b7030 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e0c10b460 0x7f1e0c19d180 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e0c108b00 0x7f1e0c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 --2- 172.21.15.1:0/507472160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e0c06c1b0 0x7f1e0c19bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 >> 172.21.15.1:0/507472160 conn(0x7f1e0c0fdd80 msgr2=0x7f1e0c109970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 shutdown_connections 2024-08-28T20:11:29.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:11:29.311+0000 7f1e13c00640 1 -- 172.21.15.1:0/507472160 wait complete. 2024-08-28T20:11:29.639 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:29 smithi001 ceph-mon[20984]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:29.639 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:29.639 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.640 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:29 smithi121 ceph-mon[25248]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:29.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:29 smithi007 ceph-mon[25357]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:29.985 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.3.service 2024-08-28T20:11:29.989 INFO:tasks.cephadm:Deploying osd.4 on smithi007 with /dev/vg_nvme/lv_3... 2024-08-28T20:11:29.989 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-28T20:11:30.227 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:11:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3[44074]: 2024-08-28T20:11:30.091+0000 7f2f7d45b640 -1 osd.3 0 log_to_monitors true 2024-08-28T20:11:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:11:30.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:30 smithi001 ceph-mon[20984]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-28T20:11:30.642 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:30 smithi007 ceph-mon[25357]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-28T20:11:30.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:30 smithi121 ceph-mon[25248]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-28T20:11:31.414 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:31 smithi007 ceph-mon[25357]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:31.414 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:31 smithi007 ceph-mon[25357]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-28T20:11:31.414 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:31 smithi007 ceph-mon[25357]: osdmap e22: 4 total, 3 up, 4 in 2024-08-28T20:11:31.414 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:31 smithi007 ceph-mon[25357]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:11:31.414 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:31.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:31 smithi001 ceph-mon[20984]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:31.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:31 smithi001 ceph-mon[20984]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-28T20:11:31.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:31 smithi001 ceph-mon[20984]: osdmap e22: 4 total, 3 up, 4 in 2024-08-28T20:11:31.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:31 smithi001 ceph-mon[20984]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:11:31.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:31 smithi121 ceph-mon[25248]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:31 smithi121 ceph-mon[25248]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-28T20:11:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:31 smithi121 ceph-mon[25248]: osdmap e22: 4 total, 3 up, 4 in 2024-08-28T20:11:31.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:31 smithi121 ceph-mon[25248]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:11:31.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:11:32.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-08-28T20:11:32.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-mon[20984]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:11:32.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-mon[20984]: osdmap e23: 4 total, 3 up, 4 in 2024-08-28T20:11:32.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-mon[20984]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' 2024-08-28T20:11:32.728 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3[44074]: 2024-08-28T20:11:32.356+0000 7f2f78000640 -1 osd.3 0 waiting for initial osdmap 2024-08-28T20:11:32.728 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:11:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3[44074]: 2024-08-28T20:11:32.379+0000 7f2f6e000640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:11:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:11:32.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:32 smithi121 ceph-mon[25248]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:11:32.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:32 smithi121 ceph-mon[25248]: osdmap e23: 4 total, 3 up, 4 in 2024-08-28T20:11:32.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:32 smithi121 ceph-mon[25248]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' 2024-08-28T20:11:32.757 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:32 smithi007 ceph-mon[25357]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:11:32.757 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:32 smithi007 ceph-mon[25357]: osdmap e23: 4 total, 3 up, 4 in 2024-08-28T20:11:32.757 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.758 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:32.758 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:32 smithi007 ceph-mon[25357]: from='osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665]' entity='osd.3' 2024-08-28T20:11:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 -- 172.21.15.7:0/707907557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a01054f0 msgr2=0x7f89a01079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/707907557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a01054f0 0x7f89a01079d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8988009900 tx=0x7f898802a410 comp rx=0 tx=0).stop 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 -- 172.21.15.7:0/707907557 shutdown_connections 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/707907557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89a0108110 0x7f89a010a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/707907557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a01054f0 0x7f89a01079d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/707907557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a0102a90 0x7f89a0104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 -- 172.21.15.7:0/707907557 >> 172.21.15.7:0/707907557 conn(0x7f89a00fd510 msgr2=0x7f89a00ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 -- 172.21.15.7:0/707907557 shutdown_connections 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 -- 172.21.15.7:0/707907557 wait complete. 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 Processor -- start 2024-08-28T20:11:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.151+0000 7f89a5b3a640 1 -- start start 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f89a5b3a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 0x7f89a0199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f89a5b3a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a01054f0 0x7f89a019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f89a5b3a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89a0108110 0x7f89a019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f89a5b3a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f89a010e030 con 0x7f89a0108110 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f89a5b3a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89a010deb0 con 0x7f89a0102a90 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f89a5b3a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89a010e1b0 con 0x7f89a01054f0 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 0x7f89a0199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 0x7f89a0199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46730/0 (socket says 172.21.15.7:46730) 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 -- 172.21.15.7:0/338554917 learned_addr learned my addr 172.21.15.7:0/338554917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f8997fff640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a01054f0 0x7f89a019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 -- 172.21.15.7:0/338554917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a01054f0 msgr2=0x7f89a019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a01054f0 0x7f89a019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 -- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89a0108110 msgr2=0x7f89a019af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89a0108110 0x7f89a019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 -- 172.21.15.7:0/338554917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a019b720 con 0x7f89a0102a90 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f8997fff640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a01054f0 0x7f89a019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899f7fe640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 0x7f89a0199d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f899000e9f0 tx=0x7f899000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.152+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899000cd80 con 0x7f89a0102a90 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.153+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89900054d0 con 0x7f89a0102a90 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.153+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a019ba10 con 0x7f89a0102a90 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.153+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990010690 con 0x7f89a0102a90 2024-08-28T20:11:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.153+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a01a1fd0 con 0x7f89a0102a90 2024-08-28T20:11:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.154+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a01a2200 con 0x7f89a0102a90 2024-08-28T20:11:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.156+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f8990004e30 con 0x7f89a0102a90 2024-08-28T20:11:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.157+0000 7f899d7fa640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f898c0b4b30 0x7f898c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.157+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f89900e4610 con 0x7f89a0102a90 2024-08-28T20:11:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.157+0000 7f8997fff640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f898c0b4b30 0x7f898c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.158+0000 7f8997fff640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f898c0b4b30 0x7f898c0b7040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8988031440 tx=0x7f8988005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:11:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.161+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8990056130 con 0x7f89a0102a90 2024-08-28T20:11:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:33.358+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f89a00fe930 con 0x7f898c0b4b30 2024-08-28T20:11:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] boot 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: osdmap e24: 4 total, 4 up, 4 in 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:33.726 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:11:33.726 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:11:33.726 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:33.726 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:33.726 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] boot 2024-08-28T20:11:33.726 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: osdmap e24: 4 total, 4 up, 4 in 2024-08-28T20:11:33.727 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:33.727 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:33.727 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:33.727 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:11:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:11:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-28T20:11:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: osd.3 [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] boot 2024-08-28T20:11:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: osdmap e24: 4 total, 4 up, 4 in 2024-08-28T20:11:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T20:11:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: osdmap e25: 4 total, 4 up, 4 in 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi001 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi001 to 8547M 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:34.663 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: osdmap e25: 4 total, 4 up, 4 in 2024-08-28T20:11:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi001 2024-08-28T20:11:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:34.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:34.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi001 to 8547M 2024-08-28T20:11:34.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:34.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:34.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:34.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: osdmap e25: 4 total, 4 up, 4 in 2024-08-28T20:11:34.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi001 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi001 to 8547M 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:34.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:35 smithi007 ceph-mon[25357]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:35 smithi007 ceph-mon[25357]: osdmap e26: 4 total, 4 up, 4 in 2024-08-28T20:11:35.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:35 smithi001 ceph-mon[20984]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:35.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:35 smithi001 ceph-mon[20984]: osdmap e26: 4 total, 4 up, 4 in 2024-08-28T20:11:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:35 smithi121 ceph-mon[25248]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:35 smithi121 ceph-mon[25248]: osdmap e26: 4 total, 4 up, 4 in 2024-08-28T20:11:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:36 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/403485181' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"} : dispatch 2024-08-28T20:11:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:36 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"} : dispatch 2024-08-28T20:11:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:36 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"}]': finished 2024-08-28T20:11:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:36 smithi007 ceph-mon[25357]: osdmap e27: 5 total, 4 up, 5 in 2024-08-28T20:11:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:36 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:36 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/3697135039' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:11:36.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:36 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/403485181' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"} : dispatch 2024-08-28T20:11:36.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:36 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"} : dispatch 2024-08-28T20:11:36.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:36 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"}]': finished 2024-08-28T20:11:36.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:36 smithi001 ceph-mon[20984]: osdmap e27: 5 total, 4 up, 5 in 2024-08-28T20:11:36.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:36 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:36.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:36 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/3697135039' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:11:36.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:36 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/403485181' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"} : dispatch 2024-08-28T20:11:36.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:36 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"} : dispatch 2024-08-28T20:11:36.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:36 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc09afde-7028-48d3-b258-e7a52e67317e"}]': finished 2024-08-28T20:11:36.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:36 smithi121 ceph-mon[25248]: osdmap e27: 5 total, 4 up, 5 in 2024-08-28T20:11:36.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:36 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:36.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:36 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/3697135039' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:11:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:37 smithi001 ceph-mon[20984]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-28T20:11:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:37 smithi121 ceph-mon[25248]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-28T20:11:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:37 smithi007 ceph-mon[25357]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-28T20:11:39.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:39 smithi001 ceph-mon[20984]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-28T20:11:39.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:39 smithi121 ceph-mon[25248]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-28T20:11:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:39 smithi007 ceph-mon[25357]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-28T20:11:41.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:41 smithi001 ceph-mon[20984]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-28T20:11:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:41 smithi121 ceph-mon[25248]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-28T20:11:41.981 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:41 smithi007 ceph-mon[25357]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-28T20:11:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:43 smithi001 ceph-mon[20984]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:11:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:43 smithi121 ceph-mon[25248]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:11:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:43 smithi007 ceph-mon[25357]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:11:44.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-28T20:11:44.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:44.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:44 smithi001 ceph-mon[20984]: Deploying daemon osd.4 on smithi007 2024-08-28T20:11:44.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-28T20:11:44.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:44.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:44 smithi121 ceph-mon[25248]: Deploying daemon osd.4 on smithi007 2024-08-28T20:11:45.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-28T20:11:45.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:45.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:44 smithi007 ceph-mon[25357]: Deploying daemon osd.4 on smithi007 2024-08-28T20:11:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:45 smithi001 ceph-mon[20984]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-28T20:11:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:45 smithi121 ceph-mon[25248]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-28T20:11:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:45 smithi007 ceph-mon[25357]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-28T20:11:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:47 smithi001 ceph-mon[20984]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:47 smithi121 ceph-mon[25248]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:48.021 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:47 smithi007 ceph-mon[25357]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:49.813 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:49 smithi007 ceph-mon[25357]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:49.813 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:49 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:49.813 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:49 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:49.813 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:49 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:49 smithi001 ceph-mon[20984]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:49 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:49 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:49 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:49 smithi121 ceph-mon[25248]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:49 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:49 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:49.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:49 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.961+0000 7f899d7fa640 1 -- 172.21.15.7:0/338554917 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f89a00fe930 con 0x7f898c0b4b30 2024-08-28T20:11:51.964 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 4 on host 'smithi007' 2024-08-28T20:11:51.965 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:51 smithi007 ceph-mon[25357]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:51.965 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.965 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.965 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:51.965 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:51.965 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f898c0b4b30 msgr2=0x7f898c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f898c0b4b30 0x7f898c0b7040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8988031440 tx=0x7f8988005d50 comp rx=0 tx=0).stop 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 msgr2=0x7f89a0199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 0x7f89a0199d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f899000e9f0 tx=0x7f899000edf0 comp rx=0 tx=0).stop 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 shutdown_connections 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f898c0b4b30 0x7f898c0b7040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89a0108110 0x7f89a019af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a01054f0 0x7f89a019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.964+0000 7f89a5b3a640 1 --2- 172.21.15.7:0/338554917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89a0102a90 0x7f89a0199d80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:51.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.965+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 >> 172.21.15.7:0/338554917 conn(0x7f89a00fd510 msgr2=0x7f89a01075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:11:51.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.965+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 shutdown_connections 2024-08-28T20:11:51.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:11:51.965+0000 7f89a5b3a640 1 -- 172.21.15.7:0/338554917 wait complete. 2024-08-28T20:11:51.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:51 smithi001 ceph-mon[20984]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:51 smithi121 ceph-mon[25248]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:52.579 DEBUG:teuthology.orchestra.run.smithi007:osd.4> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.4.service 2024-08-28T20:11:52.581 INFO:tasks.cephadm:Deploying osd.5 on smithi121 with /dev/vg_nvme/lv_3... 2024-08-28T20:11:52.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-28T20:11:52.803 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:52.803 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:52.803 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:52.836 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:11:52.956 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:52.957 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:52.957 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:52.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:11:52.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:52.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:53.969 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:53 smithi121 ceph-mon[25248]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:53.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:53 smithi001 ceph-mon[20984]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:53.991 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:53 smithi007 ceph-mon[25357]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:55.311 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:11:55.315 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:11:55.198+0000 7f753c54e640 -1 osd.4 0 log_to_monitors true 2024-08-28T20:11:55.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_3 2024-08-28T20:11:55.591 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:11:55.962 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:55.963 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T20:11:55.963 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T20:11:55.963 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.963 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.963 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:55.964 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:55.964 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.964 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:55.964 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:55.964 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:55.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:55.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:55.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:55.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:11:56.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:56.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:56.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:11:56.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:11:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 -- 172.21.15.121:0/215331367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc109210 msgr2=0x7fadbc10b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 --2- 172.21.15.121:0/215331367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc109210 0x7fadbc10b720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009ca0 tx=0x7fadb402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:11:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 -- 172.21.15.121:0/215331367 shutdown_connections 2024-08-28T20:11:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 --2- 172.21.15.121:0/215331367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadbc106670 0x7fadbc108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 --2- 172.21.15.121:0/215331367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc109210 0x7fadbc10b720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 --2- 172.21.15.121:0/215331367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc06b720 0x7fadbc106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 -- 172.21.15.121:0/215331367 >> 172.21.15.121:0/215331367 conn(0x7fadbc0fdd50 msgr2=0x7fadbc100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 -- 172.21.15.121:0/215331367 shutdown_connections 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.055+0000 7fadc083b640 1 -- 172.21.15.121:0/215331367 wait complete. 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 Processor -- start 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 -- start start 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadbc06b720 0x7fadbc199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 0x7fadbc19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc109210 0x7fadbc19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc10f170 con 0x7fadbc06b720 2024-08-28T20:11:56.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc10eff0 con 0x7fadbc109210 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadc083b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fadbc10f2f0 con 0x7fadbc106670 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 0x7fadbc19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 0x7fadbc19a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34584/0 (socket says 172.21.15.121:34584) 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 -- 172.21.15.121:0/2400591992 learned_addr learned my addr 172.21.15.121:0/2400591992 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadbad9d640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc109210 0x7fadbc19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 -- 172.21.15.121:0/2400591992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc109210 msgr2=0x7fadbc19af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc109210 0x7fadbc19af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 -- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadbc06b720 msgr2=0x7fadbc199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadbc06b720 0x7fadbc199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 -- 172.21.15.121:0/2400591992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc19b760 con 0x7fadbc106670 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadbad9d640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc109210 0x7fadbc19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.056+0000 7fadb9d9b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 0x7fadbc19a3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fadb000b4a0 tx=0x7fadb000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:11:56.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.057+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0014070 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.057+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadbc19ba50 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.057+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb0010ac0 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.057+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0017c30 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.057+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadbc1a2150 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.058+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadbc0ff870 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.059+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7fadb0017070 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.060+0000 7fadab7fe640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fada40b4b30 0x7fada40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.060+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3805+0+0 (secure 0 0 0) 0x7fadb00e3650 con 0x7fadbc106670 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.060+0000 7fadba59c640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fada40b4b30 0x7fada40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.061+0000 7fadba59c640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fada40b4b30 0x7fada40b7040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fadac00a8f0 tx=0x7fadac005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:11:56.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.063+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fadb00ab920 con 0x7fadbc106670 2024-08-28T20:11:56.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:11:56.251+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fadbc0635a0 con 0x7fada40b4b30 2024-08-28T20:11:56.817 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi007 2024-08-28T20:11:56.817 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi007 to 8546M 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: osdmap e28: 5 total, 4 up, 5 in 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:56.818 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:56.819 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:11:56.819 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: osdmap e29: 5 total, 4 up, 5 in 2024-08-28T20:11:56.819 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:56.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi007 2024-08-28T20:11:56.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi007 to 8546M 2024-08-28T20:11:56.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: osdmap e28: 5 total, 4 up, 5 in 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:56.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:56.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:11:56.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: osdmap e29: 5 total, 4 up, 5 in 2024-08-28T20:11:56.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi007 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi007 to 8546M 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: osdmap e28: 5 total, 4 up, 5 in 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:11:57.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:11:57.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:11:57.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:11:57.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:11:57.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: osdmap e29: 5 total, 4 up, 5 in 2024-08-28T20:11:57.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:57.727 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:11:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:11:57.416+0000 7f75384d0640 -1 osd.4 0 waiting for initial osdmap 2024-08-28T20:11:57.728 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:11:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:11:57.423+0000 7f75302c6640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:11:57.924 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:57 smithi121 ceph-mon[25248]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:57.924 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:57 smithi121 ceph-mon[25248]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:57.924 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:57.924 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:57 smithi121 ceph-mon[25248]: from='osd.4 ' entity='osd.4' 2024-08-28T20:11:57.994 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:57 smithi007 ceph-mon[25357]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:57.994 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:57 smithi007 ceph-mon[25357]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:57.994 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:57.994 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:57 smithi007 ceph-mon[25357]: from='osd.4 ' entity='osd.4' 2024-08-28T20:11:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:57 smithi001 ceph-mon[20984]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:11:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:57 smithi001 ceph-mon[20984]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:11:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:57 smithi001 ceph-mon[20984]: from='osd.4 ' entity='osd.4' 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] boot 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: osdmap e30: 5 total, 5 up, 5 in 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/2901584190' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"} : dispatch 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"} : dispatch 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"}]': finished 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: osdmap e31: 6 total, 5 up, 6 in 2024-08-28T20:11:58.985 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:58 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:11:59.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:11:59.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:11:59.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:59.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] boot 2024-08-28T20:11:59.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: osdmap e30: 5 total, 5 up, 5 in 2024-08-28T20:11:59.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:59.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/2901584190' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"} : dispatch 2024-08-28T20:11:59.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"} : dispatch 2024-08-28T20:11:59.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"}]': finished 2024-08-28T20:11:59.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: osdmap e31: 6 total, 5 up, 6 in 2024-08-28T20:11:59.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:58 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:11:59.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:11:59.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:11:59.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:59.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: osd.4 [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] boot 2024-08-28T20:11:59.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: osdmap e30: 5 total, 5 up, 5 in 2024-08-28T20:11:59.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T20:11:59.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/2901584190' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"} : dispatch 2024-08-28T20:11:59.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"} : dispatch 2024-08-28T20:11:59.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "024ef980-246c-45ae-9b35-2ec8c5a58dbd"}]': finished 2024-08-28T20:11:59.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: osdmap e31: 6 total, 5 up, 6 in 2024-08-28T20:11:59.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:58 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:59 smithi007 ceph-mon[25357]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:12:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:11:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/3000739223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:59 smithi001 ceph-mon[20984]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:12:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:11:59 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/3000739223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:59 smithi121 ceph-mon[25248]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-28T20:12:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:11:59 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/3000739223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:01.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:00 smithi001 ceph-mon[20984]: osdmap e32: 6 total, 5 up, 6 in 2024-08-28T20:12:01.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:00 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:00 smithi121 ceph-mon[25248]: osdmap e32: 6 total, 5 up, 6 in 2024-08-28T20:12:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:00 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:01.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:00 smithi007 ceph-mon[25357]: osdmap e32: 6 total, 5 up, 6 in 2024-08-28T20:12:01.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:00 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:02.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:01 smithi001 ceph-mon[20984]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:01 smithi121 ceph-mon[25248]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:01 smithi007 ceph-mon[25357]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:04.114 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:03 smithi121 ceph-mon[25248]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:04.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:03 smithi001 ceph-mon[20984]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:03 smithi007 ceph-mon[25357]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:05 smithi121 ceph-mon[25248]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:05 smithi001 ceph-mon[20984]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:06.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:05 smithi007 ceph-mon[25357]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:08.060 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:07 smithi121 ceph-mon[25248]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:08.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-28T20:12:08.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:07 smithi001 ceph-mon[20984]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-28T20:12:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:07 smithi007 ceph-mon[25357]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-28T20:12:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:08.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:08 smithi121 ceph-mon[25248]: Deploying daemon osd.5 on smithi121 2024-08-28T20:12:09.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:08 smithi001 ceph-mon[20984]: Deploying daemon osd.5 on smithi121 2024-08-28T20:12:09.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:08 smithi007 ceph-mon[25357]: Deploying daemon osd.5 on smithi121 2024-08-28T20:12:10.011 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:09 smithi121 ceph-mon[25248]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:09 smithi001 ceph-mon[20984]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:10.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:09 smithi007 ceph-mon[25357]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:10.958 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:10 smithi121 ceph-mon[25248]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:10 smithi001 ceph-mon[20984]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:11.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:10 smithi007 ceph-mon[25357]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:13.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:13 smithi121 ceph-mon[25248]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:13.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:13.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:13.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:13 smithi001 ceph-mon[20984]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:13 smithi007 ceph-mon[25357]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:15 smithi001 ceph-mon[20984]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:15 smithi121 ceph-mon[25248]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:15 smithi007 ceph-mon[25357]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:16.450 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 5 on host 'smithi121' 2024-08-28T20:12:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.448+0000 7fadab7fe640 1 -- 172.21.15.121:0/2400591992 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fadbc0635a0 con 0x7fada40b4b30 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fada40b4b30 msgr2=0x7fada40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fada40b4b30 0x7fada40b7040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fadac00a8f0 tx=0x7fadac005bf0 comp rx=0 tx=0).stop 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 msgr2=0x7fadbc19a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 0x7fadbc19a3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fadb000b4a0 tx=0x7fadb000b960 comp rx=0 tx=0).stop 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 shutdown_connections 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fada40b4b30 0x7fada40b7040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fadbc109210 0x7fadbc19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadbc106670 0x7fadbc19a3a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 --2- 172.21.15.121:0/2400591992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadbc06b720 0x7fadbc199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:16.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 >> 172.21.15.121:0/2400591992 conn(0x7fadbc0fdd50 msgr2=0x7fadbc104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:12:16.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 shutdown_connections 2024-08-28T20:12:16.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:12:16.451+0000 7fadc083b640 1 -- 172.21.15.121:0/2400591992 wait complete. 2024-08-28T20:12:17.097 DEBUG:teuthology.orchestra.run.smithi121:osd.5> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.5.service 2024-08-28T20:12:17.099 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-08-28T20:12:17.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-28T20:12:17.407 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:17 smithi121 ceph-mon[25248]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:17.407 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:17.407 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:17.407 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:17 smithi001 ceph-mon[20984]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:17.483 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:12:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:17 smithi007 ceph-mon[25357]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:18.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:12:18 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:12:18.369+0000 7f3ad1901640 -1 osd.5 0 log_to_monitors true 2024-08-28T20:12:19.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:19 smithi001 ceph-mon[20984]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:19.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:19 smithi001 ceph-mon[20984]: from='osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T20:12:19.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:19 smithi001 ceph-mon[20984]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T20:12:19.465 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:19 smithi121 ceph-mon[25248]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:19.465 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:19 smithi121 ceph-mon[25248]: from='osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T20:12:19.466 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:19 smithi121 ceph-mon[25248]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T20:12:19.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:19 smithi007 ceph-mon[25357]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:19.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:19 smithi007 ceph-mon[25357]: from='osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T20:12:19.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:19 smithi007 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: osdmap e33: 6 total, 5 up, 6 in 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi121 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi121 to 8543M 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:20.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:20.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:12:20.196+0000 7f3acd883640 -1 osd.5 0 waiting for initial osdmap 2024-08-28T20:12:20.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:12:20.205+0000 7f3ac9681640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:12:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-28T20:12:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: osdmap e33: 6 total, 5 up, 6 in 2024-08-28T20:12:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi121 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi121 to 8543M 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:20.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-28T20:12:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: osdmap e33: 6 total, 5 up, 6 in 2024-08-28T20:12:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:12:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi121 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi121 to 8543M 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:20.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:20.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:12:20.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-08-28T20:12:21.184 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:12:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:21 smithi001 ceph-mon[20984]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:21 smithi001 ceph-mon[20984]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:12:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:21 smithi001 ceph-mon[20984]: osdmap e34: 6 total, 5 up, 6 in 2024-08-28T20:12:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:21.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:21 smithi121 ceph-mon[25248]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:21.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:21 smithi121 ceph-mon[25248]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:12:21.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:21 smithi121 ceph-mon[25248]: osdmap e34: 6 total, 5 up, 6 in 2024-08-28T20:12:21.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:21.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:21 smithi007 ceph-mon[25357]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:21 smithi007 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:12:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:21 smithi007 ceph-mon[25357]: osdmap e34: 6 total, 5 up, 6 in 2024-08-28T20:12:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 -- 172.21.15.1:0/1293731351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80104580 msgr2=0x7f4f80104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 --2- 172.21.15.1:0/1293731351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80104580 0x7f4f80104990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009900 tx=0x7f4f6802a480 comp rx=0 tx=0).stop 2024-08-28T20:12:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 -- 172.21.15.1:0/1293731351 shutdown_connections 2024-08-28T20:12:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 --2- 172.21.15.1:0/1293731351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f80104580 0x7f4f80104990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 --2- 172.21.15.1:0/1293731351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104f20 0x7f4f8010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:21.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 --2- 172.21.15.1:0/1293731351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f801034f0 0x7f4f80103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 -- 172.21.15.1:0/1293731351 >> 172.21.15.1:0/1293731351 conn(0x7f4f800fee60 msgr2=0x7f4f80101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:12:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 -- 172.21.15.1:0/1293731351 shutdown_connections 2024-08-28T20:12:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.778+0000 7f4f87800640 1 -- 172.21.15.1:0/1293731351 wait complete. 2024-08-28T20:12:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.779+0000 7f4f87800640 1 Processor -- start 2024-08-28T20:12:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 -- start start 2024-08-28T20:12:21.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f801034f0 0x7f4f8019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104580 0x7f4f8019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f80104f20 0x7f4f8019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8010f170 con 0x7f4f801034f0 2024-08-28T20:12:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8010eff0 con 0x7f4f80104580 2024-08-28T20:12:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.780+0000 7f4f87800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8010f2f0 con 0x7f4f80104f20 2024-08-28T20:12:21.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f801034f0 0x7f4f8019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f84e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f801034f0 0x7f4f8019bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36164/0 (socket says 172.21.15.1:36164) 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f84e00640 1 -- 172.21.15.1:0/1610864853 learned_addr learned my addr 172.21.15.1:0/1610864853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f77e00640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104580 0x7f4f8019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f85800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f80104f20 0x7f4f8019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f77e00640 1 -- 172.21.15.1:0/1610864853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f80104f20 msgr2=0x7f4f8019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f77e00640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f80104f20 0x7f4f8019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f77e00640 1 -- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f801034f0 msgr2=0x7f4f8019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f77e00640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f801034f0 0x7f4f8019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.781+0000 7f4f77e00640 1 -- 172.21.15.1:0/1610864853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8019d980 con 0x7f4f80104580 2024-08-28T20:12:21.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.782+0000 7f4f77e00640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104580 0x7f4f8019c5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f6802aa70 tx=0x7f4f68003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:12:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.782+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6803f070 con 0x7f4f80104580 2024-08-28T20:12:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.782+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8019dc10 con 0x7f4f80104580 2024-08-28T20:12:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.782+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f68031c50 con 0x7f4f80104580 2024-08-28T20:12:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.782+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68035030 con 0x7f4f80104580 2024-08-28T20:12:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.782+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f801a41a0 con 0x7f4f80104580 2024-08-28T20:12:21.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.783+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f801a44c0 con 0x7f4f80104580 2024-08-28T20:12:21.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.786+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f4f68042070 con 0x7f4f80104580 2024-08-28T20:12:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.787+0000 7f4f7e000640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f640b4bb0 0x7f4f640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.787+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4566+0+0 (secure 0 0 0) 0x7f4f68105340 con 0x7f4f80104580 2024-08-28T20:12:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.787+0000 7f4f84e00640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f640b4bb0 0x7f4f640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.788+0000 7f4f84e00640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f640b4bb0 0x7f4f640b70c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4f70005fd0 tx=0x7f4f7000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:12:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.789+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f680ccc20 con 0x7f4f80104580 2024-08-28T20:12:21.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:21.995+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4f80076ab0 con 0x7f4f640b4bb0 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] boot 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: osdmap e35: 6 total, 6 up, 6 in 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:12:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:12:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:12:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] boot 2024-08-28T20:12:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: osdmap e35: 6 total, 6 up, 6 in 2024-08-28T20:12:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:12:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:12:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: osd.5 [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] boot 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: osdmap e35: 6 total, 6 up, 6 in 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:12:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:12:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:23.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:23 smithi001 ceph-mon[20984]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:12:23.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:23 smithi001 ceph-mon[20984]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:23.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:23 smithi001 ceph-mon[20984]: osdmap e36: 6 total, 6 up, 6 in 2024-08-28T20:12:23.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:23 smithi121 ceph-mon[25248]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:12:23.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:23 smithi121 ceph-mon[25248]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:23.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:23 smithi121 ceph-mon[25248]: osdmap e36: 6 total, 6 up, 6 in 2024-08-28T20:12:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:23 smithi007 ceph-mon[25357]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:12:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:23 smithi007 ceph-mon[25357]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-28T20:12:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:23 smithi007 ceph-mon[25357]: osdmap e36: 6 total, 6 up, 6 in 2024-08-28T20:12:24.292 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:24 smithi001 ceph-mon[20984]: osdmap e37: 6 total, 6 up, 6 in 2024-08-28T20:12:24.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:24 smithi121 ceph-mon[25248]: osdmap e37: 6 total, 6 up, 6 in 2024-08-28T20:12:24.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:24 smithi007 ceph-mon[25357]: osdmap e37: 6 total, 6 up, 6 in 2024-08-28T20:12:25.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:25 smithi001 ceph-mon[20984]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:25.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:25 smithi121 ceph-mon[25248]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:25.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:25 smithi007 ceph-mon[25357]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/282535123' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "38aa1326-0c57-4925-a4c6-706fa7eb6c40"} : dispatch 2024-08-28T20:12:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/282535123' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38aa1326-0c57-4925-a4c6-706fa7eb6c40"}]': finished 2024-08-28T20:12:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:26 smithi001 ceph-mon[20984]: osdmap e38: 7 total, 6 up, 7 in 2024-08-28T20:12:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:26.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1728447523' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/282535123' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "38aa1326-0c57-4925-a4c6-706fa7eb6c40"} : dispatch 2024-08-28T20:12:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/282535123' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38aa1326-0c57-4925-a4c6-706fa7eb6c40"}]': finished 2024-08-28T20:12:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:26 smithi121 ceph-mon[25248]: osdmap e38: 7 total, 6 up, 7 in 2024-08-28T20:12:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1728447523' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/282535123' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "38aa1326-0c57-4925-a4c6-706fa7eb6c40"} : dispatch 2024-08-28T20:12:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/282535123' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38aa1326-0c57-4925-a4c6-706fa7eb6c40"}]': finished 2024-08-28T20:12:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:26 smithi007 ceph-mon[25357]: osdmap e38: 7 total, 6 up, 7 in 2024-08-28T20:12:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1728447523' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:27 smithi001 ceph-mon[20984]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-28T20:12:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:27 smithi121 ceph-mon[25248]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-28T20:12:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:27 smithi007 ceph-mon[25357]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-28T20:12:29.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:29 smithi001 ceph-mon[20984]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-28T20:12:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:29 smithi121 ceph-mon[25248]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-28T20:12:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:29 smithi007 ceph-mon[25357]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-28T20:12:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:31 smithi001 ceph-mon[20984]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-28T20:12:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:31 smithi121 ceph-mon[25248]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-28T20:12:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:31 smithi007 ceph-mon[25357]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-28T20:12:33.641 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:33 smithi001 ceph-mon[20984]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-28T20:12:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:33 smithi121 ceph-mon[25248]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-28T20:12:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:33 smithi007 ceph-mon[25357]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-28T20:12:35.629 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:35 smithi001 ceph-mon[20984]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:12:35.629 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-28T20:12:35.629 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:35.629 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:35 smithi001 ceph-mon[20984]: Deploying daemon osd.6 on smithi001 2024-08-28T20:12:35.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:35 smithi121 ceph-mon[25248]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:12:35.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-28T20:12:35.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:35.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:35 smithi121 ceph-mon[25248]: Deploying daemon osd.6 on smithi001 2024-08-28T20:12:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:35 smithi007 ceph-mon[25357]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:12:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-28T20:12:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:35 smithi007 ceph-mon[25357]: Deploying daemon osd.6 on smithi001 2024-08-28T20:12:37.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:37 smithi001 ceph-mon[20984]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:37 smithi121 ceph-mon[25248]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:37.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:37 smithi007 ceph-mon[25357]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:39.517 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:39 smithi001 ceph-mon[20984]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:39.711 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:39 smithi121 ceph-mon[25248]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:39 smithi007 ceph-mon[25357]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:41.571 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:41 smithi001 ceph-mon[20984]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:41 smithi121 ceph-mon[25248]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:41.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:41 smithi007 ceph-mon[25357]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:42.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:42.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:42.708 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:42.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:42.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:42.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:42.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:42.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:42.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:43 smithi001 ceph-mon[20984]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:43 smithi007 ceph-mon[25357]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:43 smithi121 ceph-mon[25248]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:45 smithi007 ceph-mon[25357]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:45 smithi001 ceph-mon[20984]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:46.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:46.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:46.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:45 smithi121 ceph-mon[25248]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:46.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:46.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:46.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:46.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:47.010 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-08-28T20:12:47.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.008+0000 7f4f7e000640 1 -- 172.21.15.1:0/1610864853 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f80076ab0 con 0x7f4f640b4bb0 2024-08-28T20:12:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f640b4bb0 msgr2=0x7f4f640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f640b4bb0 0x7f4f640b70c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4f70005fd0 tx=0x7f4f7000b4a0 comp rx=0 tx=0).stop 2024-08-28T20:12:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104580 msgr2=0x7f4f8019c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104580 0x7f4f8019c5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f6802aa70 tx=0x7f4f68003c10 comp rx=0 tx=0).stop 2024-08-28T20:12:47.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 shutdown_connections 2024-08-28T20:12:47.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f640b4bb0 0x7f4f640b70c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:47.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f80104f20 0x7f4f8019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:47.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f80104580 0x7f4f8019c5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:47.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 --2- 172.21.15.1:0/1610864853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f801034f0 0x7f4f8019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:47.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 >> 172.21.15.1:0/1610864853 conn(0x7f4f800fee60 msgr2=0x7f4f80075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:12:47.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 shutdown_connections 2024-08-28T20:12:47.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:12:47.011+0000 7f4f87800640 1 -- 172.21.15.1:0/1610864853 wait complete. 2024-08-28T20:12:47.730 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.6.service 2024-08-28T20:12:47.734 INFO:tasks.cephadm:Deploying osd.7 on smithi007 with /dev/vg_nvme/lv_2... 2024-08-28T20:12:47.734 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-28T20:12:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:47 smithi001 ceph-mon[20984]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:47 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:47 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:47 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:12:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:47 smithi007 ceph-mon[25357]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:47 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:47 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:47 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:47 smithi121 ceph-mon[25248]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:47 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:12:48.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:47 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:48.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:47 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:48.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:48 smithi001 ceph-mon[20984]: from='osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T20:12:48.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:48 smithi001 ceph-mon[20984]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T20:12:49.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:48 smithi007 ceph-mon[25357]: from='osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T20:12:49.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:48 smithi007 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T20:12:49.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:48 smithi121 ceph-mon[25248]: from='osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T20:12:49.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:48 smithi121 ceph-mon[25248]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T20:12:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:49 smithi001 ceph-mon[20984]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:49.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:49 smithi001 ceph-mon[20984]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-28T20:12:49.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:49 smithi001 ceph-mon[20984]: osdmap e39: 7 total, 6 up, 7 in 2024-08-28T20:12:49.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:49 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:49.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:49 smithi001 ceph-mon[20984]: from='osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:12:49.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:49 smithi001 ceph-mon[20984]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:12:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:49 smithi007 ceph-mon[25357]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:49 smithi007 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-28T20:12:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:49 smithi007 ceph-mon[25357]: osdmap e39: 7 total, 6 up, 7 in 2024-08-28T20:12:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:49 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:49 smithi007 ceph-mon[25357]: from='osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:12:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:49 smithi007 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:12:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:49 smithi121 ceph-mon[25248]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:49 smithi121 ceph-mon[25248]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-28T20:12:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:49 smithi121 ceph-mon[25248]: osdmap e39: 7 total, 6 up, 7 in 2024-08-28T20:12:50.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:49 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:50.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:49 smithi121 ceph-mon[25248]: from='osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:12:50.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:49 smithi121 ceph-mon[25248]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:12:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:12:50.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-08-28T20:12:50.702 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:12:51.011 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:50 smithi007 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:12:51.011 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:50 smithi007 ceph-mon[25357]: osdmap e40: 7 total, 6 up, 7 in 2024-08-28T20:12:51.012 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.012 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 -- 172.21.15.7:0/4140489594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 msgr2=0x7f793c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 --2- 172.21.15.7:0/4140489594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c10b960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7934009ca0 tx=0x7f793402a950 comp rx=0 tx=0).stop 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 -- 172.21.15.7:0/4140489594 shutdown_connections 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 --2- 172.21.15.7:0/4140489594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c10b960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 --2- 172.21.15.7:0/4140489594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c104620 0x7f793c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 --2- 172.21.15.7:0/4140489594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793c103590 0x7f793c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 -- 172.21.15.7:0/4140489594 >> 172.21.15.7:0/4140489594 conn(0x7f793c0fef20 msgr2=0x7f793c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 -- 172.21.15.7:0/4140489594 shutdown_connections 2024-08-28T20:12:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.104+0000 7f79417c0640 1 -- 172.21.15.7:0/4140489594 wait complete. 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 Processor -- start 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 -- start start 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c103590 0x7f793c076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793c104620 0x7f793c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f793c10f150 con 0x7f793c104620 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f793c10efd0 con 0x7f793c104fc0 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f79417c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f793c10f2d0 con 0x7f793c103590 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f793b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f793b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52656/0 (socket says 172.21.15.7:52656) 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f793b7fe640 1 -- 172.21.15.7:0/1352629441 learned_addr learned my addr 172.21.15.7:0/1352629441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-28T20:12:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f793affd640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c103590 0x7f793c076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.105+0000 7f7933fff640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793c104620 0x7f793c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793b7fe640 1 -- 172.21.15.7:0/1352629441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c103590 msgr2=0x7f793c076be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793b7fe640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c103590 0x7f793c076be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793b7fe640 1 -- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793c104620 msgr2=0x7f793c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793b7fe640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793c104620 0x7f793c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793b7fe640 1 -- 172.21.15.7:0/1352629441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c076060 con 0x7f793c104fc0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793affd640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c103590 0x7f793c076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f793b7fe640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c0759f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7934006010 tx=0x7f793402fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934034040 con 0x7f793c104fc0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c0762f0 con 0x7f793c104fc0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79340308f0 con 0x7f793c104fc0 2024-08-28T20:12:51.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934039450 con 0x7f793c104fc0 2024-08-28T20:12:51.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.106+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c1a40d0 con 0x7f793c104fc0 2024-08-28T20:12:51.115 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:50 smithi001 ceph-mon[20984]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:12:51.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:50 smithi001 ceph-mon[20984]: osdmap e40: 7 total, 6 up, 7 in 2024-08-28T20:12:51.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.116 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:12:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:12:50.842+0000 7fd737000640 -1 osd.6 0 waiting for initial osdmap 2024-08-28T20:12:51.116 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:12:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:12:50.865+0000 7fd72d000640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.108+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c10a750 con 0x7f793c104fc0 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.109+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f7934037020 con 0x7f793c104fc0 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.110+0000 7f7938ff9640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f79280b4b30 0x7f79280b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.110+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4685+0+0 (secure 0 0 0) 0x7f79341056c0 con 0x7f793c104fc0 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.110+0000 7f793affd640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f79280b4b30 0x7f79280b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.111+0000 7f793affd640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f79280b4b30 0x7f79280b7040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f792c0058c0 tx=0x7f792c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:12:51.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.113+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f79340cd580 con 0x7f793c104fc0 2024-08-28T20:12:51.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:50 smithi121 ceph-mon[25248]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:12:51.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:50 smithi121 ceph-mon[25248]: osdmap e40: 7 total, 6 up, 7 in 2024-08-28T20:12:51.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:12:51.341+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f793c0635a0 con 0x7f79280b4b30 2024-08-28T20:12:51.977 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:12:51.977 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='osd.6 ' entity='osd.6' 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:51.978 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:51.979 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:51.979 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:51.979 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.059 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:12:52.059 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:12:52.059 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:52.059 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:52.059 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='osd.6 ' entity='osd.6' 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:52.060 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='osd.6 ' entity='osd.6' 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:12:52.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:12:52.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:12:52.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:12:52.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:12:52.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi001 2024-08-28T20:12:52.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi001 to 5698M 2024-08-28T20:12:52.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:52.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] boot 2024-08-28T20:12:52.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: osdmap e41: 7 total, 7 up, 7 in 2024-08-28T20:12:52.845 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:12:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi001 2024-08-28T20:12:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi001 to 5698M 2024-08-28T20:12:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:53.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] boot 2024-08-28T20:12:53.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: osdmap e41: 7 total, 7 up, 7 in 2024-08-28T20:12:53.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:53.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:12:53.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi001 2024-08-28T20:12:53.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi001 to 5698M 2024-08-28T20:12:53.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:53.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: osd.6 [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] boot 2024-08-28T20:12:53.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: osdmap e41: 7 total, 7 up, 7 in 2024-08-28T20:12:53.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T20:12:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:53 smithi007 ceph-mon[25357]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:53 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/2800387627' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"} : dispatch 2024-08-28T20:12:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:53 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"} : dispatch 2024-08-28T20:12:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:53 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"}]': finished 2024-08-28T20:12:54.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:53 smithi007 ceph-mon[25357]: osdmap e42: 8 total, 7 up, 8 in 2024-08-28T20:12:54.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:53 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:12:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:53 smithi001 ceph-mon[20984]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:53 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/2800387627' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"} : dispatch 2024-08-28T20:12:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:53 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"} : dispatch 2024-08-28T20:12:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:53 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"}]': finished 2024-08-28T20:12:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:53 smithi001 ceph-mon[20984]: osdmap e42: 8 total, 7 up, 8 in 2024-08-28T20:12:54.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:53 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:12:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:53 smithi121 ceph-mon[25248]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-28T20:12:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:53 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/2800387627' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"} : dispatch 2024-08-28T20:12:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:53 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"} : dispatch 2024-08-28T20:12:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:53 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cfe4d05-a623-481c-9463-e8571c13f7d7"}]': finished 2024-08-28T20:12:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:53 smithi121 ceph-mon[25248]: osdmap e42: 8 total, 7 up, 8 in 2024-08-28T20:12:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:53 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:12:55.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:54 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/513997584' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:55.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:54 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/513997584' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:55.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:54 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/513997584' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:12:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:55 smithi007 ceph-mon[25357]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:12:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:55 smithi001 ceph-mon[20984]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:12:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:55 smithi121 ceph-mon[25248]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:12:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:57 smithi007 ceph-mon[25357]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:12:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:57 smithi001 ceph-mon[20984]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:12:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:57 smithi121 ceph-mon[25248]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:12:59 smithi007 ceph-mon[25357]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:12:59 smithi001 ceph-mon[20984]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:12:59 smithi121 ceph-mon[25248]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:01 smithi007 ceph-mon[25357]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:02.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:01 smithi001 ceph-mon[20984]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:01 smithi121 ceph-mon[25248]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:02.797 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-28T20:13:02.798 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:02 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:03.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-28T20:13:03.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:02 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:03.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-28T20:13:03.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:02 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:03.884 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:03 smithi007 ceph-mon[25357]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:03.884 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:03 smithi007 ceph-mon[25357]: Deploying daemon osd.7 on smithi007 2024-08-28T20:13:04.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:03 smithi001 ceph-mon[20984]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:04.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:03 smithi001 ceph-mon[20984]: Deploying daemon osd.7 on smithi007 2024-08-28T20:13:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:03 smithi121 ceph-mon[25248]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:03 smithi121 ceph-mon[25248]: Deploying daemon osd.7 on smithi007 2024-08-28T20:13:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:05 smithi007 ceph-mon[25357]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:05 smithi001 ceph-mon[20984]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:05 smithi121 ceph-mon[25248]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:07 smithi007 ceph-mon[25357]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:07 smithi001 ceph-mon[20984]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:07 smithi121 ceph-mon[25248]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:09.920 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:09 smithi007 ceph-mon[25357]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:09.962 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 7 on host 'smithi007' 2024-08-28T20:13:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.960+0000 7f7938ff9640 1 -- 172.21.15.7:0/1352629441 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f793c0635a0 con 0x7f79280b4b30 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f79280b4b30 msgr2=0x7f79280b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f79280b4b30 0x7f79280b7040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f792c0058c0 tx=0x7f792c005850 comp rx=0 tx=0).stop 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 msgr2=0x7f793c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c0759f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7934006010 tx=0x7f793402fc00 comp rx=0 tx=0).stop 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 shutdown_connections 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f79280b4b30 0x7f79280b7040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793c104620 0x7f793c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f793c104fc0 0x7f793c0759f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 --2- 172.21.15.7:0/1352629441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f793c103590 0x7f793c076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 >> 172.21.15.7:0/1352629441 conn(0x7f793c0fef20 msgr2=0x7f793c107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:13:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 shutdown_connections 2024-08-28T20:13:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:13:09.963+0000 7f79417c0640 1 -- 172.21.15.7:0/1352629441 wait complete. 2024-08-28T20:13:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:09 smithi001 ceph-mon[20984]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:09 smithi121 ceph-mon[25248]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:10.477 DEBUG:teuthology.orchestra.run.smithi007:osd.7> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.7.service 2024-08-28T20:13:10.479 INFO:tasks.cephadm:Deploying osd.8 on smithi121 with /dev/vg_nvme/lv_2... 2024-08-28T20:13:10.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-28T20:13:10.732 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:13:11.172 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:10 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.172 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:10 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.172 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:10 smithi121 ceph-mon[25248]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:11.172 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:10 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.172 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:10 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:10 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:10 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:10 smithi001 ceph-mon[20984]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:10 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:10 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.243 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:10 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.243 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:10 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.244 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:10 smithi007 ceph-mon[25357]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:11.244 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:10 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:11.244 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:10 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:12.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:13:12 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:13:12.633+0000 7f46f406a640 -1 osd.7 0 log_to_monitors true 2024-08-28T20:13:13.111 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:13:13.140 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_2 2024-08-28T20:13:13.187 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:13 smithi007 ceph-mon[25357]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:13.187 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:13 smithi007 ceph-mon[25357]: from='osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T20:13:13.187 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:13 smithi007 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T20:13:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:13:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:13 smithi001 ceph-mon[20984]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:13 smithi001 ceph-mon[20984]: from='osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T20:13:13.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:13 smithi001 ceph-mon[20984]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T20:13:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:13 smithi121 ceph-mon[25248]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:13 smithi121 ceph-mon[25248]: from='osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T20:13:13.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:13 smithi121 ceph-mon[25248]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T20:13:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 -- 172.21.15.121:0/2276680985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f219006b720 msgr2=0x7f2190106130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 --2- 172.21.15.121:0/2276680985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f219006b720 0x7f2190106130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2180009900 tx=0x7f218002a410 comp rx=0 tx=0).stop 2024-08-28T20:13:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 -- 172.21.15.121:0/2276680985 shutdown_connections 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 --2- 172.21.15.121:0/2276680985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2190109210 0x7f219010b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 --2- 172.21.15.121:0/2276680985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2190106670 0x7f2190108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 --2- 172.21.15.121:0/2276680985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f219006b720 0x7f2190106130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 -- 172.21.15.121:0/2276680985 >> 172.21.15.121:0/2276680985 conn(0x7f21900fdd50 msgr2=0x7f2190100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 -- 172.21.15.121:0/2276680985 shutdown_connections 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.877+0000 7f21969a0640 1 -- 172.21.15.121:0/2276680985 wait complete. 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 Processor -- start 2024-08-28T20:13:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 -- start start 2024-08-28T20:13:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219006b720 0x7f2190199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2190106670 0x7f219019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 0x7f219019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f219010f180 con 0x7f2190106670 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f219010f000 con 0x7f219006b720 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f21969a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f219010f300 con 0x7f2190109210 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f2194f3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 0x7f219019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f218ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219006b720 0x7f2190199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f2194f3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 0x7f219019af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41420/0 (socket says 172.21.15.121:41420) 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.878+0000 7f2194f3d640 1 -- 172.21.15.121:0/534647322 learned_addr learned my addr 172.21.15.121:0/534647322 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218f7fe640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2190106670 0x7f219019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218ffff640 1 -- 172.21.15.121:0/534647322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 msgr2=0x7f219019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218ffff640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 0x7f219019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218ffff640 1 -- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2190106670 msgr2=0x7f219019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218ffff640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2190106670 0x7f219019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218ffff640 1 -- 172.21.15.121:0/534647322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219019b780 con 0x7f219006b720 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f2194f3d640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 0x7f219019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218ffff640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219006b720 0x7f2190199d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2180006010 tx=0x7f2180031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218003f070 con 0x7f219006b720 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219019ba10 con 0x7f219006b720 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2180003ca0 con 0x7f219006b720 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180035070 con 0x7f219006b720 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.879+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21901a2170 con 0x7f219006b720 2024-08-28T20:13:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.880+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2190106ac0 con 0x7f219006b720 2024-08-28T20:13:13.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.882+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f218003b580 con 0x7f219006b720 2024-08-28T20:13:13.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.882+0000 7f218d7fa640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f217c0b4b30 0x7f217c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:13.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.883+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5101+0+0 (secure 0 0 0) 0x7f21801050d0 con 0x7f219006b720 2024-08-28T20:13:13.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.883+0000 7f218f7fe640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f217c0b4b30 0x7f217c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:13.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.883+0000 7f218f7fe640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f217c0b4b30 0x7f217c0b7040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2178005d00 tx=0x7f217800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:13:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:13.886+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f218003be20 con 0x7f219006b720 2024-08-28T20:13:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:14.071+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f219002e7a0 con 0x7f217c0b4b30 2024-08-28T20:13:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-28T20:13:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:13:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: osdmap e43: 8 total, 7 up, 8 in 2024-08-28T20:13:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:13:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi007 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi007 to 5697M 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:14.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: osdmap e43: 8 total, 7 up, 8 in 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi007 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi007 to 5697M 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:14.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: osdmap e43: 8 total, 7 up, 8 in 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi007 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi007 to 5697M 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:14.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:15.191 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:13:14.881+0000 7f46effec640 -1 osd.7 0 waiting for initial osdmap 2024-08-28T20:13:15.191 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:13:14 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:13:14.893+0000 7f46e7de2640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: osdmap e44: 8 total, 7 up, 8 in 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:15.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:15 smithi001 ceph-mon[20984]: from='osd.7 ' entity='osd.7' 2024-08-28T20:13:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:13:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:13:15.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: osdmap e44: 8 total, 7 up, 8 in 2024-08-28T20:13:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:15 smithi121 ceph-mon[25248]: from='osd.7 ' entity='osd.7' 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: osdmap e44: 8 total, 7 up, 8 in 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:15 smithi007 ceph-mon[25357]: from='osd.7 ' entity='osd.7' 2024-08-28T20:13:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:16 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:13:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:16 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:13:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:16 smithi001 ceph-mon[20984]: osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] boot 2024-08-28T20:13:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:16 smithi001 ceph-mon[20984]: osdmap e45: 8 total, 8 up, 8 in 2024-08-28T20:13:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:16 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:16 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:13:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:16 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:13:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:16 smithi121 ceph-mon[25248]: osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] boot 2024-08-28T20:13:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:16 smithi121 ceph-mon[25248]: osdmap e45: 8 total, 8 up, 8 in 2024-08-28T20:13:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:16 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:16 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:13:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:16 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:13:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:16 smithi007 ceph-mon[25357]: osd.7 [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] boot 2024-08-28T20:13:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:16 smithi007 ceph-mon[25357]: osdmap e45: 8 total, 8 up, 8 in 2024-08-28T20:13:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:16 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T20:13:17.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: osdmap e46: 8 total, 8 up, 8 in 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/1119606969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"} : dispatch 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"} : dispatch 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"}]': finished 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: osdmap e47: 9 total, 8 up, 9 in 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:17.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:17 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/4046569901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:13:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: osdmap e46: 8 total, 8 up, 8 in 2024-08-28T20:13:17.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/1119606969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"} : dispatch 2024-08-28T20:13:17.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"} : dispatch 2024-08-28T20:13:17.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"}]': finished 2024-08-28T20:13:17.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: osdmap e47: 9 total, 8 up, 9 in 2024-08-28T20:13:17.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:17.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:17 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/4046569901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: osdmap e46: 8 total, 8 up, 8 in 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/1119606969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"} : dispatch 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"} : dispatch 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "817fb875-66b9-428f-abcd-cd62e49c6f81"}]': finished 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: osdmap e47: 9 total, 8 up, 9 in 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:17 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/4046569901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:13:19.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:19 smithi001 ceph-mon[20984]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:19.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:19 smithi121 ceph-mon[25248]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:19.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:19 smithi007 ceph-mon[25357]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:21.471 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:21 smithi121 ceph-mon[25248]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:21 smithi001 ceph-mon[20984]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:21 smithi007 ceph-mon[25357]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:23.389 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:23 smithi121 ceph-mon[25248]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-28T20:13:23.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:23 smithi001 ceph-mon[20984]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-28T20:13:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:23 smithi007 ceph-mon[25357]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-28T20:13:25.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:25 smithi001 ceph-mon[20984]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:13:25.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-28T20:13:25.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:25.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:25 smithi121 ceph-mon[25248]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:13:25.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-28T20:13:25.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:25.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:25 smithi007 ceph-mon[25357]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:13:25.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-28T20:13:25.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:26 smithi007 ceph-mon[25357]: Deploying daemon osd.8 on smithi121 2024-08-28T20:13:26.586 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:26 smithi121 ceph-mon[25248]: Deploying daemon osd.8 on smithi121 2024-08-28T20:13:26.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:26 smithi001 ceph-mon[20984]: Deploying daemon osd.8 on smithi121 2024-08-28T20:13:27.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:27 smithi007 ceph-mon[25357]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:13:27.586 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:27 smithi121 ceph-mon[25248]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:13:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:27 smithi001 ceph-mon[20984]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:13:29.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:29 smithi121 ceph-mon[25248]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-28T20:13:29.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:29 smithi007 ceph-mon[25357]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-28T20:13:29.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:29 smithi001 ceph-mon[20984]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-28T20:13:31.383 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:31 smithi121 ceph-mon[25248]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:13:31.383 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:31.383 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:31.383 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:31.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:31 smithi007 ceph-mon[25357]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:13:31.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:31.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:31.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:31 smithi001 ceph-mon[20984]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:13:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:33 smithi121 ceph-mon[25248]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:13:33.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:33.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:33.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:33 smithi007 ceph-mon[25357]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:13:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.678+0000 7f218d7fa640 1 -- 172.21.15.121:0/534647322 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f219002e7a0 con 0x7f217c0b4b30 2024-08-28T20:13:33.680 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 8 on host 'smithi121' 2024-08-28T20:13:33.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f217c0b4b30 msgr2=0x7f217c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:33.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f217c0b4b30 0x7f217c0b7040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2178005d00 tx=0x7f217800b410 comp rx=0 tx=0).stop 2024-08-28T20:13:33.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219006b720 msgr2=0x7f2190199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:33.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219006b720 0x7f2190199d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2180006010 tx=0x7f2180031a50 comp rx=0 tx=0).stop 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 shutdown_connections 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f217c0b4b30 0x7f217c0b7040 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2190106670 0x7f219019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2190109210 0x7f219019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.680+0000 7f21969a0640 1 --2- 172.21.15.121:0/534647322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f219006b720 0x7f2190199d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.681+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 >> 172.21.15.121:0/534647322 conn(0x7f21900fdd50 msgr2=0x7f2190104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.681+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 shutdown_connections 2024-08-28T20:13:33.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:13:33.681+0000 7f21969a0640 1 -- 172.21.15.121:0/534647322 wait complete. 2024-08-28T20:13:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:33 smithi001 ceph-mon[20984]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:13:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:34.282 DEBUG:teuthology.orchestra.run.smithi121:osd.8> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.8.service 2024-08-28T20:13:34.284 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-08-28T20:13:34.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-28T20:13:34.511 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:34.511 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:34.511 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:34.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:34.668 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:13:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:13:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:34.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:35 smithi121 ceph-mon[25248]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:35.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:35 smithi001 ceph-mon[20984]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:36.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:35 smithi007 ceph-mon[25357]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:36.229 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:13:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:13:35.865+0000 7fe70e089640 -1 osd.8 0 log_to_monitors true 2024-08-28T20:13:36.952 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:36 smithi001 ceph-mon[20984]: from='osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T20:13:36.952 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:36 smithi001 ceph-mon[20984]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T20:13:36.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:36 smithi121 ceph-mon[25248]: from='osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T20:13:36.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:36 smithi121 ceph-mon[25248]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T20:13:37.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:36 smithi007 ceph-mon[25357]: from='osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T20:13:37.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:36 smithi007 ceph-mon[25357]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T20:13:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: osdmap e48: 9 total, 8 up, 9 in 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:37.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:37.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:13:37.697+0000 7fe70a00b640 -1 osd.8 0 waiting for initial osdmap 2024-08-28T20:13:37.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:13:37.709+0000 7fe705e09640 -1 osd.8 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: osdmap e48: 9 total, 8 up, 9 in 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:37.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:37.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:37.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:37.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: osdmap e48: 9 total, 8 up, 9 in 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:38.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:38.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:13:38.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:38.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:38.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:13:38.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:13:38.147 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:13:38.191 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-08-28T20:13:38.577 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi121 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi121 to 5695M 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: osdmap e49: 9 total, 8 up, 9 in 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] boot 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: osdmap e50: 9 total, 9 up, 9 in 2024-08-28T20:13:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:38.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi121 2024-08-28T20:13:38.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi121 to 5695M 2024-08-28T20:13:38.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:13:38.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: osdmap e49: 9 total, 8 up, 9 in 2024-08-28T20:13:38.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:38.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:38.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] boot 2024-08-28T20:13:38.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: osdmap e50: 9 total, 9 up, 9 in 2024-08-28T20:13:38.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi121 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi121 to 5695M 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: osdmap e49: 9 total, 8 up, 9 in 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: osd.8 [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] boot 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: osdmap e50: 9 total, 9 up, 9 in 2024-08-28T20:13:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T20:13:39.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 -- 172.21.15.1:0/377426392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 msgr2=0x7f15d8105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:39.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 --2- 172.21.15.1:0/377426392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d8105b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009860 tx=0x7f15c802a3d0 comp rx=0 tx=0).stop 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 -- 172.21.15.1:0/377426392 shutdown_connections 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 --2- 172.21.15.1:0/377426392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15d8107140 0x7f15d810dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 --2- 172.21.15.1:0/377426392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d81067a0 0x7f15d8106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 --2- 172.21.15.1:0/377426392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d8105b80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 -- 172.21.15.1:0/377426392 >> 172.21.15.1:0/377426392 conn(0x7f15d8101060 msgr2=0x7f15d8103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 -- 172.21.15.1:0/377426392 shutdown_connections 2024-08-28T20:13:39.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.242+0000 7f15ddc00640 1 -- 172.21.15.1:0/377426392 wait complete. 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.243+0000 7f15ddc00640 1 Processor -- start 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.243+0000 7f15ddc00640 1 -- start start 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ddc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d81067a0 0x7f15d819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ddc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15d8107140 0x7f15d819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ddc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81113a0 con 0x7f15d8107140 2024-08-28T20:13:39.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ddc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8111220 con 0x7f15d81067a0 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ddc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8111520 con 0x7f15d8105710 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d819bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39738/0 (socket says 172.21.15.1:39738) 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15d6a00640 1 -- 172.21.15.1:0/174418216 learned_addr learned my addr 172.21.15.1:0/174418216 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15d7400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15d8107140 0x7f15d819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.244+0000 7f15ce000640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d81067a0 0x7f15d819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15d6a00640 1 -- 172.21.15.1:0/174418216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d81067a0 msgr2=0x7f15d819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15d6a00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d81067a0 0x7f15d819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15d6a00640 1 -- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15d8107140 msgr2=0x7f15d819d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:13:39.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15d6a00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15d8107140 0x7f15d819d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15d6a00640 1 -- 172.21.15.1:0/174418216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d819d9c0 con 0x7f15d8105710 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15d6a00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d819bf90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009980 tx=0x7f15c8032f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8005140 con 0x7f15d8105710 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c8031400 con 0x7f15d8105710 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80049b0 con 0x7f15d8105710 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d819dc50 con 0x7f15d8105710 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.245+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d81a41e0 con 0x7f15d8105710 2024-08-28T20:13:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.246+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d810c8f0 con 0x7f15d8105710 2024-08-28T20:13:39.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.249+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f15c8039040 con 0x7f15d8105710 2024-08-28T20:13:39.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.250+0000 7f15cfe00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f15bc0b4b30 0x7f15bc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:13:39.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.250+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5862+0+0 (secure 0 0 0) 0x7f15c81059a0 con 0x7f15d8105710 2024-08-28T20:13:39.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.250+0000 7f15ce000640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f15bc0b4b30 0x7f15bc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:13:39.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.251+0000 7f15ce000640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f15bc0b4b30 0x7f15bc0b7040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009bd0 tx=0x7f15c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:13:39.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.252+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15c8040030 con 0x7f15d8105710 2024-08-28T20:13:39.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:13:39.457+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f15d80635a0 con 0x7f15bc0b4b30 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:39 smithi001 ceph-mon[20984]: osdmap e51: 9 total, 9 up, 9 in 2024-08-28T20:13:39.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:13:39.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:13:39.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:39.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:13:39.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:13:39.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:39.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:39 smithi121 ceph-mon[25248]: osdmap e51: 9 total, 9 up, 9 in 2024-08-28T20:13:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:13:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:13:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-28T20:13:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:13:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:13:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:40.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:39 smithi007 ceph-mon[25357]: osdmap e51: 9 total, 9 up, 9 in 2024-08-28T20:13:40.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:40 smithi001 ceph-mon[20984]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:13:40.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:40 smithi001 ceph-mon[20984]: osdmap e52: 9 total, 9 up, 9 in 2024-08-28T20:13:40.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:40 smithi121 ceph-mon[25248]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:13:40.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:40 smithi121 ceph-mon[25248]: osdmap e52: 9 total, 9 up, 9 in 2024-08-28T20:13:41.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:40 smithi007 ceph-mon[25357]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:13:41.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:40 smithi007 ceph-mon[25357]: osdmap e52: 9 total, 9 up, 9 in 2024-08-28T20:13:41.869 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:41 smithi001 ceph-mon[20984]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:41 smithi121 ceph-mon[25248]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:42.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:41 smithi007 ceph-mon[25357]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:43 smithi001 ceph-mon[20984]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-08-28T20:13:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:43 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/997601870' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a163d6f-2558-4097-a93e-0714aa8ff4b3"} : dispatch 2024-08-28T20:13:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:43 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/997601870' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a163d6f-2558-4097-a93e-0714aa8ff4b3"}]': finished 2024-08-28T20:13:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:43 smithi001 ceph-mon[20984]: osdmap e53: 10 total, 9 up, 10 in 2024-08-28T20:13:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:13:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:43 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2824036920' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:13:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:43 smithi121 ceph-mon[25248]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-08-28T20:13:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:43 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/997601870' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a163d6f-2558-4097-a93e-0714aa8ff4b3"} : dispatch 2024-08-28T20:13:43.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:43 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/997601870' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a163d6f-2558-4097-a93e-0714aa8ff4b3"}]': finished 2024-08-28T20:13:43.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:43 smithi121 ceph-mon[25248]: osdmap e53: 10 total, 9 up, 10 in 2024-08-28T20:13:43.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:13:43.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:43 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2824036920' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:13:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:43 smithi007 ceph-mon[25357]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-08-28T20:13:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:43 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/997601870' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a163d6f-2558-4097-a93e-0714aa8ff4b3"} : dispatch 2024-08-28T20:13:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:43 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/997601870' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a163d6f-2558-4097-a93e-0714aa8ff4b3"}]': finished 2024-08-28T20:13:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:43 smithi007 ceph-mon[25357]: osdmap e53: 10 total, 9 up, 10 in 2024-08-28T20:13:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:13:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:43 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2824036920' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:13:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:45 smithi001 ceph-mon[20984]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-28T20:13:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:45 smithi121 ceph-mon[25248]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-28T20:13:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:45 smithi007 ceph-mon[25357]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-28T20:13:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:47 smithi001 ceph-mon[20984]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-28T20:13:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:47 smithi121 ceph-mon[25248]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-28T20:13:48.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:47 smithi007 ceph-mon[25357]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-28T20:13:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:49 smithi001 ceph-mon[20984]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:13:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:49 smithi121 ceph-mon[25248]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:13:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:49 smithi007 ceph-mon[25357]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T20:13:51.815 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:51 smithi001 ceph-mon[20984]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-28T20:13:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:51 smithi121 ceph-mon[25248]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-28T20:13:52.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:51 smithi007 ceph-mon[25357]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-28T20:13:52.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-28T20:13:52.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:52 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:52.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-28T20:13:52.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:52 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:53.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-28T20:13:53.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:52 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:13:53.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:53 smithi121 ceph-mon[25248]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:53.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:53 smithi121 ceph-mon[25248]: Deploying daemon osd.9 on smithi001 2024-08-28T20:13:53.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:53 smithi001 ceph-mon[20984]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:53.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:53 smithi001 ceph-mon[20984]: Deploying daemon osd.9 on smithi001 2024-08-28T20:13:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:53 smithi007 ceph-mon[25357]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:53 smithi007 ceph-mon[25357]: Deploying daemon osd.9 on smithi001 2024-08-28T20:13:55.837 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:55 smithi001 ceph-mon[20984]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:55 smithi007 ceph-mon[25357]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:55 smithi121 ceph-mon[25248]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:57.937 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:57 smithi001 ceph-mon[20984]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:57 smithi007 ceph-mon[25357]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:57 smithi121 ceph-mon[25248]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:13:59.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:13:59 smithi001 ceph-mon[20984]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:13:59 smithi007 ceph-mon[25357]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:13:59 smithi121 ceph-mon[25248]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:01.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:00 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:01.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:00 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:01.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:00 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:00 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:00 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:00 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:00 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:01.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:00 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:01.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:00 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:01.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:01 smithi001 ceph-mon[20984]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:01 smithi007 ceph-mon[25357]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:01 smithi121 ceph-mon[25248]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:03 smithi001 ceph-mon[20984]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:03.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:03.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:03.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:03 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:03 smithi007 ceph-mon[25357]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:03 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:03 smithi121 ceph-mon[25248]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:04.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:04.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:03 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:04.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.451+0000 7f15cfe00640 1 -- 172.21.15.1:0/174418216 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f15d80635a0 con 0x7f15bc0b4b30 2024-08-28T20:14:04.453 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-08-28T20:14:04.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.453+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f15bc0b4b30 msgr2=0x7f15bc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:04.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.453+0000 7f15ddc00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f15bc0b4b30 0x7f15bc0b7040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009bd0 tx=0x7f15c0005f90 comp rx=0 tx=0).stop 2024-08-28T20:14:04.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 msgr2=0x7f15d819bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:04.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d819bf90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009980 tx=0x7f15c8032f00 comp rx=0 tx=0).stop 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 shutdown_connections 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f15bc0b4b30 0x7f15bc0b7040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f15d8107140 0x7f15d819d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d81067a0 0x7f15d819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 --2- 172.21.15.1:0/174418216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15d8105710 0x7f15d819bf90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 >> 172.21.15.1:0/174418216 conn(0x7f15d8101060 msgr2=0x7f15d8109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 shutdown_connections 2024-08-28T20:14:04.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:04.454+0000 7f15ddc00640 1 -- 172.21.15.1:0/174418216 wait complete. 2024-08-28T20:14:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:04 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:05.202 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:05.203 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:05.203 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:04 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:05.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:05.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:05.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:04 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:05.246 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.9.service 2024-08-28T20:14:05.250 INFO:tasks.cephadm:Deploying osd.10 on smithi007 with /dev/vg_nvme/lv_1... 2024-08-28T20:14:05.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-28T20:14:05.514 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:14:05.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:14:05 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:14:05.549+0000 7f0799a4e640 -1 osd.9 0 log_to_monitors true 2024-08-28T20:14:05.954 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:05 smithi007 ceph-mon[25357]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:05.954 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:05 smithi007 ceph-mon[25357]: from='osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T20:14:05.954 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:05 smithi007 ceph-mon[25357]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T20:14:06.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:05 smithi001 ceph-mon[20984]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:06.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:05 smithi001 ceph-mon[20984]: from='osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T20:14:06.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:05 smithi001 ceph-mon[20984]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T20:14:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:05 smithi121 ceph-mon[25248]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:05 smithi121 ceph-mon[25248]: from='osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T20:14:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:05 smithi121 ceph-mon[25248]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T20:14:06.833 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:14:06.816+0000 7f0794600640 -1 osd.9 0 waiting for initial osdmap 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: osdmap e54: 10 total, 9 up, 10 in 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: from='osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:14:06.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: osdmap e55: 10 total, 9 up, 10 in 2024-08-28T20:14:06.834 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:06.860 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-28T20:14:06.860 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: osdmap e54: 10 total, 9 up, 10 in 2024-08-28T20:14:06.861 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: from='osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:14:06.861 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:06.861 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:14:06.861 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:14:06.861 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: osdmap e55: 10 total, 9 up, 10 in 2024-08-28T20:14:06.861 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:07.114 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:14:06 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:14:06.831+0000 7f078f600640 -1 osd.9 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:14:07.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-28T20:14:07.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: osdmap e54: 10 total, 9 up, 10 in 2024-08-28T20:14:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: from='osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:14:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]} : dispatch 2024-08-28T20:14:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-08-28T20:14:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: osdmap e55: 10 total, 9 up, 10 in 2024-08-28T20:14:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:07.909 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:07 smithi007 ceph-mon[25357]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:07.909 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:07 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-08-28T20:14:07.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-08-28T20:14:08.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:07 smithi001 ceph-mon[20984]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:08.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:07 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:08.130 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:07 smithi121 ceph-mon[25248]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:08.131 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:07 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:08.192 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 -- 172.21.15.7:0/3893648740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 msgr2=0x7f10a4108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 --2- 172.21.15.7:0/3893648740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4108ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1094009900 tx=0x7f109402a410 comp rx=0 tx=0).stop 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 -- 172.21.15.7:0/3893648740 shutdown_connections 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 --2- 172.21.15.7:0/3893648740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 0x7f10a410b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 --2- 172.21.15.7:0/3893648740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4108ae0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 --2- 172.21.15.7:0/3893648740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a406c400 0x7f10a4106140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 -- 172.21.15.7:0/3893648740 >> 172.21.15.7:0/3893648740 conn(0x7f10a40fdd80 msgr2=0x7f10a4100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 -- 172.21.15.7:0/3893648740 shutdown_connections 2024-08-28T20:14:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.622+0000 7f10abf98640 1 -- 172.21.15.7:0/3893648740 wait complete. 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 Processor -- start 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 -- start start 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a406c400 0x7f10a4103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 0x7f10a4102580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410f180 con 0x7f10a4109220 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410f000 con 0x7f10a4106680 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10abf98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410f300 con 0x7f10a406c400 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10a9533640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10a9533640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4102040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40788/0 (socket says 172.21.15.7:40788) 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10a9533640 1 -- 172.21.15.7:0/1283420140 learned_addr learned my addr 172.21.15.7:0/1283420140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-08-28T20:14:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10a9d34640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a406c400 0x7f10a4103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.623+0000 7f10aa535640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 0x7f10a4102580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10a9533640 1 -- 172.21.15.7:0/1283420140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a406c400 msgr2=0x7f10a4103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10a9533640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a406c400 0x7f10a4103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10a9533640 1 -- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 msgr2=0x7f10a4102580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10a9533640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 0x7f10a4102580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10a9533640 1 -- 172.21.15.7:0/1283420140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a4102c80 con 0x7f10a4106680 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10aa535640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 0x7f10a4102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10a9533640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4102040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1094006010 tx=0x7f1094004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109403f030 con 0x7f10a4106680 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094003cb0 con 0x7f10a4106680 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a41a3e30 con 0x7f10a4106680 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094035070 con 0x7f10a4106680 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.624+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41a41d0 con 0x7f10a4106680 2024-08-28T20:14:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.625+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a40ff8a0 con 0x7f10a4106680 2024-08-28T20:14:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.626+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f1094042030 con 0x7f10a4106680 2024-08-28T20:14:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.627+0000 7f109affd640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10900b4b30 0x7f10900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.627+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6261+0+0 (secure 0 0 0) 0x7f10941055c0 con 0x7f10a4106680 2024-08-28T20:14:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.628+0000 7f10a9d34640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10900b4b30 0x7f10900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.628+0000 7f10a9d34640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10900b4b30 0x7f10900b7040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10a000bbe0 tx=0x7f10a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.630+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f10940ccef0 con 0x7f10a4106680 2024-08-28T20:14:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:08.831+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f10a40635a0 con 0x7f10900b4b30 2024-08-28T20:14:08.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:08 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:14:08.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:08 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:14:08.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:08.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:08 smithi001 ceph-mon[20984]: osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] boot 2024-08-28T20:14:08.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:08 smithi001 ceph-mon[20984]: osdmap e56: 10 total, 10 up, 10 in 2024-08-28T20:14:08.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:08 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:14:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:08 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:14:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:08 smithi007 ceph-mon[25357]: osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] boot 2024-08-28T20:14:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:08 smithi007 ceph-mon[25357]: osdmap e56: 10 total, 10 up, 10 in 2024-08-28T20:14:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:09.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:08 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:14:09.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:08 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:14:09.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:09.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:08 smithi121 ceph-mon[25248]: osd.9 [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] boot 2024-08-28T20:14:09.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:08 smithi121 ceph-mon[25248]: osdmap e56: 10 total, 10 up, 10 in 2024-08-28T20:14:09.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T20:14:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: osdmap e57: 10 total, 10 up, 10 in 2024-08-28T20:14:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:14:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:14:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:10.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: osdmap e57: 10 total, 10 up, 10 in 2024-08-28T20:14:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:14:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:14:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:10.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-28T20:14:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: osdmap e57: 10 total, 10 up, 10 in 2024-08-28T20:14:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:14:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:10.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:10 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi001 2024-08-28T20:14:11.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:10 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi001 to 4273M 2024-08-28T20:14:11.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:10 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi001 2024-08-28T20:14:11.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:10 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi001 to 4273M 2024-08-28T20:14:11.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:10 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi001 2024-08-28T20:14:11.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:10 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi001 to 4273M 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/1558212131' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"} : dispatch 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"} : dispatch 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"}]': finished 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: osdmap e58: 11 total, 10 up, 11 in 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:11 smithi007 ceph-mon[25357]: from='client.? 172.21.15.7:0/3569284860' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/1558212131' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"} : dispatch 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"} : dispatch 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"}]': finished 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: osdmap e58: 11 total, 10 up, 11 in 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:11 smithi001 ceph-mon[20984]: from='client.? 172.21.15.7:0/3569284860' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:14:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/1558212131' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"} : dispatch 2024-08-28T20:14:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"} : dispatch 2024-08-28T20:14:12.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "284360f9-662f-43ab-924b-7820d7e7042f"}]': finished 2024-08-28T20:14:12.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: osdmap e58: 11 total, 10 up, 11 in 2024-08-28T20:14:12.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:12.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:11 smithi121 ceph-mon[25248]: from='client.? 172.21.15.7:0/3569284860' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:14:14.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:13 smithi001 ceph-mon[20984]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:13 smithi121 ceph-mon[25248]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:13 smithi007 ceph-mon[25357]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:16.118 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:15 smithi007 ceph-mon[25357]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:15 smithi001 ceph-mon[20984]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:15 smithi121 ceph-mon[25248]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:17 smithi007 ceph-mon[25357]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:18.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:17 smithi001 ceph-mon[20984]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:17 smithi121 ceph-mon[25248]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:19.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:19 smithi007 ceph-mon[25357]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:19.843 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-28T20:14:19.844 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:20.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:19 smithi001 ceph-mon[20984]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:20.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-28T20:14:20.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:19 smithi121 ceph-mon[25248]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-28T20:14:20.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:21.127 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:20 smithi007 ceph-mon[25357]: Deploying daemon osd.10 on smithi007 2024-08-28T20:14:21.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:20 smithi001 ceph-mon[20984]: Deploying daemon osd.10 on smithi007 2024-08-28T20:14:21.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:20 smithi121 ceph-mon[25248]: Deploying daemon osd.10 on smithi007 2024-08-28T20:14:21.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:21 smithi001 ceph-mon[20984]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:22.217 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:21 smithi007 ceph-mon[25357]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:21 smithi121 ceph-mon[25248]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:23 smithi007 ceph-mon[25357]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:23 smithi001 ceph-mon[20984]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:24.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:23 smithi121 ceph-mon[25248]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:25.194 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:25.195 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:25.195 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:25.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:25.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:25.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:25.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:25.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:25.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:26.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:25 smithi007 ceph-mon[25357]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:25 smithi001 ceph-mon[20984]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:25 smithi121 ceph-mon[25248]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:26 smithi001 ceph-mon[20984]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:26 smithi121 ceph-mon[25248]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:27.247 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:26 smithi007 ceph-mon[25357]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:27.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.914+0000 7f109affd640 1 -- 172.21.15.7:0/1283420140 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f10a40635a0 con 0x7f10900b4b30 2024-08-28T20:14:27.917 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 10 on host 'smithi007' 2024-08-28T20:14:27.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10900b4b30 msgr2=0x7f10900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:27.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10900b4b30 0x7f10900b7040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10a000bbe0 tx=0x7f10a000b390 comp rx=0 tx=0).stop 2024-08-28T20:14:27.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 msgr2=0x7f10a4102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4102040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1094006010 tx=0x7f1094004340 comp rx=0 tx=0).stop 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 shutdown_connections 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10900b4b30 0x7f10900b7040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a4109220 0x7f10a4102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10a4106680 0x7f10a4102040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 --2- 172.21.15.7:0/1283420140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a406c400 0x7f10a4103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 >> 172.21.15.7:0/1283420140 conn(0x7f10a40fdd80 msgr2=0x7f10a4104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 shutdown_connections 2024-08-28T20:14:27.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-08-28T20:14:27.917+0000 7f10abf98640 1 -- 172.21.15.7:0/1283420140 wait complete. 2024-08-28T20:14:28.191 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.191 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.191 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.191 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:28.511 DEBUG:teuthology.orchestra.run.smithi007:osd.10> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.10.service 2024-08-28T20:14:28.513 INFO:tasks.cephadm:Deploying osd.11 on smithi121 with /dev/vg_nvme/lv_1... 2024-08-28T20:14:28.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-28T20:14:28.769 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:14:29.190 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:29 smithi121 ceph-mon[25248]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:29 smithi007 ceph-mon[25357]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:29 smithi001 ceph-mon[20984]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:30.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:14:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:14:30.491+0000 7f3ce34b1640 -1 osd.10 0 log_to_monitors true 2024-08-28T20:14:31.037 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-28T20:14:31.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_1 2024-08-28T20:14:31.281 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:31 smithi007 ceph-mon[25357]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:31.281 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:31 smithi007 ceph-mon[25357]: from='osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T20:14:31.281 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:31 smithi007 ceph-mon[25357]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T20:14:31.312 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:14:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:31 smithi001 ceph-mon[20984]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:31 smithi001 ceph-mon[20984]: from='osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T20:14:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:31 smithi001 ceph-mon[20984]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T20:14:31.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:31 smithi121 ceph-mon[25248]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:31.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:31 smithi121 ceph-mon[25248]: from='osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T20:14:31.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:31 smithi121 ceph-mon[25248]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T20:14:31.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 -- 172.21.15.121:0/106779627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 msgr2=0x7ff3b01039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:31.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/106779627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b01039f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009900 tx=0x7ff3a002a480 comp rx=0 tx=0).stop 2024-08-28T20:14:31.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 -- 172.21.15.121:0/106779627 shutdown_connections 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/106779627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3b0104fb0 0x7ff3b010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/106779627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3b0104610 0x7ff3b0104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/106779627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b01039f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 -- 172.21.15.121:0/106779627 >> 172.21.15.121:0/106779627 conn(0x7ff3b00feef0 msgr2=0x7ff3b01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 -- 172.21.15.121:0/106779627 shutdown_connections 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 -- 172.21.15.121:0/106779627 wait complete. 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.804+0000 7ff3b59bf640 1 Processor -- start 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 -- start start 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b0199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3b0104610 0x7ff3b019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3b0104fb0 0x7ff3b019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:31.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b010f130 con 0x7ff3b0104fb0 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b010efb0 con 0x7ff3b0104610 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3b59bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b010f2b0 con 0x7ff3b0103580 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b0199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b0199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59532/0 (socket says 172.21.15.121:59532) 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 -- 172.21.15.121:0/4214904365 learned_addr learned my addr 172.21.15.121:0/4214904365 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3af7fe640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3b0104fb0 0x7ff3b019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3ae7fc640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3b0104610 0x7ff3b019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 -- 172.21.15.121:0/4214904365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3b0104610 msgr2=0x7ff3b019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3b0104610 0x7ff3b019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 -- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3b0104fb0 msgr2=0x7ff3b019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3b0104fb0 0x7ff3b019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.805+0000 7ff3aeffd640 1 -- 172.21.15.121:0/4214904365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b019b790 con 0x7ff3b0103580 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.806+0000 7ff3aeffd640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b0199d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0006010 tx=0x7ff3a0004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:31.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.806+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a003f030 con 0x7ff3b0103580 2024-08-28T20:14:31.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.806+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a0003cb0 con 0x7ff3b0103580 2024-08-28T20:14:31.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.806+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0035070 con 0x7ff3b0103580 2024-08-28T20:14:31.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.806+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b019ba20 con 0x7ff3b0103580 2024-08-28T20:14:31.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.806+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b01a1fb0 con 0x7ff3b0103580 2024-08-28T20:14:31.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.807+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b010a760 con 0x7ff3b0103580 2024-08-28T20:14:31.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.809+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7ff3a0042030 con 0x7ff3b0103580 2024-08-28T20:14:31.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.809+0000 7ff3b49bd640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3980b4b30 0x7ff3980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:31.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.810+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6398+0+0 (secure 0 0 0) 0x7ff3a0105590 con 0x7ff3b0103580 2024-08-28T20:14:31.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.810+0000 7ff3ae7fc640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3980b4b30 0x7ff3980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:31.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.810+0000 7ff3ae7fc640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3980b4b30 0x7ff3980b7040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400bbe0 tx=0x7ff3a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:31.817+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff3a0003e60 con 0x7ff3b0103580 2024-08-28T20:14:32.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:32.011+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff3b00635a0 con 0x7ff3980b4b30 2024-08-28T20:14:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-28T20:14:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:14:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: osdmap e59: 11 total, 10 up, 11 in 2024-08-28T20:14:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:14:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi007 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi007 to 4273M 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:14:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: osdmap e59: 11 total, 10 up, 11 in 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi007 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi007 to 4273M 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:14:32.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:14:32.211+0000 7f3cdf433640 -1 osd.10 0 waiting for initial osdmap 2024-08-28T20:14:32.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:14:32.229+0000 7f3cdb231640 -1 osd.10 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:14:32.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-28T20:14:32.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: osdmap e59: 11 total, 10 up, 11 in 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi007 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi007 to 4273M 2024-08-28T20:14:32.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T20:14:32.567 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:33.403 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:33 smithi121 ceph-mon[25248]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:14:33.403 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:33 smithi121 ceph-mon[25248]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:33.403 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:33 smithi121 ceph-mon[25248]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:14:33.403 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:33 smithi121 ceph-mon[25248]: osdmap e60: 11 total, 10 up, 11 in 2024-08-28T20:14:33.403 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:33.403 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:33 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:33 smithi001 ceph-mon[20984]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:14:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:33 smithi001 ceph-mon[20984]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:33 smithi001 ceph-mon[20984]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:14:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:33 smithi001 ceph-mon[20984]: osdmap e60: 11 total, 10 up, 11 in 2024-08-28T20:14:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:33.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:33 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:33 smithi007 ceph-mon[25357]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:14:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:33 smithi007 ceph-mon[25357]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:33 smithi007 ceph-mon[25357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-08-28T20:14:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:33 smithi007 ceph-mon[25357]: osdmap e60: 11 total, 10 up, 11 in 2024-08-28T20:14:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:33.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:33 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] boot 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: osdmap e61: 11 total, 11 up, 11 in 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:34 smithi001 ceph-mon[20984]: osdmap e62: 11 total, 11 up, 11 in 2024-08-28T20:14:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:14:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:14:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] boot 2024-08-28T20:14:34.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: osdmap e61: 11 total, 11 up, 11 in 2024-08-28T20:14:34.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:34 smithi121 ceph-mon[25248]: osdmap e62: 11 total, 11 up, 11 in 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: osd.10 [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] boot 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: osdmap e61: 11 total, 11 up, 11 in 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T20:14:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:34 smithi007 ceph-mon[25357]: osdmap e62: 11 total, 11 up, 11 in 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/3944615366' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"} : dispatch 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"} : dispatch 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"}]': finished 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: osdmap e63: 12 total, 11 up, 12 in 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:35.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:35 smithi001 ceph-mon[20984]: from='client.? 172.21.15.121:0/410833673' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:14:35.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:35.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/3944615366' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"} : dispatch 2024-08-28T20:14:35.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"} : dispatch 2024-08-28T20:14:35.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"}]': finished 2024-08-28T20:14:35.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: osdmap e63: 12 total, 11 up, 12 in 2024-08-28T20:14:35.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:35.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:35 smithi121 ceph-mon[25248]: from='client.? 172.21.15.121:0/410833673' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/3944615366' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"} : dispatch 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"} : dispatch 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7656a4e-5f9c-4081-a1ef-7ea7c74028e2"}]': finished 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: osdmap e63: 12 total, 11 up, 12 in 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:35.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:35 smithi007 ceph-mon[25357]: from='client.? 172.21.15.121:0/410833673' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T20:14:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:37 smithi001 ceph-mon[20984]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:37.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:37 smithi121 ceph-mon[25248]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:37.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:37 smithi007 ceph-mon[25357]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:39.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:39 smithi001 ceph-mon[20984]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-08-28T20:14:39.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:39 smithi121 ceph-mon[25248]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-08-28T20:14:39.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:39 smithi007 ceph-mon[25357]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-08-28T20:14:41.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:41 smithi001 ceph-mon[20984]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-28T20:14:41.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:41 smithi121 ceph-mon[25248]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-28T20:14:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:41 smithi007 ceph-mon[25357]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-28T20:14:43.460 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:43 smithi121 ceph-mon[25248]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-28T20:14:43.460 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-28T20:14:43.460 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:43.461 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:43 smithi121 ceph-mon[25248]: Deploying daemon osd.11 on smithi121 2024-08-28T20:14:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:43 smithi007 ceph-mon[25357]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-28T20:14:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-28T20:14:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:43 smithi007 ceph-mon[25357]: Deploying daemon osd.11 on smithi121 2024-08-28T20:14:43.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:43 smithi001 ceph-mon[20984]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-28T20:14:43.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-28T20:14:43.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:43.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:43 smithi001 ceph-mon[20984]: Deploying daemon osd.11 on smithi121 2024-08-28T20:14:45.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:45 smithi121 ceph-mon[25248]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:14:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:45 smithi007 ceph-mon[25357]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:14:45.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:45 smithi001 ceph-mon[20984]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T20:14:47.429 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:47 smithi121 ceph-mon[25248]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-28T20:14:47.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:47 smithi007 ceph-mon[25357]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-28T20:14:47.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:47 smithi001 ceph-mon[20984]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-28T20:14:48.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:48.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:48.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:48.569 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:48.569 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:48.569 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:48.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:48.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:48.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:49.264 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:49 smithi121 ceph-mon[25248]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:14:49.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:49 smithi007 ceph-mon[25357]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:14:49.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:49 smithi001 ceph-mon[20984]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T20:14:51.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.299+0000 7ff3b49bd640 1 -- 172.21.15.121:0/4214904365 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff3b00635a0 con 0x7ff3980b4b30 2024-08-28T20:14:51.301 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 11 on host 'smithi121' 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3980b4b30 msgr2=0x7ff3980b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3980b4b30 0x7ff3980b7040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400bbe0 tx=0x7ff3a400b390 comp rx=0 tx=0).stop 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 msgr2=0x7ff3b0199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b0199d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0006010 tx=0x7ff3a0004340 comp rx=0 tx=0).stop 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 shutdown_connections 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3980b4b30 0x7ff3980b7040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3b0104fb0 0x7ff3b019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3b0104610 0x7ff3b019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:51.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 --2- 172.21.15.121:0/4214904365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3b0103580 0x7ff3b0199d60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:51.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 >> 172.21.15.121:0/4214904365 conn(0x7ff3b00feef0 msgr2=0x7ff3b0107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:51.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 shutdown_connections 2024-08-28T20:14:51.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:14:51.301+0000 7ff3b59bf640 1 -- 172.21.15.121:0/4214904365 wait complete. 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:51 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:51.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:51.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:51 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:14:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:51.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:51 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:52.038 DEBUG:teuthology.orchestra.run.smithi121:osd.11> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.11.service 2024-08-28T20:14:52.040 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-28T20:14:52.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-28T20:14:52.433 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:14:53.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 -- 172.21.15.1:0/1177173996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0141043a0 msgr2=0x7fe0141047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:53.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 --2- 172.21.15.1:0/1177173996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0141043a0 0x7fe0141047b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009900 tx=0x7fdffc02a490 comp rx=0 tx=0).stop 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 -- 172.21.15.1:0/1177173996 shutdown_connections 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 --2- 172.21.15.1:0/1177173996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014104d40 0x7fe01410b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 --2- 172.21.15.1:0/1177173996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0141043a0 0x7fe0141047b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 --2- 172.21.15.1:0/1177173996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe014103310 0x7fe014103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 -- 172.21.15.1:0/1177173996 >> 172.21.15.1:0/1177173996 conn(0x7fe0140fec60 msgr2=0x7fe014101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 -- 172.21.15.1:0/1177173996 shutdown_connections 2024-08-28T20:14:53.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.041+0000 7fe018a00640 1 -- 172.21.15.1:0/1177173996 wait complete. 2024-08-28T20:14:53.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 Processor -- start 2024-08-28T20:14:53.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 -- start start 2024-08-28T20:14:53.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 0x7fe01419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:53.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0141043a0 0x7fe01419c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:53.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe014104d40 0x7fe01419d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe01410ef70 con 0x7fe014103310 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe01410edf0 con 0x7fe014104d40 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe018a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe01410f0f0 con 0x7fe0141043a0 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.043+0000 7fe013400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 0x7fe01419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 0x7fe01419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40606/0 (socket says 172.21.15.1:40606) 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 -- 172.21.15.1:0/2085510564 learned_addr learned my addr 172.21.15.1:0/2085510564 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013e00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe014104d40 0x7fe01419d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe00be00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0141043a0 0x7fe01419c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 -- 172.21.15.1:0/2085510564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0141043a0 msgr2=0x7fe01419c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0141043a0 0x7fe01419c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 -- 172.21.15.1:0/2085510564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe014104d40 msgr2=0x7fe01419d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe014104d40 0x7fe01419d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 -- 172.21.15.1:0/2085510564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01419d820 con 0x7fe014103310 2024-08-28T20:14:53.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013e00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe014104d40 0x7fe01419d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:14:53.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.044+0000 7fe013400640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 0x7fe01419bdf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe00400e9f0 tx=0x7fe00400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:53.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.045+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00400cd80 con 0x7fe014103310 2024-08-28T20:14:53.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.045+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0040054d0 con 0x7fe014103310 2024-08-28T20:14:53.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.045+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004010690 con 0x7fe014103310 2024-08-28T20:14:53.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.045+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01419db10 con 0x7fe014103310 2024-08-28T20:14:53.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.045+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0141a4210 con 0x7fe014103310 2024-08-28T20:14:53.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.046+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0141a43e0 con 0x7fe014103310 2024-08-28T20:14:53.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.049+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7fe004004e30 con 0x7fe014103310 2024-08-28T20:14:53.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.050+0000 7fe010c00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdff80b4bb0 0x7fdff80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:53.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.050+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6809+0+0 (secure 0 0 0) 0x7fe0040e5160 con 0x7fe014103310 2024-08-28T20:14:53.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.050+0000 7fe00be00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdff80b4bb0 0x7fdff80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:53.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.051+0000 7fe00be00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdff80b4bb0 0x7fdff80b70c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:53.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.056+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe004056130 con 0x7fe014103310 2024-08-28T20:14:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.255+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe0141a45b0 con 0x7fe014103310 2024-08-28T20:14:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.256+0000 7fe010c00640 1 -- 172.21.15.1:0/2085510564 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7fe0040ac7d0 con 0x7fe014103310 2024-08-28T20:14:53.258 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdff80b4bb0 msgr2=0x7fdff80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdff80b4bb0 0x7fdff80b70c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc031400 comp rx=0 tx=0).stop 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 msgr2=0x7fe01419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 0x7fe01419bdf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe00400e9f0 tx=0x7fe00400edf0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 shutdown_connections 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdff80b4bb0 0x7fdff80b70c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe014104d40 0x7fe01419d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0141043a0 0x7fe01419c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 --2- 172.21.15.1:0/2085510564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe014103310 0x7fe01419bdf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.258+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 >> 172.21.15.1:0/2085510564 conn(0x7fe0140fec60 msgr2=0x7fe014075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.259+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 shutdown_connections 2024-08-28T20:14:53.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:53.259+0000 7fe018a00640 1 -- 172.21.15.1:0/2085510564 wait complete. 2024-08-28T20:14:53.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:53 smithi121 ceph-mon[25248]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:53.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:53 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2085510564' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:53.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:53 smithi007 ceph-mon[25357]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:53.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:53 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2085510564' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:53.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:53 smithi001 ceph-mon[20984]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:53.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:53 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2085510564' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:54.198 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":63,"num_osds":12,"num_up_osds":11,"osd_up_since":1724876073,"num_in_osds":12,"osd_in_since":1724876074,"num_remapped_pgs":0} 2024-08-28T20:14:54.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:14:53 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:14:53.877+0000 7f680ca23640 -1 osd.11 0 log_to_monitors true 2024-08-28T20:14:54.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:54 smithi121 ceph-mon[25248]: from='osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T20:14:54.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:54 smithi121 ceph-mon[25248]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T20:14:54.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:54 smithi007 ceph-mon[25357]: from='osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T20:14:54.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:54 smithi007 ceph-mon[25357]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T20:14:54.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:54 smithi001 ceph-mon[20984]: from='osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T20:14:54.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:54 smithi001 ceph-mon[20984]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T20:14:55.200 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-28T20:14:55.578 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: osdmap e64: 12 total, 11 up, 12 in 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: Detected new or changed devices on smithi121 2024-08-28T20:14:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi121 to 4271M 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:55.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:55 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.837 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: osdmap e64: 12 total, 11 up, 12 in 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: Detected new or changed devices on smithi121 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi121 to 4271M 2024-08-28T20:14:55.839 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.839 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:55.839 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:55.839 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:55 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.979 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:14:55.553+0000 7f68089a5640 -1 osd.11 0 waiting for initial osdmap 2024-08-28T20:14:55.979 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:14:55.567+0000 7f68047a3640 -1 osd.11 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: osdmap e64: 12 total, 11 up, 12 in 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: Detected new or changed devices on smithi121 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi121 to 4271M 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:14:55.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:55 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 -- 172.21.15.1:0/4116551986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 msgr2=0x7f521010b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 --2- 172.21.15.1:0/4116551986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 0x7f521010b6e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5208009ca0 tx=0x7f520802a950 comp rx=0 tx=0).stop 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 -- 172.21.15.1:0/4116551986 shutdown_connections 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 --2- 172.21.15.1:0/4116551986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 0x7f521010b6e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 --2- 172.21.15.1:0/4116551986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52101043a0 0x7f52101047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 --2- 172.21.15.1:0/4116551986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5210103310 0x7f5210103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 -- 172.21.15.1:0/4116551986 >> 172.21.15.1:0/4116551986 conn(0x7f52100fec60 msgr2=0x7f5210101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 -- 172.21.15.1:0/4116551986 shutdown_connections 2024-08-28T20:14:56.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.200+0000 7f5216600640 1 -- 172.21.15.1:0/4116551986 wait complete. 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.201+0000 7f5216600640 1 Processor -- start 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 -- start start 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5210103310 0x7f521019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 0x7f521019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 0x7f521019cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f521010ef70 con 0x7f5210104d40 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f521010edf0 con 0x7f5210103310 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5216600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f521010f0f0 con 0x7f52101043a0 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5207e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 0x7f521019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:56.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5215200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5210103310 0x7f521019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5207e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 0x7f521019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44532/0 (socket says 172.21.15.1:44532) 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5207e00640 1 -- 172.21.15.1:0/864309273 learned_addr learned my addr 172.21.15.1:0/864309273 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.202+0000 7f5215c00640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 0x7f521019cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5207e00640 1 -- 172.21.15.1:0/864309273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5210103310 msgr2=0x7f521019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5207e00640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5210103310 0x7f521019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5207e00640 1 -- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 msgr2=0x7f521019cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5207e00640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 0x7f521019cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5207e00640 1 -- 172.21.15.1:0/864309273 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521019d780 con 0x7f52101043a0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5207e00640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 0x7f521019c3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51f800e9f0 tx=0x7f51f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f800cd80 con 0x7f52101043a0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521019da70 con 0x7f52101043a0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f80108e0 con 0x7f52101043a0 2024-08-28T20:14:56.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.203+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8018980 con 0x7f52101043a0 2024-08-28T20:14:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.204+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52101a4170 con 0x7f52101043a0 2024-08-28T20:14:56.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.204+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5210103780 con 0x7f52101043a0 2024-08-28T20:14:56.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.207+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f51f8010430 con 0x7f52101043a0 2024-08-28T20:14:56.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.209+0000 7f520e000640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51f40b4b30 0x7f51f40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:56.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.209+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6847+0+0 (secure 0 0 0) 0x7f51f80e53a0 con 0x7f52101043a0 2024-08-28T20:14:56.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.209+0000 7f5215200640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51f40b4b30 0x7f51f40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:56.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.210+0000 7f5215200640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51f40b4b30 0x7f51f40b7040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5200009bd0 tx=0x7f5200005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:56.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.211+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f51f80ac3a0 con 0x7f52101043a0 2024-08-28T20:14:56.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.406+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f52101a4500 con 0x7f52101043a0 2024-08-28T20:14:56.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.406+0000 7f520e000640 1 -- 172.21.15.1:0/864309273 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f51f80b0b60 con 0x7f52101043a0 2024-08-28T20:14:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:14:56.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.408+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51f40b4b30 msgr2=0x7f51f40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:56.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.408+0000 7f5216600640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51f40b4b30 0x7f51f40b7040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5200009bd0 tx=0x7f5200005f90 comp rx=0 tx=0).stop 2024-08-28T20:14:56.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 msgr2=0x7f521019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:56.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 0x7f521019c3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51f800e9f0 tx=0x7f51f800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 shutdown_connections 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51f40b4b30 0x7f51f40b7040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5210104d40 0x7f521019cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52101043a0 0x7f521019c3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 --2- 172.21.15.1:0/864309273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5210103310 0x7f521019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 >> 172.21.15.1:0/864309273 conn(0x7f52100fec60 msgr2=0x7f5210075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 shutdown_connections 2024-08-28T20:14:56.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:56.409+0000 7f5216600640 1 -- 172.21.15.1:0/864309273 wait complete. 2024-08-28T20:14:56.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:56 smithi001 ceph-mon[20984]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:14:56.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:56 smithi001 ceph-mon[20984]: osdmap e65: 12 total, 11 up, 12 in 2024-08-28T20:14:56.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:56.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:56 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:56.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:56 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/864309273' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:56.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:56 smithi007 ceph-mon[25357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:14:56.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:56 smithi007 ceph-mon[25357]: osdmap e65: 12 total, 11 up, 12 in 2024-08-28T20:14:56.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:56.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:56 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:56.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:56 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/864309273' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:56.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:56 smithi121 ceph-mon[25248]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-28T20:14:56.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:56 smithi121 ceph-mon[25248]: osdmap e65: 12 total, 11 up, 12 in 2024-08-28T20:14:56.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:56.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:56 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:56.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:56 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/864309273' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:57.223 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1724876073,"num_in_osds":12,"osd_in_since":1724876074,"num_remapped_pgs":0} 2024-08-28T20:14:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:57 smithi007 ceph-mon[25357]: purged_snaps scrub starts 2024-08-28T20:14:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:57 smithi007 ceph-mon[25357]: purged_snaps scrub ok 2024-08-28T20:14:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:57 smithi007 ceph-mon[25357]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:57 smithi007 ceph-mon[25357]: osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] boot 2024-08-28T20:14:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:57 smithi007 ceph-mon[25357]: osdmap e66: 12 total, 12 up, 12 in 2024-08-28T20:14:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:57 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:57 smithi001 ceph-mon[20984]: purged_snaps scrub starts 2024-08-28T20:14:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:57 smithi001 ceph-mon[20984]: purged_snaps scrub ok 2024-08-28T20:14:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:57 smithi001 ceph-mon[20984]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:57 smithi001 ceph-mon[20984]: osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] boot 2024-08-28T20:14:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:57 smithi001 ceph-mon[20984]: osdmap e66: 12 total, 12 up, 12 in 2024-08-28T20:14:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:57 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:57 smithi121 ceph-mon[25248]: purged_snaps scrub starts 2024-08-28T20:14:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:57 smithi121 ceph-mon[25248]: purged_snaps scrub ok 2024-08-28T20:14:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:57 smithi121 ceph-mon[25248]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-08-28T20:14:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:57 smithi121 ceph-mon[25248]: osd.11 [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] boot 2024-08-28T20:14:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:57 smithi121 ceph-mon[25248]: osdmap e66: 12 total, 12 up, 12 in 2024-08-28T20:14:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:57 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T20:14:58.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-28T20:14:58.613 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:14:58.919 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:58 smithi001 ceph-mon[20984]: osdmap e67: 12 total, 12 up, 12 in 2024-08-28T20:14:58.957 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:58 smithi007 ceph-mon[25357]: osdmap e67: 12 total, 12 up, 12 in 2024-08-28T20:14:58.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:58 smithi121 ceph-mon[25248]: osdmap e67: 12 total, 12 up, 12 in 2024-08-28T20:14:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 -- 172.21.15.1:0/120740448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e441034f0 msgr2=0x7f2e44103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 --2- 172.21.15.1:0/120740448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e441034f0 0x7f2e44103960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009900 tx=0x7f2e3402a480 comp rx=0 tx=0).stop 2024-08-28T20:14:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 -- 172.21.15.1:0/120740448 shutdown_connections 2024-08-28T20:14:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 --2- 172.21.15.1:0/120740448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e44104580 0x7f2e44104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 --2- 172.21.15.1:0/120740448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e44104f20 0x7f2e4410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 --2- 172.21.15.1:0/120740448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e441034f0 0x7f2e44103960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 -- 172.21.15.1:0/120740448 >> 172.21.15.1:0/120740448 conn(0x7f2e440fee60 msgr2=0x7f2e44101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 -- 172.21.15.1:0/120740448 shutdown_connections 2024-08-28T20:14:59.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.230+0000 7f2e4a800640 1 -- 172.21.15.1:0/120740448 wait complete. 2024-08-28T20:14:59.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.231+0000 7f2e4a800640 1 Processor -- start 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.231+0000 7f2e4a800640 1 -- start start 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.231+0000 7f2e4a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e441034f0 0x7f2e44199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e4a800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e44104580 0x7f2e4419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 0x7f2e4419af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e4a800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410f130 con 0x7f2e44104580 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e4a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410efb0 con 0x7f2e44104f20 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e4a800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410f2b0 con 0x7f2e441034f0 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 0x7f2e4419af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e3be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e44104580 0x7f2e4419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 0x7f2e4419af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44398/0 (socket says 172.21.15.1:44398) 2024-08-28T20:14:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 -- 172.21.15.1:0/623078352 learned_addr learned my addr 172.21.15.1:0/623078352 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43400640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e441034f0 0x7f2e44199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 -- 172.21.15.1:0/623078352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e441034f0 msgr2=0x7f2e44199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e441034f0 0x7f2e44199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 -- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e44104580 msgr2=0x7f2e4419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e44104580 0x7f2e4419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.232+0000 7f2e43e00640 1 -- 172.21.15.1:0/623078352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4419b790 con 0x7f2e44104f20 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.233+0000 7f2e43e00640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 0x7f2e4419af70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00eb10 tx=0x7f2e3c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.233+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c004b20 con 0x7f2e44104f20 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.233+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e3c004cc0 con 0x7f2e44104f20 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.233+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c010670 con 0x7f2e44104f20 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.233+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4419ba80 con 0x7f2e44104f20 2024-08-28T20:14:59.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.233+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441a2180 con 0x7f2e44104f20 2024-08-28T20:14:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.234+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e44103960 con 0x7f2e44104f20 2024-08-28T20:14:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.236+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f2e3c005000 con 0x7f2e44104f20 2024-08-28T20:14:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.238+0000 7f2e40c00640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e280b4bb0 0x7f2e280b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:14:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.238+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f2e3c0e5470 con 0x7f2e44104f20 2024-08-28T20:14:59.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.238+0000 7f2e43400640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e280b4bb0 0x7f2e280b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:14:59.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.239+0000 7f2e43400640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e280b4bb0 0x7f2e280b70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e34031440 tx=0x7f2e340314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:14:59.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.239+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2e3c056130 con 0x7f2e44104f20 2024-08-28T20:14:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.437+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2e4410a6d0 con 0x7f2e44104f20 2024-08-28T20:14:59.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.438+0000 7f2e40c00640 1 -- 172.21.15.1:0/623078352 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f2e4410a6d0 con 0x7f2e44104f20 2024-08-28T20:14:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:14:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e280b4bb0 msgr2=0x7f2e280b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e280b4bb0 0x7f2e280b70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e34031440 tx=0x7f2e340314a0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 msgr2=0x7f2e4419af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 0x7f2e4419af70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00eb10 tx=0x7f2e3c00c2d0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 shutdown_connections 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e280b4bb0 0x7f2e280b70c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e44104580 0x7f2e4419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e44104f20 0x7f2e4419af70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 --2- 172.21.15.1:0/623078352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e441034f0 0x7f2e44199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 >> 172.21.15.1:0/623078352 conn(0x7f2e440fee60 msgr2=0x7f2e441078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 shutdown_connections 2024-08-28T20:14:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:14:59.441+0000 7f2e4a800640 1 -- 172.21.15.1:0/623078352 wait complete. 2024-08-28T20:14:59.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:59 smithi001 ceph-mon[20984]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:14:59.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:14:59 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/623078352' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:14:59.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:59 smithi121 ceph-mon[25248]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:14:59.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:14:59 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/623078352' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:15:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:59 smithi007 ceph-mon[25357]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:14:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/623078352' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T20:15:00.327 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":67,"num_osds":12,"num_up_osds":12,"osd_up_since":1724876096,"num_in_osds":12,"osd_in_since":1724876074,"num_remapped_pgs":0} 2024-08-28T20:15:00.327 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:15:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:01.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.333+0000 7f06cb200640 1 -- 172.21.15.1:0/2934442486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc103750 msgr2=0x7f06cc103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:01.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.333+0000 7f06cb200640 1 --2- 172.21.15.1:0/2934442486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc103750 0x7f06cc103b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009900 tx=0x7f06bc02a410 comp rx=0 tx=0).stop 2024-08-28T20:15:01.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 -- 172.21.15.1:0/2934442486 shutdown_connections 2024-08-28T20:15:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 --2- 172.21.15.1:0/2934442486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06cc1099e0 0x7f06cc110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 --2- 172.21.15.1:0/2934442486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 --2- 172.21.15.1:0/2934442486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc103750 0x7f06cc103b60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 -- 172.21.15.1:0/2934442486 >> 172.21.15.1:0/2934442486 conn(0x7f06cc0ff1a0 msgr2=0x7f06cc1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 -- 172.21.15.1:0/2934442486 shutdown_connections 2024-08-28T20:15:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.334+0000 7f06cb200640 1 -- 172.21.15.1:0/2934442486 wait complete. 2024-08-28T20:15:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 Processor -- start 2024-08-28T20:15:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 -- start start 2024-08-28T20:15:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06cc103750 0x7f06cc19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc19c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc1099e0 0x7f06cc1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:01.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1136b0 con 0x7f06cc1099e0 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc113530 con 0x7f06cc109090 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.335+0000 7f06cb200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc113830 con 0x7f06cc103750 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc19c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc19c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44420/0 (socket says 172.21.15.1:44420) 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 -- 172.21.15.1:0/3041306567 learned_addr learned my addr 172.21.15.1:0/3041306567 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9e00640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06cc103750 0x7f06cc19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06ca800640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc1099e0 0x7f06cc1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 -- 172.21.15.1:0/3041306567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06cc103750 msgr2=0x7f06cc19c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06cc103750 0x7f06cc19c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 -- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc1099e0 msgr2=0x7f06cc1a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc1099e0 0x7f06cc1a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 -- 172.21.15.1:0/3041306567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc1a21f0 con 0x7f06cc109090 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.336+0000 7f06c9400640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc19c820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06b800e9f0 tx=0x7f06b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.337+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b800ccc0 con 0x7f06cc109090 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.337+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc1a24e0 con 0x7f06cc109090 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.337+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b80108e0 con 0x7f06cc109090 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.337+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b8018860 con 0x7f06cc109090 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.337+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc1a8c40 con 0x7f06cc109090 2024-08-28T20:15:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.338+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06cc103b60 con 0x7f06cc109090 2024-08-28T20:15:01.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.341+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f06b8010430 con 0x7f06cc109090 2024-08-28T20:15:01.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.343+0000 7f06c2a00640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f06b00b4bb0 0x7f06b00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:01.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.343+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f06b80e53d0 con 0x7f06cc109090 2024-08-28T20:15:01.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.343+0000 7f06c9e00640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f06b00b4bb0 0x7f06b00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:01.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.344+0000 7f06c9e00640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f06b00b4bb0 0x7f06b00b70c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06bc031440 tx=0x7f06bc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:01.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.344+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06b80ac2b0 con 0x7f06cc109090 2024-08-28T20:15:01.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.540+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06cc1a8f30 con 0x7f06cc109090 2024-08-28T20:15:01.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.542+0000 7f06c2a00640 1 -- 172.21.15.1:0/3041306567 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+18292 (secure 0 0 0) 0x7f06b80b0a70 con 0x7f06cc109090 2024-08-28T20:15:01.544 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:01.545 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":67,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:14:57.556455+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:15:01.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.544+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f06b00b4bb0 msgr2=0x7f06b00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:01.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.544+0000 7f06cb200640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f06b00b4bb0 0x7f06b00b70c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06bc031440 tx=0x7f06bc009560 comp rx=0 tx=0).stop 2024-08-28T20:15:01.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.544+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 msgr2=0x7f06cc19c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:01.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.544+0000 7f06cb200640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc19c820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06b800e9f0 tx=0x7f06b800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 shutdown_connections 2024-08-28T20:15:01.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f06b00b4bb0 0x7f06b00b70c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06cc1099e0 0x7f06cc1a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06cc109090 0x7f06cc19c820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 --2- 172.21.15.1:0/3041306567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06cc103750 0x7f06cc19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:01.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 >> 172.21.15.1:0/3041306567 conn(0x7f06cc0ff1a0 msgr2=0x7f06cc10e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:01.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 shutdown_connections 2024-08-28T20:15:01.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:01.545+0000 7f06cb200640 1 -- 172.21.15.1:0/3041306567 wait complete. 2024-08-28T20:15:01.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:01 smithi001 ceph-mon[20984]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:02.123 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:01 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3041306567' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:15:02.125 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:01 smithi007 ceph-mon[25357]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:02.125 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:01 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3041306567' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:15:02.125 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:01 smithi121 ceph-mon[25248]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:02.125 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:01 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3041306567' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:15:02.407 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-28T20:11:04.566315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-28T20:15:02.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-28T20:15:02.778 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:03.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 -- 172.21.15.1:0/4277480516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 msgr2=0x7f18c4112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:03.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 --2- 172.21.15.1:0/4277480516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c4112410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009ca0 tx=0x7f18bc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 -- 172.21.15.1:0/4277480516 shutdown_connections 2024-08-28T20:15:03.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 --2- 172.21.15.1:0/4277480516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c4112410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 --2- 172.21.15.1:0/4277480516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c410b290 0x7f18c410b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 --2- 172.21.15.1:0/4277480516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 0x7f18c4105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 -- 172.21.15.1:0/4277480516 >> 172.21.15.1:0/4277480516 conn(0x7f18c4101420 msgr2=0x7f18c4103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 -- 172.21.15.1:0/4277480516 shutdown_connections 2024-08-28T20:15:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.342+0000 7f18c3200640 1 -- 172.21.15.1:0/4277480516 wait complete. 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.343+0000 7f18c3200640 1 Processor -- start 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.343+0000 7f18c3200640 1 -- start start 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.343+0000 7f18c3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 0x7f18c419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.343+0000 7f18c3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c410b290 0x7f18c419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.343+0000 7f18c3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c41a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c3200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41158f0 con 0x7f18c410bbe0 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4115770 con 0x7f18c410b290 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4115a70 con 0x7f18c4105950 2024-08-28T20:15:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c41a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c41a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40142/0 (socket says 172.21.15.1:40142) 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c2800640 1 -- 172.21.15.1:0/2546743233 learned_addr learned my addr 172.21.15.1:0/2546743233 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c1e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 0x7f18c419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18bbe00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c410b290 0x7f18c419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c1e00640 1 -- 172.21.15.1:0/2546743233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c410b290 msgr2=0x7f18c419c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c1e00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c410b290 0x7f18c419c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c1e00640 1 -- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 msgr2=0x7f18c41a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c1e00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c41a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.344+0000 7f18c1e00640 1 -- 172.21.15.1:0/2546743233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c41a21f0 con 0x7f18c4105950 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.345+0000 7f18c1e00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 0x7f18c419c280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18b400e9f0 tx=0x7f18b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.345+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b400ccc0 con 0x7f18c4105950 2024-08-28T20:15:03.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.345+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c41a24e0 con 0x7f18c4105950 2024-08-28T20:15:03.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.345+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18b4005020 con 0x7f18c4105950 2024-08-28T20:15:03.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.345+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004a00 con 0x7f18c4105950 2024-08-28T20:15:03.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.345+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c41a8c40 con 0x7f18c4105950 2024-08-28T20:15:03.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.346+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c4105d60 con 0x7f18c4105950 2024-08-28T20:15:03.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.349+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f18b4004ba0 con 0x7f18c4105950 2024-08-28T20:15:03.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.350+0000 7f18baa00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18a80b4b30 0x7f18a80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:03.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.350+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f18b40e4bf0 con 0x7f18c4105950 2024-08-28T20:15:03.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.350+0000 7f18bbe00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18a80b4b30 0x7f18a80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:03.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.351+0000 7f18bbe00640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18a80b4b30 0x7f18a80b7040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18c410acf0 tx=0x7f18ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:03.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.352+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f18b40ac120 con 0x7f18c4105950 2024-08-28T20:15:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.548+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f18c402e430 con 0x7f18c4105950 2024-08-28T20:15:03.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.549+0000 7f18baa00640 1 -- 172.21.15.1:0/2546743233 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f18b40aba20 con 0x7f18c4105950 2024-08-28T20:15:03.551 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-08-28T20:15:03.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18a80b4b30 msgr2=0x7f18a80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:03.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18a80b4b30 0x7f18a80b7040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18c410acf0 tx=0x7f18ac005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:03.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 msgr2=0x7f18c419c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:03.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 0x7f18c419c280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18b400e9f0 tx=0x7f18b400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 shutdown_connections 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18a80b4b30 0x7f18a80b7040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410bbe0 0x7f18c41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c410b290 0x7f18c419c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 --2- 172.21.15.1:0/2546743233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18c4105950 0x7f18c419c280 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 >> 172.21.15.1:0/2546743233 conn(0x7f18c4101420 msgr2=0x7f18c41088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 shutdown_connections 2024-08-28T20:15:03.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:03.552+0000 7f18c3200640 1 -- 172.21.15.1:0/2546743233 wait complete. 2024-08-28T20:15:03.936 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:03 smithi001 ceph-mon[20984]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:03.936 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:03 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2546743233' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T20:15:03.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:03 smithi121 ceph-mon[25248]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:03.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:03 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2546743233' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T20:15:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:03 smithi007 ceph-mon[25357]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:03 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2546743233' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.b on smithi007 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.e on smithi007 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.h on smithi007 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.k on smithi007 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.c on smithi121 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.f on smithi121 2024-08-28T20:15:04.406 INFO:tasks.cephadm:Adding mds.i on smithi121 2024-08-28T20:15:04.407 INFO:tasks.cephadm:Adding mds.l on smithi121 2024-08-28T20:15:04.407 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l' 2024-08-28T20:15:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 -- 172.21.15.121:0/764387598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4104f40 msgr2=0x7fe2e410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 --2- 172.21.15.121:0/764387598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4104f40 0x7fe2e410b8e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009ca0 tx=0x7fe2dc02a950 comp rx=0 tx=0).stop 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 -- 172.21.15.121:0/764387598 shutdown_connections 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 --2- 172.21.15.121:0/764387598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e41045a0 0x7fe2e41049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 --2- 172.21.15.121:0/764387598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4104f40 0x7fe2e410b8e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 --2- 172.21.15.121:0/764387598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e4103510 0x7fe2e4103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 -- 172.21.15.121:0/764387598 >> 172.21.15.121:0/764387598 conn(0x7fe2e40fee60 msgr2=0x7fe2e4101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 -- 172.21.15.121:0/764387598 shutdown_connections 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.128+0000 7fe2e9248640 1 -- 172.21.15.121:0/764387598 wait complete. 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 Processor -- start 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 -- start start 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 0x7fe2e4199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41045a0 0x7fe2e419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e4104f40 0x7fe2e419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e410f150 con 0x7fe2e4104f40 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e410efd0 con 0x7fe2e41045a0 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e9248640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e410f2d0 con 0x7fe2e4103510 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e2d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 0x7fe2e4199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e2d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 0x7fe2e4199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54814/0 (socket says 172.21.15.121:54814) 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e2d9d640 1 -- 172.21.15.121:0/3249297843 learned_addr learned my addr 172.21.15.121:0/3249297843 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-28T20:15:05.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e259c640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41045a0 0x7fe2e419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.129+0000 7fe2e359e640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e4104f40 0x7fe2e419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e2d9d640 1 -- 172.21.15.121:0/3249297843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41045a0 msgr2=0x7fe2e419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e2d9d640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41045a0 0x7fe2e419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e2d9d640 1 -- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e4104f40 msgr2=0x7fe2e419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e2d9d640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e4104f40 0x7fe2e419af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e2d9d640 1 -- 172.21.15.121:0/3249297843 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e419b6b0 con 0x7fe2e4103510 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e259c640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41045a0 0x7fe2e419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e2d9d640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 0x7fe2e4199d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400d770 tx=0x7fe2d400db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4017070 con 0x7fe2e4103510 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e419b9a0 con 0x7fe2e4103510 2024-08-28T20:15:05.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2d4009820 con 0x7fe2e4103510 2024-08-28T20:15:05.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4004bc0 con 0x7fe2e4103510 2024-08-28T20:15:05.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.130+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e41a1f60 con 0x7fe2e4103510 2024-08-28T20:15:05.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.131+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e410a6f0 con 0x7fe2e4103510 2024-08-28T20:15:05.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.134+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7fe2d40099d0 con 0x7fe2e4103510 2024-08-28T20:15:05.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.135+0000 7fe2dbfff640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe2d00b4b30 0x7fe2d00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:05.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.135+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fe2d40e4aa0 con 0x7fe2e4103510 2024-08-28T20:15:05.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.135+0000 7fe2e259c640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe2d00b4b30 0x7fe2d00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:05.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.136+0000 7fe2e259c640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe2d00b4b30 0x7fe2d00b7040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00afb0 tx=0x7fe2cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:05.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.138+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe2d40ac070 con 0x7fe2e4103510 2024-08-28T20:15:05.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.331+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}) -- 0x7fe2e4063760 con 0x7fe2d00b4b30 2024-08-28T20:15:05.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.340+0000 7fe2dbfff640 1 -- 172.21.15.121:0/3249297843 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe2e4063760 con 0x7fe2d00b4b30 2024-08-28T20:15:05.342 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mds.all update... 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe2d00b4b30 msgr2=0x7fe2d00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe2d00b4b30 0x7fe2d00b7040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00afb0 tx=0x7fe2cc00a2d0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 msgr2=0x7fe2e4199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 0x7fe2e4199d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400d770 tx=0x7fe2d400db70 comp rx=0 tx=0).stop 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 shutdown_connections 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe2d00b4b30 0x7fe2d00b7040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.342+0000 7fe2e9248640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e4104f40 0x7fe2e419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.343+0000 7fe2e9248640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41045a0 0x7fe2e419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.343+0000 7fe2e9248640 1 --2- 172.21.15.121:0/3249297843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e4103510 0x7fe2e4199d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.343+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 >> 172.21.15.121:0/3249297843 conn(0x7fe2e40fee60 msgr2=0x7fe2e41078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:05.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.343+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 shutdown_connections 2024-08-28T20:15:05.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-28T20:15:05.343+0000 7fe2e9248640 1 -- 172.21.15.121:0/3249297843 wait complete. 2024-08-28T20:15:05.956 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:05 smithi121 ceph-mon[25248]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:05.957 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:05 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:05.957 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:05 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:05 smithi001 ceph-mon[20984]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:05 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:05 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:05.984 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.a.service 2024-08-28T20:15:05.989 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.d.service 2024-08-28T20:15:06.034 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.g.service 2024-08-28T20:15:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:05 smithi007 ceph-mon[25357]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:05 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:05 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:06.079 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.j.service 2024-08-28T20:15:06.123 DEBUG:teuthology.orchestra.run.smithi007:mds.b> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.b.service 2024-08-28T20:15:06.126 DEBUG:teuthology.orchestra.run.smithi007:mds.e> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.e.service 2024-08-28T20:15:06.170 DEBUG:teuthology.orchestra.run.smithi007:mds.h> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.h.service 2024-08-28T20:15:06.213 DEBUG:teuthology.orchestra.run.smithi007:mds.k> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.k.service 2024-08-28T20:15:06.256 DEBUG:teuthology.orchestra.run.smithi121:mds.c> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.c.service 2024-08-28T20:15:06.259 DEBUG:teuthology.orchestra.run.smithi121:mds.f> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.f.service 2024-08-28T20:15:06.301 DEBUG:teuthology.orchestra.run.smithi121:mds.i> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.i.service 2024-08-28T20:15:06.344 DEBUG:teuthology.orchestra.run.smithi121:mds.l> sudo journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.l.service 2024-08-28T20:15:06.387 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-28T20:15:06.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:06.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:15:06.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-08-28T20:15:06.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:06.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:06.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:06.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:06.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:06.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:06 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:06.759 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:06.869 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:15:06.869 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-08-28T20:15:06.869 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:06.869 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:06.869 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:06.870 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:06.870 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:06.870 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:06 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:07.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:06 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:07.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.379+0000 7f12b3800640 1 -- 172.21.15.1:0/1110722377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10b460 msgr2=0x7f12ac10b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 --2- 172.21.15.1:0/1110722377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10b460 0x7f12ac10b870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1298009900 tx=0x7f129802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 -- 172.21.15.1:0/1110722377 shutdown_connections 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 --2- 172.21.15.1:0/1110722377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10b460 0x7f12ac10b870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 --2- 172.21.15.1:0/1110722377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac10bdb0 0x7f12ac1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 --2- 172.21.15.1:0/1110722377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac105b20 0x7f12ac105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 -- 172.21.15.1:0/1110722377 >> 172.21.15.1:0/1110722377 conn(0x7f12ac1015b0 msgr2=0x7f12ac103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 -- 172.21.15.1:0/1110722377 shutdown_connections 2024-08-28T20:15:07.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.380+0000 7f12b3800640 1 -- 172.21.15.1:0/1110722377 wait complete. 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 Processor -- start 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 -- start start 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 0x7f12ac19c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac10b460 0x7f12ac19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10bdb0 0x7f12ac1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac115a70 con 0x7f12ac10bdb0 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1158f0 con 0x7f12ac10b460 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.381+0000 7f12b3800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac115bf0 con 0x7f12ac105b20 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b1800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10bdb0 0x7f12ac1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:07.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 0x7f12ac19c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:07.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 0x7f12ac19c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:38618/0 (socket says 172.21.15.1:38618) 2024-08-28T20:15:07.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b0e00640 1 -- 172.21.15.1:0/3147627597 learned_addr learned my addr 172.21.15.1:0/3147627597 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:07.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12abe00640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac10b460 0x7f12ac19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b1800640 1 -- 172.21.15.1:0/3147627597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 msgr2=0x7f12ac19c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b1800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 0x7f12ac19c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b1800640 1 -- 172.21.15.1:0/3147627597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac10b460 msgr2=0x7f12ac19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b1800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac10b460 0x7f12ac19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b1800640 1 -- 172.21.15.1:0/3147627597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac1a23f0 con 0x7f12ac10bdb0 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.382+0000 7f12b0e00640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 0x7f12ac19c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.383+0000 7f12b1800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10bdb0 0x7f12ac1a1cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009fd0 tx=0x7f12a400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.383+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a400ce20 con 0x7f12ac10bdb0 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.383+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a4005020 con 0x7f12ac10bdb0 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.383+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1a26e0 con 0x7f12ac10bdb0 2024-08-28T20:15:07.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.383+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4010690 con 0x7f12ac10bdb0 2024-08-28T20:15:07.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.383+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a8e40 con 0x7f12ac10bdb0 2024-08-28T20:15:07.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.384+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac105f30 con 0x7f12ac10bdb0 2024-08-28T20:15:07.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.386+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f12a40054d0 con 0x7f12ac10bdb0 2024-08-28T20:15:07.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.388+0000 7f12a9600640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f12940b4b30 0x7f12940b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:07.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.388+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f12a40e53d0 con 0x7f12ac10bdb0 2024-08-28T20:15:07.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.388+0000 7f12b0e00640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f12940b4b30 0x7f12940b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:07.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.389+0000 7f12b0e00640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f12940b4b30 0x7f12940b7040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f12a0011550 tx=0x7f12a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:07.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.392+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f12a40ac900 con 0x7f12ac10bdb0 2024-08-28T20:15:07.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.624+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12ac10dbe0 con 0x7f12ac10bdb0 2024-08-28T20:15:07.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.625+0000 7f12a9600640 1 -- 172.21.15.1:0/3147627597 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f12a40ac200 con 0x7f12ac10bdb0 2024-08-28T20:15:07.627 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:07.628 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-08-28T20:07:12:747850+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-28T20:15:07.628 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-08-28T20:15:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.627+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f12940b4b30 msgr2=0x7f12940b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.627+0000 7f12b3800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f12940b4b30 0x7f12940b7040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f12a0011550 tx=0x7f12a0005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.627+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10bdb0 msgr2=0x7f12ac1a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.627+0000 7f12b3800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10bdb0 0x7f12ac1a1cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009fd0 tx=0x7f12a400ef10 comp rx=0 tx=0).stop 2024-08-28T20:15:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 shutdown_connections 2024-08-28T20:15:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f12940b4b30 0x7f12940b7040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12ac10bdb0 0x7f12ac1a1cc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12ac10b460 0x7f12ac19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 --2- 172.21.15.1:0/3147627597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12ac105b20 0x7f12ac19c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 >> 172.21.15.1:0/3147627597 conn(0x7f12ac1015b0 msgr2=0x7f12ac1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 shutdown_connections 2024-08-28T20:15:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:07.628+0000 7f12b3800640 1 -- 172.21.15.1:0/3147627597 wait complete. 2024-08-28T20:15:07.795 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:07 smithi121 ceph-mon[25248]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:07.795 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:07 smithi121 ceph-mon[25248]: Deploying daemon mds.l on smithi121 2024-08-28T20:15:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:07 smithi001 ceph-mon[20984]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:07 smithi001 ceph-mon[20984]: Deploying daemon mds.l on smithi121 2024-08-28T20:15:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:07 smithi007 ceph-mon[25357]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:07 smithi007 ceph-mon[25357]: Deploying daemon mds.l on smithi121 2024-08-28T20:15:08.174 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:07 smithi121 systemd[1]: Starting Ceph mds.l for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:08.468 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 podman[54678]: 2024-08-28 20:15:08.173036733 +0000 UTC m=+0.108012995 container create f3f7312b5c505802ec34ae3b7e0a9916890af88f65516e07a12684efcf9d709a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-28T20:15:08.468 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 podman[54678]: 2024-08-28 20:15:08.080557851 +0000 UTC m=+0.015534127 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:08.468 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 podman[54678]: 2024-08-28 20:15:08.383573026 +0000 UTC m=+0.318549293 container init f3f7312b5c505802ec34ae3b7e0a9916890af88f65516e07a12684efcf9d709a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:15:08.468 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 podman[54678]: 2024-08-28 20:15:08.386261303 +0000 UTC m=+0.321237566 container start f3f7312b5c505802ec34ae3b7e0a9916890af88f65516e07a12684efcf9d709a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:15:08.468 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mds[54697]: -- 172.21.15.121:0/3451140821 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56444206b860 con 0x564446211180 2024-08-28T20:15:08.468 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l[54693]: starting mds.l at 2024-08-28T20:15:08.469 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 bash[54678]: f3f7312b5c505802ec34ae3b7e0a9916890af88f65516e07a12684efcf9d709a 2024-08-28T20:15:08.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3147627597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:08.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6832/2034298209,v1:172.21.15.121:6833/2034298209] up:boot 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: fsmap 1 up:standby 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:08.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:08.729 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:15:08 smithi121 systemd[1]: Started Ceph mds.l for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:08.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3147627597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:08.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6832/2034298209,v1:172.21.15.121:6833/2034298209] up:boot 2024-08-28T20:15:08.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: fsmap 1 up:standby 2024-08-28T20:15:08.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T20:15:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3147627597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6832/2034298209,v1:172.21.15.121:6833/2034298209] up:boot 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: fsmap 1 up:standby 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:08.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:09 smithi007 ceph-mon[25357]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:09 smithi007 ceph-mon[25357]: Deploying daemon mds.k on smithi007 2024-08-28T20:15:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:09 smithi001 ceph-mon[20984]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:09 smithi001 ceph-mon[20984]: Deploying daemon mds.k on smithi007 2024-08-28T20:15:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:09 smithi121 ceph-mon[25248]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:09 smithi121 ceph-mon[25248]: Deploying daemon mds.k on smithi007 2024-08-28T20:15:10.482 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:10.520 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 systemd[1]: Starting Ceph mds.k for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:10.786 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 podman[54276]: 2024-08-28 20:15:10.421614786 +0000 UTC m=+0.015864463 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:10.787 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 podman[54276]: 2024-08-28 20:15:10.529645885 +0000 UTC m=+0.123895589 container create 845cb1f731c48acfc4daef6966958587c2312d562352b418ee40a5ab0dee2152 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:15:10.787 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 podman[54276]: 2024-08-28 20:15:10.749038846 +0000 UTC m=+0.343288523 container init 845cb1f731c48acfc4daef6966958587c2312d562352b418ee40a5ab0dee2152 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:15:10.787 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 podman[54276]: 2024-08-28 20:15:10.751827886 +0000 UTC m=+0.346077557 container start 845cb1f731c48acfc4daef6966958587c2312d562352b418ee40a5ab0dee2152 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:15:10.787 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 ceph-mds[54295]: -- 172.21.15.7:0/2199599586 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569e6e41860 con 0x5569eafe7a80 2024-08-28T20:15:10.867 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:11.065 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k[54291]: starting mds.k at 2024-08-28T20:15:11.065 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 bash[54276]: 845cb1f731c48acfc4daef6966958587c2312d562352b418ee40a5ab0dee2152 2024-08-28T20:15:11.065 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:15:10 smithi007 systemd[1]: Started Ceph mds.k for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 -- 172.21.15.1:0/3567205475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 msgr2=0x7f10b81103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 --2- 172.21.15.1:0/3567205475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 0x7f10b81103e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009ca0 tx=0x7f10b002a8c0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 -- 172.21.15.1:0/3567205475 shutdown_connections 2024-08-28T20:15:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 --2- 172.21.15.1:0/3567205475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 0x7f10b81103e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 --2- 172.21.15.1:0/3567205475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8109260 0x7f10b8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 --2- 172.21.15.1:0/3567205475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8103920 0x7f10b8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 -- 172.21.15.1:0/3567205475 >> 172.21.15.1:0/3567205475 conn(0x7f10b80ff330 msgr2=0x7f10b8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 -- 172.21.15.1:0/3567205475 shutdown_connections 2024-08-28T20:15:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.459+0000 7f10bd000640 1 -- 172.21.15.1:0/3567205475 wait complete. 2024-08-28T20:15:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.461+0000 7f10bd000640 1 Processor -- start 2024-08-28T20:15:11.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.461+0000 7f10bd000640 1 -- start start 2024-08-28T20:15:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10bd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 0x7f10b819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10bd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8109260 0x7f10b819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10bd000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 0x7f10b819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10bd000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81138c0 con 0x7f10b8109bb0 2024-08-28T20:15:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10bd000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8113740 con 0x7f10b8103920 2024-08-28T20:15:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10bd000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8113a40 con 0x7f10b8109260 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 0x7f10b819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 0x7f10b819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:49778/0 (socket says 172.21.15.1:49778) 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10b5e00640 1 -- 172.21.15.1:0/4164361025 learned_addr learned my addr 172.21.15.1:0/4164361025 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10b6800640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 0x7f10b819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.462+0000 7f10b5400640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8109260 0x7f10b819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5e00640 1 -- 172.21.15.1:0/4164361025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8109260 msgr2=0x7f10b819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5e00640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8109260 0x7f10b819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5e00640 1 -- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 msgr2=0x7f10b819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5e00640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 0x7f10b819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5e00640 1 -- 172.21.15.1:0/4164361025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b81a0160 con 0x7f10b8103920 2024-08-28T20:15:11.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5400640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8109260 0x7f10b819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10b5e00640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 0x7f10b819a1f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e9f0 tx=0x7f10a800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.463+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a800cd80 con 0x7f10b8103920 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.464+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b81a0450 con 0x7f10b8103920 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.464+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a80054d0 con 0x7f10b8103920 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.464+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8010690 con 0x7f10b8103920 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.464+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b81a6bb0 con 0x7f10b8103920 2024-08-28T20:15:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.465+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b8103d30 con 0x7f10b8103920 2024-08-28T20:15:11.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.467+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f10a8004e90 con 0x7f10b8103920 2024-08-28T20:15:11.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.469+0000 7f10aea00640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f109c0b4c30 0x7f109c0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:11.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.469+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f10a80e50d0 con 0x7f10b8103920 2024-08-28T20:15:11.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.469+0000 7f10b5400640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f109c0b4c30 0x7f109c0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:11.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.470+0000 7f10b5400640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f109c0b4c30 0x7f109c0b7140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f10a40095f0 tx=0x7f10a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:11.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.473+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f10a80ac600 con 0x7f10b8103920 2024-08-28T20:15:11.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.717+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b802e430 con 0x7f10b8103920 2024-08-28T20:15:11.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.717+0000 7f10aea00640 1 -- 172.21.15.1:0/4164361025 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f10a80abf00 con 0x7f10b8103920 2024-08-28T20:15:11.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:11.720 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"btime":"2024-08-28T20:15:11:593916+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-28T20:15:11.720 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f109c0b4c30 msgr2=0x7f109c0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f109c0b4c30 0x7f109c0b7140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f10a40095f0 tx=0x7f10a4005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 msgr2=0x7f10b819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 0x7f10b819a1f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e9f0 tx=0x7f10a800edf0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 shutdown_connections 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f109c0b4c30 0x7f109c0b7140 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10b8109bb0 0x7f10b819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b8109260 0x7f10b819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 --2- 172.21.15.1:0/4164361025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b8103920 0x7f10b819a1f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:11.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 >> 172.21.15.1:0/4164361025 conn(0x7f10b80ff330 msgr2=0x7f10b8106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:11.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 shutdown_connections 2024-08-28T20:15:11.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:11.720+0000 7f10bd000640 1 -- 172.21.15.1:0/4164361025 wait complete. 2024-08-28T20:15:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:11.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:11 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:11.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:11.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:11.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:11.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:11.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:11.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:11.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:11 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:11 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:12.908 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:12 smithi007 ceph-mon[25357]: Deploying daemon mds.j on smithi001 2024-08-28T20:15:12.908 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:12 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6832/3463409516,v1:172.21.15.7:6833/3463409516] up:boot 2024-08-28T20:15:12.908 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:12 smithi007 ceph-mon[25357]: fsmap 2 up:standby 2024-08-28T20:15:12.908 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:12 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T20:15:12.908 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:12 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/4164361025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:12 smithi001 ceph-mon[20984]: Deploying daemon mds.j on smithi001 2024-08-28T20:15:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:12 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6832/3463409516,v1:172.21.15.7:6833/3463409516] up:boot 2024-08-28T20:15:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:12 smithi001 ceph-mon[20984]: fsmap 2 up:standby 2024-08-28T20:15:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:12 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T20:15:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:12 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/4164361025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:12.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:12 smithi121 ceph-mon[25248]: Deploying daemon mds.j on smithi001 2024-08-28T20:15:12.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:12 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6832/3463409516,v1:172.21.15.7:6833/3463409516] up:boot 2024-08-28T20:15:12.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:12 smithi121 ceph-mon[25248]: fsmap 2 up:standby 2024-08-28T20:15:12.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:12 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T20:15:12.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:12 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/4164361025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:13.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:13 smithi001 ceph-mon[20984]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:13.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:13 smithi121 ceph-mon[25248]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:14.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:13 smithi007 ceph-mon[25357]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:14.227 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:13 smithi001 systemd[1]: Starting Ceph mds.j for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:14.516 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 podman[62589]: 2024-08-28 20:15:14.138739019 +0000 UTC m=+0.027302633 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:14.516 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 podman[62589]: 2024-08-28 20:15:14.271351661 +0000 UTC m=+0.159915283 container create 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:15:14.517 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 podman[62589]: 2024-08-28 20:15:14.515709943 +0000 UTC m=+0.404273556 container init 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:15:14.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 podman[62589]: 2024-08-28 20:15:14.522084416 +0000 UTC m=+0.410648020 container start 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-28T20:15:14.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 bash[62589]: 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 2024-08-28T20:15:14.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 systemd[1]: Started Ceph mds.j for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:14.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 ceph-mds[62608]: -- 172.21.15.1:0/1007410375 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56105ec91860 con 0x561062e37180 2024-08-28T20:15:14.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:15:14 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j[62604]: starting mds.j at 2024-08-28T20:15:15.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: Deploying daemon mds.d on smithi001 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.1:6834/2494570830,v1:172.21.15.1:6835/2494570830] up:boot 2024-08-28T20:15:15.940 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: fsmap 3 up:standby 2024-08-28T20:15:15.941 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-28T20:15:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: Deploying daemon mds.d on smithi001 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.1:6834/2494570830,v1:172.21.15.1:6835/2494570830] up:boot 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: fsmap 3 up:standby 2024-08-28T20:15:15.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-28T20:15:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:16.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:16.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: Deploying daemon mds.d on smithi001 2024-08-28T20:15:16.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.1:6834/2494570830,v1:172.21.15.1:6835/2494570830] up:boot 2024-08-28T20:15:16.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: fsmap 3 up:standby 2024-08-28T20:15:16.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-28T20:15:16.622 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 -- 172.21.15.1:0/1298836715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109ba0 msgr2=0x7f69041103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 --2- 172.21.15.1:0/1298836715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109ba0 0x7f69041103d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009ca0 tx=0x7f68fc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 -- 172.21.15.1:0/1298836715 shutdown_connections 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 --2- 172.21.15.1:0/1298836715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109ba0 0x7f69041103d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 --2- 172.21.15.1:0/1298836715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904109250 0x7f6904109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 --2- 172.21.15.1:0/1298836715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904103910 0x7f6904103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 -- 172.21.15.1:0/1298836715 >> 172.21.15.1:0/1298836715 conn(0x7f69040ff380 msgr2=0x7f69041017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 -- 172.21.15.1:0/1298836715 shutdown_connections 2024-08-28T20:15:17.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.399+0000 7f6909e00640 1 -- 172.21.15.1:0/1298836715 wait complete. 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.400+0000 7f6909e00640 1 Processor -- start 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.400+0000 7f6909e00640 1 -- start start 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6909e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 0x7f690419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6909e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109250 0x7f690419c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6909e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904109ba0 0x7f69041a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6909e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69041138b0 con 0x7f6904109250 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6909e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6904113730 con 0x7f6904109ba0 2024-08-28T20:15:17.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6909e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6904113a30 con 0x7f6904103910 2024-08-28T20:15:17.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6902a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 0x7f690419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:17.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6902000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109250 0x7f690419c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6902a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 0x7f690419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33426/0 (socket says 172.21.15.1:33426) 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6902a00640 1 -- 172.21.15.1:0/535791981 learned_addr learned my addr 172.21.15.1:0/535791981 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.401+0000 7f6903400640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904109ba0 0x7f69041a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6902a00640 1 -- 172.21.15.1:0/535791981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904109ba0 msgr2=0x7f69041a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6902a00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904109ba0 0x7f69041a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6902a00640 1 -- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109250 msgr2=0x7f690419c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6902a00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109250 0x7f690419c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6902a00640 1 -- 172.21.15.1:0/535791981 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69041a23b0 con 0x7f6904103910 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6903400640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904109ba0 0x7f69041a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6902a00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 0x7f690419c440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68f400e9f0 tx=0x7f68f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f400cd80 con 0x7f6904103910 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69041a26a0 con 0x7f6904103910 2024-08-28T20:15:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68f40108e0 con 0x7f6904103910 2024-08-28T20:15:17.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4018980 con 0x7f6904103910 2024-08-28T20:15:17.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.402+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69041a8e00 con 0x7f6904103910 2024-08-28T20:15:17.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.404+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6904103d20 con 0x7f6904103910 2024-08-28T20:15:17.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.406+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f68f4010430 con 0x7f6904103910 2024-08-28T20:15:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.407+0000 7f6908a00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68e80b4b30 0x7f68e80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.408+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f68f40e50a0 con 0x7f6904103910 2024-08-28T20:15:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.408+0000 7f6902000640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68e80b4b30 0x7f68e80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.408+0000 7f6902000640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68e80b4b30 0x7f68e80b7040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69041058b0 tx=0x7f68f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.411+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f68f40ac5d0 con 0x7f6904103910 2024-08-28T20:15:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.662+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f690419d570 con 0x7f6904103910 2024-08-28T20:15:17.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.663+0000 7f6908a00640 1 -- 172.21.15.1:0/535791981 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f68f40abed0 con 0x7f6904103910 2024-08-28T20:15:17.665 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 podman[62970]: 2024-08-28 20:15:17.5699435 +0000 UTC m=+0.155972678 container create a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-28T20:15:17.666 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:17.666 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"btime":"2024-08-28T20:15:15:618668+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-08-28T20:15:17.666 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 4 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68e80b4b30 msgr2=0x7f68e80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68e80b4b30 0x7f68e80b7040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69041058b0 tx=0x7f68f0005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 msgr2=0x7f690419c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 0x7f690419c440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68f400e9f0 tx=0x7f68f400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 shutdown_connections 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68e80b4b30 0x7f68e80b7040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6904109250 0x7f690419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6904109ba0 0x7f69041a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 --2- 172.21.15.1:0/535791981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6904103910 0x7f690419c440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.665+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 >> 172.21.15.1:0/535791981 conn(0x7f69040ff380 msgr2=0x7f6904108840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:17.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.666+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 shutdown_connections 2024-08-28T20:15:17.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:17.666+0000 7f6909e00640 1 -- 172.21.15.1:0/535791981 wait complete. 2024-08-28T20:15:17.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:17 smithi001 ceph-mon[20984]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:17.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:17 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/535791981' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:17.921 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 podman[62970]: 2024-08-28 20:15:17.798011019 +0000 UTC m=+0.384040220 container init a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-28T20:15:17.921 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 podman[62970]: 2024-08-28 20:15:17.804371636 +0000 UTC m=+0.390400814 container start a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:15:17.921 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 bash[62970]: a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 2024-08-28T20:15:17.922 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 systemd[1]: Started Ceph mds.d for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:17.922 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 ceph-mds[63010]: -- 172.21.15.1:0/4087045725 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564575cf5860 con 0x564579e9b600 2024-08-28T20:15:17.922 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:15:17 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d[62995]: starting mds.d at 2024-08-28T20:15:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:17 smithi121 ceph-mon[25248]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:17 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/535791981' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:17 smithi007 ceph-mon[25357]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:17 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/535791981' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:19.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:19.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:19.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:19.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: Deploying daemon mds.e on smithi007 2024-08-28T20:15:19.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:19.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.1:6836/3430910515,v1:172.21.15.1:6837/3430910515] up:boot 2024-08-28T20:15:19.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: fsmap 4 up:standby 2024-08-28T20:15:19.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-28T20:15:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: Deploying daemon mds.e on smithi007 2024-08-28T20:15:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.1:6836/3430910515,v1:172.21.15.1:6837/3430910515] up:boot 2024-08-28T20:15:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: fsmap 4 up:standby 2024-08-28T20:15:19.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: Deploying daemon mds.e on smithi007 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.1:6836/3430910515,v1:172.21.15.1:6837/3430910515] up:boot 2024-08-28T20:15:19.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: fsmap 4 up:standby 2024-08-28T20:15:19.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-28T20:15:20.065 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:19 smithi007 systemd[1]: Starting Ceph mds.e for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:20.349 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 podman[54589]: 2024-08-28 20:15:20.08396919 +0000 UTC m=+0.109592692 container create 03c9553a31e93f319531c9966cce67bc7fe4098edb4397c9dc9fe901e3d465f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:15:20.349 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 podman[54589]: 2024-08-28 20:15:19.990468113 +0000 UTC m=+0.016091616 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:20.349 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 podman[54589]: 2024-08-28 20:15:20.311485905 +0000 UTC m=+0.337109408 container init 03c9553a31e93f319531c9966cce67bc7fe4098edb4397c9dc9fe901e3d465f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-28T20:15:20.349 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 podman[54589]: 2024-08-28 20:15:20.31458054 +0000 UTC m=+0.340204051 container start 03c9553a31e93f319531c9966cce67bc7fe4098edb4397c9dc9fe901e3d465f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:15:20.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:20.815 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 ceph-mds[54609]: -- 172.21.15.7:0/2807954719 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604e7e6f860 con 0x5604ec015600 2024-08-28T20:15:20.815 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e[54605]: starting mds.e at 2024-08-28T20:15:20.815 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 bash[54589]: 03c9553a31e93f319531c9966cce67bc7fe4098edb4397c9dc9fe901e3d465f9 2024-08-28T20:15:20.815 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:15:20 smithi007 systemd[1]: Started Ceph mds.e for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:21.021 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 -- 172.21.15.1:0/1598163945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4109b90 msgr2=0x7f3fd41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 --2- 172.21.15.1:0/1598163945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4109b90 0x7f3fd41103c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009ca0 tx=0x7f3fcc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 -- 172.21.15.1:0/1598163945 shutdown_connections 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 --2- 172.21.15.1:0/1598163945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4109b90 0x7f3fd41103c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 --2- 172.21.15.1:0/1598163945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fd4109240 0x7f3fd4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 --2- 172.21.15.1:0/1598163945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4103900 0x7f3fd4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 -- 172.21.15.1:0/1598163945 >> 172.21.15.1:0/1598163945 conn(0x7f3fd407b5f0 msgr2=0x7f3fd407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 -- 172.21.15.1:0/1598163945 shutdown_connections 2024-08-28T20:15:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.613+0000 7f3fdc200640 1 -- 172.21.15.1:0/1598163945 wait complete. 2024-08-28T20:15:21.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.614+0000 7f3fdc200640 1 Processor -- start 2024-08-28T20:15:21.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 -- start start 2024-08-28T20:15:21.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4103900 0x7f3fd419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 0x7f3fd419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fd4109b90 0x7f3fd41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd41138a0 con 0x7f3fd4103900 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4113720 con 0x7f3fd4109240 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fdc200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4113a20 con 0x7f3fd4109b90 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fd8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 0x7f3fd419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fd9800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4103900 0x7f3fd419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fd8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 0x7f3fd419ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:38338/0 (socket says 172.21.15.1:38338) 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.615+0000 7f3fd8e00640 1 -- 172.21.15.1:0/668044025 learned_addr learned my addr 172.21.15.1:0/668044025 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fda200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fd4109b90 0x7f3fd41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fd8e00640 1 -- 172.21.15.1:0/668044025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fd4109b90 msgr2=0x7f3fd41a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fd8e00640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fd4109b90 0x7f3fd41a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fd8e00640 1 -- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4103900 msgr2=0x7f3fd419c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fd8e00640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4103900 0x7f3fd419c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fd8e00640 1 -- 172.21.15.1:0/668044025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd41a2400 con 0x7f3fd4109240 2024-08-28T20:15:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.616+0000 7f3fd8e00640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 0x7f3fd419ca30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000e9f0 tx=0x7f3fc000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.617+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000ccc0 con 0x7f3fd4109240 2024-08-28T20:15:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.617+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc00108e0 con 0x7f3fd4109240 2024-08-28T20:15:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.617+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0018860 con 0x7f3fd4109240 2024-08-28T20:15:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.617+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd41a26f0 con 0x7f3fd4109240 2024-08-28T20:15:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.617+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd41a8e50 con 0x7f3fd4109240 2024-08-28T20:15:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.618+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd4103d10 con 0x7f3fd4109240 2024-08-28T20:15:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.620+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f3fc0010430 con 0x7f3fd4109240 2024-08-28T20:15:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.622+0000 7f3fd2000640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3fbc0b4b30 0x7f3fbc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.622+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f3fc00e5410 con 0x7f3fd4109240 2024-08-28T20:15:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.622+0000 7f3fd9800640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3fbc0b4b30 0x7f3fbc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.623+0000 7f3fd9800640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3fbc0b4b30 0x7f3fbc0b7040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80095f0 tx=0x7f3fc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:21.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.624+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3fc00ac2f0 con 0x7f3fd4109240 2024-08-28T20:15:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:21.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:21.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:21.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: Deploying daemon mds.f on smithi121 2024-08-28T20:15:21.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6834/2627425818,v1:172.21.15.7:6835/2627425818] up:boot 2024-08-28T20:15:21.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: fsmap 5 up:standby 2024-08-28T20:15:21.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T20:15:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: Deploying daemon mds.f on smithi121 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6834/2627425818,v1:172.21.15.7:6835/2627425818] up:boot 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: fsmap 5 up:standby 2024-08-28T20:15:21.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:21.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: Deploying daemon mds.f on smithi121 2024-08-28T20:15:21.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6834/2627425818,v1:172.21.15.7:6835/2627425818] up:boot 2024-08-28T20:15:21.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: fsmap 5 up:standby 2024-08-28T20:15:21.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T20:15:21.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.857+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fd41a9140 con 0x7f3fd4109240 2024-08-28T20:15:21.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.858+0000 7f3fd2000640 1 -- 172.21.15.1:0/668044025 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7f3fc00b0ab0 con 0x7f3fd4109240 2024-08-28T20:15:21.860 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:21.860 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-08-28T20:15:21:203537+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-28T20:15:21.860 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-08-28T20:15:21.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3fbc0b4b30 msgr2=0x7f3fbc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:21.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3fbc0b4b30 0x7f3fbc0b7040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80095f0 tx=0x7f3fc8005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:21.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 msgr2=0x7f3fd419ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:21.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 0x7f3fd419ca30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000e9f0 tx=0x7f3fc000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 shutdown_connections 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3fbc0b4b30 0x7f3fbc0b7040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fd4109b90 0x7f3fd41a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3fd4109240 0x7f3fd419ca30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 --2- 172.21.15.1:0/668044025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fd4103900 0x7f3fd419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 >> 172.21.15.1:0/668044025 conn(0x7f3fd407b5f0 msgr2=0x7f3fd4107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 shutdown_connections 2024-08-28T20:15:21.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:21.861+0000 7f3fdc200640 1 -- 172.21.15.1:0/668044025 wait complete. 2024-08-28T20:15:22.452 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 systemd[1]: Starting Ceph mds.f for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:22.702 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:22 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/668044025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:22.703 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 podman[54982]: 2024-08-28 20:15:22.361231124 +0000 UTC m=+0.015628434 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:22.703 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 podman[54982]: 2024-08-28 20:15:22.474497456 +0000 UTC m=+0.128894799 container create f44e044acf3e5bdf4fe50a76b6232f7ad40b2b2f1042772f2077a2f11fa5e5b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:15:22.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:22 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/668044025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:22.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:22 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/668044025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:22.979 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 podman[54982]: 2024-08-28 20:15:22.701916567 +0000 UTC m=+0.356313863 container init f44e044acf3e5bdf4fe50a76b6232f7ad40b2b2f1042772f2077a2f11fa5e5b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-28T20:15:22.979 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 podman[54982]: 2024-08-28 20:15:22.70479954 +0000 UTC m=+0.359196846 container start f44e044acf3e5bdf4fe50a76b6232f7ad40b2b2f1042772f2077a2f11fa5e5b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-28T20:15:22.980 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 ceph-mds[55002]: -- 172.21.15.121:0/343589725 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558fc1df9860 con 0x558fc5f9fa80 2024-08-28T20:15:22.980 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f[54998]: starting mds.f at 2024-08-28T20:15:22.980 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 bash[54982]: f44e044acf3e5bdf4fe50a76b6232f7ad40b2b2f1042772f2077a2f11fa5e5b9 2024-08-28T20:15:22.980 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:15:22 smithi121 systemd[1]: Started Ceph mds.f for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:24.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:24.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:24.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: Deploying daemon mds.c on smithi121 2024-08-28T20:15:24.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6834/179317583,v1:172.21.15.121:6835/179317583] up:boot 2024-08-28T20:15:24.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: fsmap 6 up:standby 2024-08-28T20:15:24.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: Deploying daemon mds.c on smithi121 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6834/179317583,v1:172.21.15.121:6835/179317583] up:boot 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: fsmap 6 up:standby 2024-08-28T20:15:24.177 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: Deploying daemon mds.c on smithi121 2024-08-28T20:15:24.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6834/179317583,v1:172.21.15.121:6835/179317583] up:boot 2024-08-28T20:15:24.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: fsmap 6 up:standby 2024-08-28T20:15:24.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T20:15:24.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:24.730 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:24 smithi121 systemd[1]: Starting Ceph mds.c for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:24.964 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:25.092 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:24 smithi121 podman[55287]: 2024-08-28 20:15:24.738697942 +0000 UTC m=+0.016284792 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:25.092 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:24 smithi121 podman[55287]: 2024-08-28 20:15:24.836064464 +0000 UTC m=+0.113651303 container create d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:15:25.092 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:25 smithi121 podman[55287]: 2024-08-28 20:15:25.055338517 +0000 UTC m=+0.332925363 container init d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-28T20:15:25.092 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:25 smithi121 podman[55287]: 2024-08-28 20:15:25.058106333 +0000 UTC m=+0.335693173 container start d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-28T20:15:25.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mds[55306]: -- 172.21.15.121:0/1521798478 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c31b1cb860 con 0x55c31f371600 2024-08-28T20:15:25.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c[55302]: starting mds.c at 2024-08-28T20:15:25.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:25 smithi121 bash[55287]: d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 2024-08-28T20:15:25.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:15:25 smithi121 systemd[1]: Started Ceph mds.c for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 -- 172.21.15.1:0/4211910205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109260 msgr2=0x7f8c44109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 --2- 172.21.15.1:0/4211910205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109260 0x7f8c44109670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009900 tx=0x7f8c2c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 -- 172.21.15.1:0/4211910205 shutdown_connections 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 --2- 172.21.15.1:0/4211910205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44109bb0 0x7f8c441103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 --2- 172.21.15.1:0/4211910205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109260 0x7f8c44109670 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 --2- 172.21.15.1:0/4211910205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44103920 0x7f8c44103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 -- 172.21.15.1:0/4211910205 >> 172.21.15.1:0/4211910205 conn(0x7f8c440ff370 msgr2=0x7f8c441017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 -- 172.21.15.1:0/4211910205 shutdown_connections 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.624+0000 7f8c49400640 1 -- 172.21.15.1:0/4211910205 wait complete. 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.625+0000 7f8c49400640 1 Processor -- start 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.625+0000 7f8c49400640 1 -- start start 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c49400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44103920 0x7f8c4419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44109260 0x7f8c4419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:25.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c49400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 0x7f8c441a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c49400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8c441138c0 con 0x7f8c44103920 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c49400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44113740 con 0x7f8c44109260 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c49400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44113a40 con 0x7f8c44109bb0 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c42800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44103920 0x7f8c4419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c43200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 0x7f8c441a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c3be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44109260 0x7f8c4419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c43200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 0x7f8c441a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33476/0 (socket says 172.21.15.1:33476) 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c43200640 1 -- 172.21.15.1:0/2179490566 learned_addr learned my addr 172.21.15.1:0/2179490566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c42800640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44103920 0x7f8c4419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48164/0 (socket says 172.21.15.1:48164) 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c3be00640 1 -- 172.21.15.1:0/2179490566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 msgr2=0x7f8c441a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c3be00640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 0x7f8c441a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c3be00640 1 -- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44103920 msgr2=0x7f8c4419c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c3be00640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44103920 0x7f8c4419c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.626+0000 7f8c3be00640 1 -- 172.21.15.1:0/2179490566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c441a2480 con 0x7f8c44109260 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c43200640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 0x7f8c441a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c3be00640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44109260 0x7f8c4419cab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009230 tx=0x7f8c2c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c03f070 con 0x7f8c44109260 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c441a2710 con 0x7f8c44109260 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c2c031b50 con 0x7f8c44109260 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c035030 con 0x7f8c44109260 2024-08-28T20:15:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.627+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c441a8ed0 con 0x7f8c44109260 2024-08-28T20:15:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.628+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c44104ba0 con 0x7f8c44109260 2024-08-28T20:15:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.631+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f8c2c042070 con 0x7f8c44109260 2024-08-28T20:15:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.632+0000 7f8c3b400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c280b4b30 0x7f8c280b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.632+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f8c2c104e90 con 0x7f8c44109260 2024-08-28T20:15:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.632+0000 7f8c42800640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c280b4b30 0x7f8c280b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.633+0000 7f8c42800640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c280b4b30 0x7f8c280b7040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009bd0 tx=0x7f8c34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:25.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.637+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c2c0cbd70 con 0x7f8c44109260 2024-08-28T20:15:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.870+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c441a90a0 con 0x7f8c44109260 2024-08-28T20:15:25.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.871+0000 7f8c3b400640 1 -- 172.21.15.1:0/2179490566 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6379 (secure 0 0 0) 0x7f8c2c0d0530 con 0x7f8c44109260 2024-08-28T20:15:25.872 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:25.872 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-08-28T20:15:25:836983+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-28T20:15:25.873 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c280b4b30 msgr2=0x7f8c280b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c280b4b30 0x7f8c280b7040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009bd0 tx=0x7f8c34005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44109260 msgr2=0x7f8c4419cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44109260 0x7f8c4419cab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009230 tx=0x7f8c2c003b90 comp rx=0 tx=0).stop 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 shutdown_connections 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8c280b4b30 0x7f8c280b7040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c44109bb0 0x7f8c441a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c44109260 0x7f8c4419cab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 --2- 172.21.15.1:0/2179490566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c44103920 0x7f8c4419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 >> 172.21.15.1:0/2179490566 conn(0x7f8c440ff370 msgr2=0x7f8c441068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 shutdown_connections 2024-08-28T20:15:25.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:25.873+0000 7f8c49400640 1 -- 172.21.15.1:0/2179490566 wait complete. 2024-08-28T20:15:25.890 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:25.890 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:25.891 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:25.891 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:25.891 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:25.891 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:25.891 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:25 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:26.226 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:25 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:26.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:26.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:25 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:26 smithi001 ceph-mon[20984]: Deploying daemon mds.h on smithi007 2024-08-28T20:15:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:26 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6836/1661917289,v1:172.21.15.121:6837/1661917289] up:boot 2024-08-28T20:15:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:26 smithi001 ceph-mon[20984]: fsmap 7 up:standby 2024-08-28T20:15:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T20:15:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2179490566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:26 smithi121 ceph-mon[25248]: Deploying daemon mds.h on smithi007 2024-08-28T20:15:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:26 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6836/1661917289,v1:172.21.15.121:6837/1661917289] up:boot 2024-08-28T20:15:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:26 smithi121 ceph-mon[25248]: fsmap 7 up:standby 2024-08-28T20:15:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T20:15:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2179490566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:27.262 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 systemd[1]: Starting Ceph mds.h for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:27.263 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:26 smithi007 ceph-mon[25357]: Deploying daemon mds.h on smithi007 2024-08-28T20:15:27.263 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:26 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6836/1661917289,v1:172.21.15.121:6837/1661917289] up:boot 2024-08-28T20:15:27.263 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:26 smithi007 ceph-mon[25357]: fsmap 7 up:standby 2024-08-28T20:15:27.263 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T20:15:27.263 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2179490566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:27.533 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 podman[54893]: 2024-08-28 20:15:27.164152722 +0000 UTC m=+0.015504640 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:27.533 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 podman[54893]: 2024-08-28 20:15:27.28391868 +0000 UTC m=+0.135270586 container create e8d292d41c0af73dd66df5b17bcff9d7f721ec17d7cbd30daa14bd5664aef593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True) 2024-08-28T20:15:27.533 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 podman[54893]: 2024-08-28 20:15:27.532451667 +0000 UTC m=+0.383803576 container init e8d292d41c0af73dd66df5b17bcff9d7f721ec17d7cbd30daa14bd5664aef593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-28T20:15:27.815 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 podman[54893]: 2024-08-28 20:15:27.535455869 +0000 UTC m=+0.386807769 container start e8d292d41c0af73dd66df5b17bcff9d7f721ec17d7cbd30daa14bd5664aef593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-28T20:15:27.815 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mds[54912]: -- 172.21.15.7:0/2134330660 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4495cd860 con 0x55a44d773a80 2024-08-28T20:15:27.815 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h[54908]: starting mds.h at 2024-08-28T20:15:27.815 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 bash[54893]: e8d292d41c0af73dd66df5b17bcff9d7f721ec17d7cbd30daa14bd5664aef593 2024-08-28T20:15:27.815 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:15:27 smithi007 systemd[1]: Started Ceph mds.h for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:28.104 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:28.104 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:28.104 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:28.105 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:28.105 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:28.105 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:28.105 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:28.606 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:28.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:28 smithi001 ceph-mon[20984]: Deploying daemon mds.i on smithi121 2024-08-28T20:15:28.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:28 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6836/3668716781,v1:172.21.15.7:6837/3668716781] up:boot 2024-08-28T20:15:28.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:28 smithi001 ceph-mon[20984]: fsmap 8 up:standby 2024-08-28T20:15:28.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T20:15:28.998 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:29.213 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:28 smithi121 ceph-mon[25248]: Deploying daemon mds.i on smithi121 2024-08-28T20:15:29.213 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:28 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6836/3668716781,v1:172.21.15.7:6837/3668716781] up:boot 2024-08-28T20:15:29.213 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:28 smithi121 ceph-mon[25248]: fsmap 8 up:standby 2024-08-28T20:15:29.214 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T20:15:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:28 smithi007 ceph-mon[25357]: Deploying daemon mds.i on smithi121 2024-08-28T20:15:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:28 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6836/3668716781,v1:172.21.15.7:6837/3668716781] up:boot 2024-08-28T20:15:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:28 smithi007 ceph-mon[25357]: fsmap 8 up:standby 2024-08-28T20:15:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T20:15:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 -- 172.21.15.1:0/983407587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 msgr2=0x7f5f7010f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 --2- 172.21.15.1:0/983407587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 0x7f5f7010f9a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009900 tx=0x7f5f5c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 -- 172.21.15.1:0/983407587 shutdown_connections 2024-08-28T20:15:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 --2- 172.21.15.1:0/983407587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 0x7f5f7010f9a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 --2- 172.21.15.1:0/983407587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 0x7f5f70112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 --2- 172.21.15.1:0/983407587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f700758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.697+0000 7f5f76600640 1 -- 172.21.15.1:0/983407587 >> 172.21.15.1:0/983407587 conn(0x7f5f7007b5f0 msgr2=0x7f5f7007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.698+0000 7f5f76600640 1 -- 172.21.15.1:0/983407587 shutdown_connections 2024-08-28T20:15:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.698+0000 7f5f76600640 1 -- 172.21.15.1:0/983407587 wait complete. 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 Processor -- start 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 -- start start 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f7019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 0x7f5f7019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 0x7f5f701a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70115a70 con 0x7f5f70075e20 2024-08-28T20:15:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701158f0 con 0x7f5f7010fee0 2024-08-28T20:15:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f76600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70115bf0 con 0x7f5f700754d0 2024-08-28T20:15:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f6f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f7019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f6ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 0x7f5f7019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f6fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 0x7f5f701a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f6f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f7019c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45082/0 (socket says 172.21.15.1:45082) 2024-08-28T20:15:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.699+0000 7f5f6f400640 1 -- 172.21.15.1:0/3868275140 learned_addr learned my addr 172.21.15.1:0/3868275140 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6f400640 1 -- 172.21.15.1:0/3868275140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 msgr2=0x7f5f701a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6f400640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 0x7f5f701a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6f400640 1 -- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 msgr2=0x7f5f7019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6f400640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 0x7f5f7019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6f400640 1 -- 172.21.15.1:0/3868275140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f701a2350 con 0x7f5f700754d0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6fe00640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 0x7f5f701a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f6f400640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f7019c3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000e9f0 tx=0x7f5f6000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.700+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000cd80 con 0x7f5f700754d0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.701+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f701a2640 con 0x7f5f700754d0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.701+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f600108e0 con 0x7f5f700754d0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.701+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60018980 con 0x7f5f700754d0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.701+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f701a8da0 con 0x7f5f700754d0 2024-08-28T20:15:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.702+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f700758e0 con 0x7f5f700754d0 2024-08-28T20:15:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.704+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f5f60010430 con 0x7f5f700754d0 2024-08-28T20:15:29.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.706+0000 7f5f67e00640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f540b4b30 0x7f5f540b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:29.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.706+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f5f600e5500 con 0x7f5f700754d0 2024-08-28T20:15:29.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.706+0000 7f5f6ea00640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f540b4b30 0x7f5f540b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:29.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.707+0000 7f5f6ea00640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f540b4b30 0x7f5f540b7040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c02a9e0 tx=0x7f5f5c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.711+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f600ac3e0 con 0x7f5f700754d0 2024-08-28T20:15:29.729 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:29 smithi121 systemd[1]: Starting Ceph mds.i for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:29.938 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:29 smithi007 ceph-mon[25357]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:29.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.945+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f7002e430 con 0x7f5f700754d0 2024-08-28T20:15:29.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.946+0000 7f5f67e00640 1 -- 172.21.15.1:0/3868275140 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7201 (secure 0 0 0) 0x7f5f600b0ba0 con 0x7f5f700754d0 2024-08-28T20:15:29.948 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:29.948 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":9,"btime":"2024-08-28T20:15:27:850243+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-28T20:15:29.948 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 9 2024-08-28T20:15:29.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f540b4b30 msgr2=0x7f5f540b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f540b4b30 0x7f5f540b7040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c02a9e0 tx=0x7f5f5c005a20 comp rx=0 tx=0).stop 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 msgr2=0x7f5f7019c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f7019c3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000e9f0 tx=0x7f5f6000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 shutdown_connections 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f540b4b30 0x7f5f540b7040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f70075e20 0x7f5f7019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7010fee0 0x7f5f701a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 --2- 172.21.15.1:0/3868275140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f700754d0 0x7f5f7019c3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 >> 172.21.15.1:0/3868275140 conn(0x7f5f7007b5f0 msgr2=0x7f5f70101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:29.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 shutdown_connections 2024-08-28T20:15:29.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:29.949+0000 7f5f76600640 1 -- 172.21.15.1:0/3868275140 wait complete. 2024-08-28T20:15:30.111 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:29 smithi121 ceph-mon[25248]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:30.112 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:29 smithi121 podman[55588]: 2024-08-28 20:15:29.856030134 +0000 UTC m=+0.107106456 container create 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-28T20:15:30.112 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:29 smithi121 podman[55588]: 2024-08-28 20:15:29.764435475 +0000 UTC m=+0.015511753 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:30.112 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:30 smithi121 podman[55588]: 2024-08-28 20:15:30.075179133 +0000 UTC m=+0.326255413 container init 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-28T20:15:30.112 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:30 smithi121 podman[55588]: 2024-08-28 20:15:30.078032759 +0000 UTC m=+0.329109039 container start 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:15:30.226 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:29 smithi001 ceph-mon[20984]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:30.479 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mds[55608]: -- 172.21.15.121:0/3363174756 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563098bef860 con 0x56309cd95a80 2024-08-28T20:15:30.479 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i[55604]: starting mds.i at 2024-08-28T20:15:30.480 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:30 smithi121 bash[55588]: 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 2024-08-28T20:15:30.480 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:15:30 smithi121 systemd[1]: Started Ceph mds.i for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:30.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3868275140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:30.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:30.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:30.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:30.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:30.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:30.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:31.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3868275140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:31.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:31.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:31.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:31.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:31.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:31.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:31.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3868275140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:31.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:31.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:31.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:31.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:31.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:31.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:32.132 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:31 smithi001 ceph-mon[20984]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:32.132 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:31 smithi001 ceph-mon[20984]: Deploying daemon mds.g on smithi001 2024-08-28T20:15:32.132 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:31 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] up:boot 2024-08-28T20:15:32.132 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:31 smithi001 ceph-mon[20984]: fsmap 9 up:standby 2024-08-28T20:15:32.132 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:15:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:31 smithi121 ceph-mon[25248]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:31 smithi121 ceph-mon[25248]: Deploying daemon mds.g on smithi001 2024-08-28T20:15:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:31 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] up:boot 2024-08-28T20:15:32.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:31 smithi121 ceph-mon[25248]: fsmap 9 up:standby 2024-08-28T20:15:32.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:15:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:31 smithi007 ceph-mon[25357]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:31 smithi007 ceph-mon[25357]: Deploying daemon mds.g on smithi001 2024-08-28T20:15:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:31 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] up:boot 2024-08-28T20:15:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:31 smithi007 ceph-mon[25357]: fsmap 9 up:standby 2024-08-28T20:15:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:15:32.734 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:33.174 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:32 smithi001 ceph-mon[20984]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:33.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:32 smithi121 ceph-mon[25248]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:33.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:32 smithi007 ceph-mon[25357]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:33.477 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 podman[63666]: 2024-08-28 20:15:33.191837002 +0000 UTC m=+0.143098509 container create 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-28T20:15:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:33.776 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 podman[63666]: 2024-08-28 20:15:33.503237837 +0000 UTC m=+0.454499344 container init 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-28T20:15:33.776 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 podman[63666]: 2024-08-28 20:15:33.510231887 +0000 UTC m=+0.461493399 container start 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-28T20:15:33.776 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 bash[63666]: 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 2024-08-28T20:15:33.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 ceph-mds[63711]: -- 172.21.15.1:0/1534675237 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562c9475860 con 0x5562cd61b600 2024-08-28T20:15:33.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g[63692]: starting mds.g at 2024-08-28T20:15:33.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:15:33 smithi001 systemd[1]: Started Ceph mds.g for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:34.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 -- 172.21.15.1:0/2652513604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f379810fdb0 msgr2=0x7f37981121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:34.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 --2- 172.21.15.1:0/2652513604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f379810fdb0 0x7f37981121d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3790009ca0 tx=0x7f379002a950 comp rx=0 tx=0).stop 2024-08-28T20:15:34.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 -- 172.21.15.1:0/2652513604 shutdown_connections 2024-08-28T20:15:34.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 --2- 172.21.15.1:0/2652513604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f379810fdb0 0x7f37981121d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 --2- 172.21.15.1:0/2652513604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3798102b50 0x7f379810f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 --2- 172.21.15.1:0/2652513604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f3798102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 -- 172.21.15.1:0/2652513604 >> 172.21.15.1:0/2652513604 conn(0x7f37980fe060 msgr2=0x7f37981004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:34.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 -- 172.21.15.1:0/2652513604 shutdown_connections 2024-08-28T20:15:34.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.346+0000 7f379d800640 1 -- 172.21.15.1:0/2652513604 wait complete. 2024-08-28T20:15:34.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.347+0000 7f379d800640 1 Processor -- start 2024-08-28T20:15:34.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.347+0000 7f379d800640 1 -- start start 2024-08-28T20:15:34.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f379819c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:34.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379d800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3798102b50 0x7f379819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:34.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f379810fdb0 0x7f37981a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379d800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3798115850 con 0x7f3798102b50 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37981156d0 con 0x7f379810fdb0 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379d800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37981159d0 con 0x7f3798102200 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f3797e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f379819c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f3797e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f379819c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45116/0 (socket says 172.21.15.1:45116) 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f3797e00640 1 -- 172.21.15.1:0/2239930552 learned_addr learned my addr 172.21.15.1:0/2239930552 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f3797400640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3798102b50 0x7f379819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.348+0000 7f379ce00640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f379810fdb0 0x7f37981a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3797e00640 1 -- 172.21.15.1:0/2239930552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f379810fdb0 msgr2=0x7f37981a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3797e00640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f379810fdb0 0x7f37981a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3797e00640 1 -- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3798102b50 msgr2=0x7f379819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3797e00640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3798102b50 0x7f379819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3797e00640 1 -- 172.21.15.1:0/2239930552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37981a2130 con 0x7f3798102200 2024-08-28T20:15:34.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3797e00640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f379819c1c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f378800e9f0 tx=0x7f378800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:34.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.349+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378800cd80 con 0x7f3798102200 2024-08-28T20:15:34.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.350+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37981a2420 con 0x7f3798102200 2024-08-28T20:15:34.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.350+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37880054d0 con 0x7f3798102200 2024-08-28T20:15:34.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.350+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788010690 con 0x7f3798102200 2024-08-28T20:15:34.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.350+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37981a8b80 con 0x7f3798102200 2024-08-28T20:15:34.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.351+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3798102610 con 0x7f3798102200 2024-08-28T20:15:34.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.354+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f3788004e30 con 0x7f3798102200 2024-08-28T20:15:34.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.355+0000 7f3794c00640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f377c0b4b30 0x7f377c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:34.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.355+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f37880e52d0 con 0x7f3798102200 2024-08-28T20:15:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.355+0000 7f3797400640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f377c0b4b30 0x7f377c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.356+0000 7f3797400640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f377c0b4b30 0x7f377c0b7040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3798103c80 tx=0x7f3784005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:34.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.357+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37880ac800 con 0x7f3798102200 2024-08-28T20:15:34.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.605+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f379819d2f0 con 0x7f3798102200 2024-08-28T20:15:34.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.606+0000 7f3794c00640 1 -- 172.21.15.1:0/2239930552 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8851 (secure 0 0 0) 0x7f37880ac100 con 0x7f3798102200 2024-08-28T20:15:34.609 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:34.609 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"btime":"2024-08-28T20:15:33:924640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24673,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-08-28T20:15:34.609 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 11 2024-08-28T20:15:34.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f377c0b4b30 msgr2=0x7f377c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f377c0b4b30 0x7f377c0b7040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3798103c80 tx=0x7f3784005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 msgr2=0x7f379819c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f379819c1c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f378800e9f0 tx=0x7f378800edf0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 shutdown_connections 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f377c0b4b30 0x7f377c0b7040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3798102b50 0x7f379819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f379810fdb0 0x7f37981a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 --2- 172.21.15.1:0/2239930552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3798102200 0x7f379819c1c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:34.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 >> 172.21.15.1:0/2239930552 conn(0x7f37980fe060 msgr2=0x7f3798111710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:34.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 shutdown_connections 2024-08-28T20:15:34.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:34.609+0000 7f379d800640 1 -- 172.21.15.1:0/2239930552 wait complete. 2024-08-28T20:15:34.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:34.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:34.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:34.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:34.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:34.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:34.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: Deploying daemon mds.a on smithi001 2024-08-28T20:15:34.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] up:boot 2024-08-28T20:15:34.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: fsmap 10 up:standby 2024-08-28T20:15:34.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T20:15:34.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:34 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2239930552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:34.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: Deploying daemon mds.a on smithi001 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] up:boot 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: fsmap 10 up:standby 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T20:15:34.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:34 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2239930552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: Deploying daemon mds.a on smithi001 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] up:boot 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: fsmap 10 up:standby 2024-08-28T20:15:35.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T20:15:35.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:34 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2239930552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:35.865 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:35 smithi001 ceph-mon[20984]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:35.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:35 smithi121 ceph-mon[25248]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:36.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:35 smithi007 ceph-mon[25357]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:37.354 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 systemd[1]: Starting Ceph mds.a for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:15:37.608 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 podman[64048]: 2024-08-28 20:15:37.256412789 +0000 UTC m=+0.028307834 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:15:37.608 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 podman[64048]: 2024-08-28 20:15:37.362421474 +0000 UTC m=+0.134316525 container create d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-28T20:15:37.608 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 podman[64048]: 2024-08-28 20:15:37.606821023 +0000 UTC m=+0.378716069 container init d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-28T20:15:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:37 smithi001 ceph-mon[20984]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:37.978 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 podman[64048]: 2024-08-28 20:15:37.613173684 +0000 UTC m=+0.385068729 container start d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-28T20:15:37.978 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 bash[64048]: d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a 2024-08-28T20:15:37.978 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 systemd[1]: Started Ceph mds.a for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:37.978 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 ceph-mds[64067]: -- 172.21.15.1:0/3562235787 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623a7cf9860 con 0x5623abe9f180 2024-08-28T20:15:37.978 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:15:37 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a[64063]: starting mds.a at 2024-08-28T20:15:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:37 smithi121 ceph-mon[25248]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:37 smithi007 ceph-mon[25357]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:38.071 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:38.927 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:38.927 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:38.927 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: Deploying daemon mds.b on smithi007 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.1:6840/508380082,v1:172.21.15.1:6841/508380082] up:boot 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: fsmap 11 up:standby 2024-08-28T20:15:38.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T20:15:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:39.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:39.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:39.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:39.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:39.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: Deploying daemon mds.b on smithi007 2024-08-28T20:15:39.066 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.1:6840/508380082,v1:172.21.15.1:6841/508380082] up:boot 2024-08-28T20:15:39.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: fsmap 11 up:standby 2024-08-28T20:15:39.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T20:15:39.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 -- 172.21.15.1:0/1135990048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10bbf0 msgr2=0x7feddc112420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 --2- 172.21.15.1:0/1135990048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10bbf0 0x7feddc112420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009ca0 tx=0x7fedd402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 -- 172.21.15.1:0/1135990048 shutdown_connections 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 --2- 172.21.15.1:0/1135990048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10bbf0 0x7feddc112420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 --2- 172.21.15.1:0/1135990048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc10b2a0 0x7feddc10b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 --2- 172.21.15.1:0/1135990048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc105960 0x7feddc105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.105+0000 7fede0c00640 1 -- 172.21.15.1:0/1135990048 >> 172.21.15.1:0/1135990048 conn(0x7feddc101410 msgr2=0x7feddc103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:39.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.106+0000 7fede0c00640 1 -- 172.21.15.1:0/1135990048 shutdown_connections 2024-08-28T20:15:39.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.106+0000 7fede0c00640 1 -- 172.21.15.1:0/1135990048 wait complete. 2024-08-28T20:15:39.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 Processor -- start 2024-08-28T20:15:39.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 -- start start 2024-08-28T20:15:39.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 0x7feddc19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10b2a0 0x7feddc19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc10bbf0 0x7feddc1a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feddc115900 con 0x7feddc10b2a0 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feddc115780 con 0x7feddc105960 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.107+0000 7fede0c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feddc115a80 con 0x7feddc10bbf0 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 0x7feddc19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10b2a0 0x7feddc19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:39.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 0x7feddc19c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57462/0 (socket says 172.21.15.1:57462) 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 -- 172.21.15.1:0/3641615429 learned_addr learned my addr 172.21.15.1:0/3641615429 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddbe00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc10bbf0 0x7feddc1a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 -- 172.21.15.1:0/3641615429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc10bbf0 msgr2=0x7feddc1a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc10bbf0 0x7feddc1a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 -- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10b2a0 msgr2=0x7feddc19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10b2a0 0x7feddc19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 -- 172.21.15.1:0/3641615429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc1a21a0 con 0x7feddc105960 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7feddb400640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 0x7feddc19c230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00e9f0 tx=0x7fedcc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:39.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.108+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00cd80 con 0x7feddc105960 2024-08-28T20:15:39.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.109+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedcc0108e0 con 0x7feddc105960 2024-08-28T20:15:39.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.109+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc1a2490 con 0x7feddc105960 2024-08-28T20:15:39.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.109+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc018980 con 0x7feddc105960 2024-08-28T20:15:39.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.109+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc1a8bf0 con 0x7feddc105960 2024-08-28T20:15:39.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.110+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc105d70 con 0x7feddc105960 2024-08-28T20:15:39.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.112+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7fedcc010430 con 0x7feddc105960 2024-08-28T20:15:39.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.114+0000 7fedd8c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fedc00b4bb0 0x7fedc00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:39.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.114+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fedcc0e5520 con 0x7feddc105960 2024-08-28T20:15:39.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.114+0000 7fedd3e00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fedc00b4bb0 0x7fedc00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:39.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.114+0000 7fedd3e00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fedc00b4bb0 0x7fedc00b70c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feddc10ad00 tx=0x7fedc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:39.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.115+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fedcc0aca50 con 0x7feddc105960 2024-08-28T20:15:39.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: Deploying daemon mds.b on smithi007 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.1:6840/508380082,v1:172.21.15.1:6841/508380082] up:boot 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: fsmap 11 up:standby 2024-08-28T20:15:39.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T20:15:39.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.350+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feddc19d360 con 0x7feddc105960 2024-08-28T20:15:39.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.351+0000 7fedd8c00640 1 -- 172.21.15.1:0/3641615429 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9671 (secure 0 0 0) 0x7fedcc0ac350 con 0x7feddc105960 2024-08-28T20:15:39.352 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:39.353 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":12,"btime":"2024-08-28T20:15:38:711494+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24673,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-08-28T20:15:39.353 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 12 2024-08-28T20:15:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fedc00b4bb0 msgr2=0x7fedc00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fedc00b4bb0 0x7fedc00b70c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feddc10ad00 tx=0x7fedc4005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 msgr2=0x7feddc19c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 0x7feddc19c230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00e9f0 tx=0x7fedcc00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 shutdown_connections 2024-08-28T20:15:39.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fedc00b4bb0 0x7fedc00b70c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feddc10b2a0 0x7feddc19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc10bbf0 0x7feddc1a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 --2- 172.21.15.1:0/3641615429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feddc105960 0x7feddc19c230 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 >> 172.21.15.1:0/3641615429 conn(0x7feddc101410 msgr2=0x7feddc1088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.353+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 shutdown_connections 2024-08-28T20:15:39.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:39.354+0000 7fede0c00640 1 -- 172.21.15.1:0/3641615429 wait complete. 2024-08-28T20:15:39.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:39 smithi001 ceph-mon[20984]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:39.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:39 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3641615429' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:40.003 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:39 smithi007 ceph-mon[25357]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:40.003 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:39 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3641615429' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:40.130 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:39 smithi121 ceph-mon[25248]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:40.131 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:39 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3641615429' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:40.565 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:15:40 smithi007 systemd[1]: Started Ceph mds.b for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:15:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:41.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] up:boot 2024-08-28T20:15:41.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: fsmap 12 up:standby 2024-08-28T20:15:41.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:41.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] up:boot 2024-08-28T20:15:41.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: fsmap 12 up:standby 2024-08-28T20:15:41.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:41.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] up:boot 2024-08-28T20:15:41.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: fsmap 12 up:standby 2024-08-28T20:15:41.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T20:15:42.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:15:42.524 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 -- 172.21.15.1:0/3295430896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109260 msgr2=0x7f4abc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3295430896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109260 0x7f4abc109670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009860 tx=0x7f4aa802a340 comp rx=0 tx=0).stop 2024-08-28T20:15:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 -- 172.21.15.1:0/3295430896 shutdown_connections 2024-08-28T20:15:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3295430896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109260 0x7f4abc109670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3295430896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc109bb0 0x7f4abc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3295430896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc103920 0x7f4abc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 -- 172.21.15.1:0/3295430896 >> 172.21.15.1:0/3295430896 conn(0x7f4abc0ff3b0 msgr2=0x7f4abc101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:43.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 -- 172.21.15.1:0/3295430896 shutdown_connections 2024-08-28T20:15:43.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.178+0000 7f4ac2600640 1 -- 172.21.15.1:0/3295430896 wait complete. 2024-08-28T20:15:43.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 Processor -- start 2024-08-28T20:15:43.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 -- start start 2024-08-28T20:15:43.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 0x7f4abc19c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:43.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc109260 0x7f4abc19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:43.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109bb0 0x7f4abc1a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:43.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc113870 con 0x7f4abc109bb0 2024-08-28T20:15:43.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc1136f0 con 0x7f4abc109260 2024-08-28T20:15:43.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.180+0000 7f4ac2600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc1139f0 con 0x7f4abc103920 2024-08-28T20:15:43.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 0x7f4abc19c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:43.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 0x7f4abc19c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34794/0 (socket says 172.21.15.1:34794) 2024-08-28T20:15:43.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 -- 172.21.15.1:0/3552603208 learned_addr learned my addr 172.21.15.1:0/3552603208 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:43.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abbe00640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109bb0 0x7f4abc1a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:43.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abaa00640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc109260 0x7f4abc19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 -- 172.21.15.1:0/3552603208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc109260 msgr2=0x7f4abc19ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc109260 0x7f4abc19ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 -- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109bb0 msgr2=0x7f4abc1a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109bb0 0x7f4abc1a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 -- 172.21.15.1:0/3552603208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc1a2410 con 0x7f4abc103920 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.181+0000 7f4abb400640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 0x7f4abc19c4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00e9c0 tx=0x7f4aac00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.182+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00cde0 con 0x7f4abc103920 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.182+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aac0035f0 con 0x7f4abc103920 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.182+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac010690 con 0x7f4abc103920 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.182+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc1a2700 con 0x7f4abc103920 2024-08-28T20:15:43.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.182+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc1a8e60 con 0x7f4abc103920 2024-08-28T20:15:43.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.183+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc104ba0 con 0x7f4abc103920 2024-08-28T20:15:43.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.185+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f4aac004000 con 0x7f4abc103920 2024-08-28T20:15:43.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.187+0000 7f4ab3e00640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4aa00b4bb0 0x7f4aa00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:43.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.187+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f4aac0e50b0 con 0x7f4abc103920 2024-08-28T20:15:43.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.187+0000 7f4abaa00640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4aa00b4bb0 0x7f4aa00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:43.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.188+0000 7f4abaa00640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4aa00b4bb0 0x7f4aa00b70c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8035040 tx=0x7f4aa8030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:43.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.189+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4aac0ac670 con 0x7f4abc103920 2024-08-28T20:15:43.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:42 smithi001 ceph-mon[20984]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:43.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:42 smithi121 ceph-mon[25248]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:43.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:43.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:42 smithi007 ceph-mon[25357]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:43.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.436+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4abc103d30 con 0x7f4abc103920 2024-08-28T20:15:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.437+0000 7f4ab3e00640 1 -- 172.21.15.1:0/3552603208 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10494 (secure 0 0 0) 0x7f4aac0abf70 con 0x7f4abc103920 2024-08-28T20:15:43.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:43.438 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-08-28T20:15:40:811961+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24646,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24673,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-28T20:15:43.439 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4aa00b4bb0 msgr2=0x7f4aa00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4aa00b4bb0 0x7f4aa00b70c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8035040 tx=0x7f4aa8030340 comp rx=0 tx=0).stop 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 msgr2=0x7f4abc19c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 0x7f4abc19c4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00e9c0 tx=0x7f4aac00ee80 comp rx=0 tx=0).stop 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 shutdown_connections 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4aa00b4bb0 0x7f4aa00b70c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4abc109bb0 0x7f4abc1a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc109260 0x7f4abc19ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 --2- 172.21.15.1:0/3552603208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4abc103920 0x7f4abc19c4a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 >> 172.21.15.1:0/3552603208 conn(0x7f4abc0ff3b0 msgr2=0x7f4abc108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 shutdown_connections 2024-08-28T20:15:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:43.439+0000 7f4ac2600640 1 -- 172.21.15.1:0/3552603208 wait complete. 2024-08-28T20:15:44.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-28T20:15:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3552603208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:44.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:44.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3552603208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:44.597 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:44.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3552603208' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:44.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 -- 172.21.15.1:0/2214738597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498075b70 msgr2=0x7fb498075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 --2- 172.21.15.1:0/2214738597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498075b70 0x7fb498075f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb484009900 tx=0x7fb48402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 -- 172.21.15.1:0/2214738597 shutdown_connections 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 --2- 172.21.15.1:0/2214738597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498075b70 0x7fb498075f80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 --2- 172.21.15.1:0/2214738597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498114020 0x7fb4981164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 --2- 172.21.15.1:0/2214738597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb498077120 0x7fb498075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 -- 172.21.15.1:0/2214738597 >> 172.21.15.1:0/2214738597 conn(0x7fb4980ff1e0 msgr2=0x7fb498101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 -- 172.21.15.1:0/2214738597 shutdown_connections 2024-08-28T20:15:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.228+0000 7fb49ea00640 1 -- 172.21.15.1:0/2214738597 wait complete. 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.229+0000 7fb49ea00640 1 Processor -- start 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.229+0000 7fb49ea00640 1 -- start start 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 0x7fb4981a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498077120 0x7fb4981a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb498114020 0x7fb4981a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49ea00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb498119c60 con 0x7fb498077120 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb498119ae0 con 0x7fb498114020 2024-08-28T20:15:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49ea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb498119de0 con 0x7fb498075b70 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 0x7fb4981a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 0x7fb4981a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34826/0 (socket says 172.21.15.1:34826) 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 -- 172.21.15.1:0/1878454625 learned_addr learned my addr 172.21.15.1:0/1878454625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49cc00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498077120 0x7fb4981a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49e000640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb498114020 0x7fb4981a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 -- 172.21.15.1:0/1878454625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb498114020 msgr2=0x7fb4981a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb498114020 0x7fb4981a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 -- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498077120 msgr2=0x7fb4981a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.230+0000 7fb49d600640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498077120 0x7fb4981a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb49d600640 1 -- 172.21.15.1:0/1878454625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4981a65e0 con 0x7fb498075b70 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb49cc00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498077120 0x7fb4981a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb49d600640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 0x7fb4981a0670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00ea60 tx=0x7fb48c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00cde0 con 0x7fb498075b70 2024-08-28T20:15:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48c0035f0 con 0x7fb498075b70 2024-08-28T20:15:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4981a68d0 con 0x7fb498075b70 2024-08-28T20:15:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c010690 con 0x7fb498075b70 2024-08-28T20:15:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.231+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981ad030 con 0x7fb498075b70 2024-08-28T20:15:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.232+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb498075f80 con 0x7fb498075b70 2024-08-28T20:15:45.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.235+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7fb48c0037a0 con 0x7fb498075b70 2024-08-28T20:15:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.236+0000 7fb496000640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb4800b4bb0 0x7fb4800b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.237+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fb48c0e5460 con 0x7fb498075b70 2024-08-28T20:15:45.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.237+0000 7fb49cc00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb4800b4bb0 0x7fb4800b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.237+0000 7fb49cc00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb4800b4bb0 0x7fb4800b70c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb484000c00 tx=0x7fb484032cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.238+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb48c0ac990 con 0x7fb498075b70 2024-08-28T20:15:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.455+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb4981a17a0 con 0x7fb498075b70 2024-08-28T20:15:45.457 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:45 smithi001 ceph-mon[20984]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.456+0000 7fb496000640 1 -- 172.21.15.1:0/1878454625 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) ==== 84+0+65 (secure 0 0 0) 0x7fb48c0ac290 con 0x7fb498075b70 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:15:45.458 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb4800b4bb0 msgr2=0x7fb4800b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb4800b4bb0 0x7fb4800b70c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb484000c00 tx=0x7fb484032cc0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 msgr2=0x7fb4981a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 0x7fb4981a0670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00ea60 tx=0x7fb48c00ef20 comp rx=0 tx=0).stop 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 shutdown_connections 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb4800b4bb0 0x7fb4800b70c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498077120 0x7fb4981a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb498114020 0x7fb4981a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 --2- 172.21.15.1:0/1878454625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498075b70 0x7fb4981a0670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.458+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 >> 172.21.15.1:0/1878454625 conn(0x7fb4980ff1e0 msgr2=0x7fb49810ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.459+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 shutdown_connections 2024-08-28T20:15:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:45.459+0000 7fb49ea00640 1 -- 172.21.15.1:0/1878454625 wait complete. 2024-08-28T20:15:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:45 smithi007 ceph-mon[25357]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:45.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:45 smithi121 ceph-mon[25248]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:46.432 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:46 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1878454625' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-28T20:15:46.432 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:46 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.432 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:46 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.432 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:46 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.432 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:46 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:46 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1878454625' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-28T20:15:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:46 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:46 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:46 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:46 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:46 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1878454625' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-28T20:15:46.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:46 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:46 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:46 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:46 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:46.832 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-28T20:15:46.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-28T20:15:47.244 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:47.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:47 smithi001 ceph-mon[20984]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:47.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 -- 172.21.15.1:0/2249632373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4109260 msgr2=0x7f99b4109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:47.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 --2- 172.21.15.1:0/2249632373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4109260 0x7f99b4109670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009900 tx=0x7f99a002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:47.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 -- 172.21.15.1:0/2249632373 shutdown_connections 2024-08-28T20:15:47.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 --2- 172.21.15.1:0/2249632373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4109260 0x7f99b4109670 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:47.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 --2- 172.21.15.1:0/2249632373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99b4109bb0 0x7f99b41103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:47.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 --2- 172.21.15.1:0/2249632373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99b4103920 0x7f99b4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:47.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 -- 172.21.15.1:0/2249632373 >> 172.21.15.1:0/2249632373 conn(0x7f99b40ff330 msgr2=0x7f99b4101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:47.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 -- 172.21.15.1:0/2249632373 shutdown_connections 2024-08-28T20:15:47.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.893+0000 7f99bae00640 1 -- 172.21.15.1:0/2249632373 wait complete. 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.894+0000 7f99bae00640 1 Processor -- start 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 -- start start 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 0x7f99b419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99b4109260 0x7f99b419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99b4109bb0 0x7f99b41a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41138c0 con 0x7f99b4103920 2024-08-28T20:15:47.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4113740 con 0x7f99b4109bb0 2024-08-28T20:15:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99bae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4113a40 con 0x7f99b4109260 2024-08-28T20:15:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99b3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 0x7f99b419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99b3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 0x7f99b419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39610/0 (socket says 172.21.15.1:39610) 2024-08-28T20:15:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99b3e00640 1 -- 172.21.15.1:0/3194189162 learned_addr learned my addr 172.21.15.1:0/3194189162 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.895+0000 7f99b3400640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99b4109260 0x7f99b419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b8e00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99b4109bb0 0x7f99b41a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b3e00640 1 -- 172.21.15.1:0/3194189162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99b4109260 msgr2=0x7f99b419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b3e00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99b4109260 0x7f99b419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b3e00640 1 -- 172.21.15.1:0/3194189162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99b4109bb0 msgr2=0x7f99b41a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b3e00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99b4109bb0 0x7f99b41a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b3e00640 1 -- 172.21.15.1:0/3194189162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b41a23c0 con 0x7f99b4103920 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.896+0000 7f99b3e00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 0x7f99b419c450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99a400e9f0 tx=0x7f99a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.897+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a400cd80 con 0x7f99b4103920 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.897+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b41a26b0 con 0x7f99b4103920 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.897+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a40108e0 con 0x7f99b4103920 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.897+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b41a8e10 con 0x7f99b4103920 2024-08-28T20:15:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.897+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4018980 con 0x7f99b4103920 2024-08-28T20:15:47.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.898+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99940052c0 con 0x7f99b4103920 2024-08-28T20:15:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.901+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f99a4010430 con 0x7f99b4103920 2024-08-28T20:15:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.902+0000 7f99b0c00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f99980b4bb0 0x7f99980b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.902+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f99a40e4dc0 con 0x7f99b4103920 2024-08-28T20:15:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.902+0000 7f99b3400640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f99980b4bb0 0x7f99980b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.903+0000 7f99b3400640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f99980b4bb0 0x7f99980b70c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99a002a9e0 tx=0x7f99a0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:47.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:47.909+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99a40abca0 con 0x7f99b4103920 2024-08-28T20:15:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:47 smithi121 ceph-mon[25248]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:47 smithi007 ceph-mon[25357]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:48.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:48.127+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f99940055b0 con 0x7f99b4103920 2024-08-28T20:15:49.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.017+0000 7f99b0c00640 1 -- 172.21.15.1:0/3194189162 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) ==== 138+0+0 (secure 0 0 0) 0x7f99a40b0460 con 0x7f99b4103920 2024-08-28T20:15:49.020 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-08-28T20:15:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.023+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f99980b4bb0 msgr2=0x7f99980b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.023+0000 7f99bae00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f99980b4bb0 0x7f99980b70c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99a002a9e0 tx=0x7f99a0005a20 comp rx=0 tx=0).stop 2024-08-28T20:15:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.023+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 msgr2=0x7f99b419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.023+0000 7f99bae00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 0x7f99b419c450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99a400e9f0 tx=0x7f99a400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 shutdown_connections 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f99980b4bb0 0x7f99980b70c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99b4109bb0 0x7f99b41a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99b4109260 0x7f99b419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 --2- 172.21.15.1:0/3194189162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99b4103920 0x7f99b419c450 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 >> 172.21.15.1:0/3194189162 conn(0x7f99b40ff330 msgr2=0x7f99b4107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 shutdown_connections 2024-08-28T20:15:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:49.024+0000 7f99bae00640 1 -- 172.21.15.1:0/3194189162 wait complete. 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3194189162' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-28T20:15:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:48 smithi007 ceph-mon[25357]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3194189162' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-28T20:15:49.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:48 smithi001 ceph-mon[20984]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:49.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:15:49.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:15:49.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:15:49.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3194189162' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-28T20:15:49.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:48 smithi121 ceph-mon[25248]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:50.001 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-28T20:15:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:50 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3194189162' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-28T20:15:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:50 smithi001 ceph-mon[20984]: osdmap e68: 12 total, 12 up, 12 in 2024-08-28T20:15:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:50 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3194189162' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-28T20:15:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:50 smithi007 ceph-mon[25357]: osdmap e68: 12 total, 12 up, 12 in 2024-08-28T20:15:50.397 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:50 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3194189162' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-28T20:15:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:50 smithi121 ceph-mon[25248]: osdmap e68: 12 total, 12 up, 12 in 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 -- 172.21.15.1:0/1600321835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 msgr2=0x7f184c10b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 --2- 172.21.15.1:0/1600321835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 0x7f184c10b870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1838009900 tx=0x7f183802a410 comp rx=0 tx=0).stop 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 -- 172.21.15.1:0/1600321835 shutdown_connections 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 --2- 172.21.15.1:0/1600321835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 0x7f184c10b870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 --2- 172.21.15.1:0/1600321835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f184c10bdb0 0x7f184c1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 --2- 172.21.15.1:0/1600321835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 -- 172.21.15.1:0/1600321835 >> 172.21.15.1:0/1600321835 conn(0x7f184c1015b0 msgr2=0x7f184c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 -- 172.21.15.1:0/1600321835 shutdown_connections 2024-08-28T20:15:51.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.203+0000 7f1853400640 1 -- 172.21.15.1:0/1600321835 wait complete. 2024-08-28T20:15:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.204+0000 7f1853400640 1 Processor -- start 2024-08-28T20:15:51.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 -- start start 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c19c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 0x7f184c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f184c10bdb0 0x7f184c1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f184c115a70 con 0x7f184c10b460 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f184c1158f0 con 0x7f184c10bdb0 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1853400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f184c115bf0 con 0x7f184c105b20 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1850a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c19c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1850a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c19c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:46150/0 (socket says 172.21.15.1:46150) 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1850a00640 1 -- 172.21.15.1:0/3090794317 learned_addr learned my addr 172.21.15.1:0/3090794317 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f184be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 0x7f184c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:51.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.205+0000 7f1851400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f184c10bdb0 0x7f184c1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:51.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1850a00640 1 -- 172.21.15.1:0/3090794317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f184c10bdb0 msgr2=0x7f184c1a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1850a00640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f184c10bdb0 0x7f184c1a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1850a00640 1 -- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 msgr2=0x7f184c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1850a00640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 0x7f184c19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1850a00640 1 -- 172.21.15.1:0/3090794317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c1a23f0 con 0x7f184c105b20 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1850a00640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c19c480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f184000e9f0 tx=0x7f184000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184000cd80 con 0x7f184c105b20 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18400108e0 con 0x7f184c105b20 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.206+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184c1a26e0 con 0x7f184c105b20 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.207+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840018980 con 0x7f184c105b20 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.207+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c1a8e40 con 0x7f184c105b20 2024-08-28T20:15:51.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.208+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184c105f30 con 0x7f184c105b20 2024-08-28T20:15:51.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.210+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f1840010430 con 0x7f184c105b20 2024-08-28T20:15:51.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.212+0000 7f1849600640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18340b4b30 0x7f18340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:51.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.212+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7f18400e5670 con 0x7f184c105b20 2024-08-28T20:15:51.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.212+0000 7f184be00640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18340b4b30 0x7f18340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:51.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.213+0000 7f184be00640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18340b4b30 0x7f18340b7040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1838009230 tx=0x7f1838031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:51.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.214+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f18400ac3e0 con 0x7f184c105b20 2024-08-28T20:15:51.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:51 smithi121 ceph-mon[25248]: osdmap e69: 12 total, 12 up, 12 in 2024-08-28T20:15:51.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:51 smithi121 ceph-mon[25248]: pgmap v290: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:51.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:51 smithi007 ceph-mon[25357]: osdmap e69: 12 total, 12 up, 12 in 2024-08-28T20:15:51.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:51 smithi007 ceph-mon[25357]: pgmap v290: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:51.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:51.408+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f184c19d5b0 con 0x7f184c105b20 2024-08-28T20:15:51.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:51 smithi001 ceph-mon[20984]: osdmap e69: 12 total, 12 up, 12 in 2024-08-28T20:15:51.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:51 smithi001 ceph-mon[20984]: pgmap v290: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:52.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.049+0000 7f1849600640 1 -- 172.21.15.1:0/3090794317 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f184c19d5b0 con 0x7f184c105b20 2024-08-28T20:15:52.055 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-08-28T20:15:52.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.057+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18340b4b30 msgr2=0x7f18340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:52.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.057+0000 7f1853400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18340b4b30 0x7f18340b7040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1838009230 tx=0x7f1838031400 comp rx=0 tx=0).stop 2024-08-28T20:15:52.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.057+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 msgr2=0x7f184c19c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:52.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.057+0000 7f1853400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c19c480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f184000e9f0 tx=0x7f184000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:52.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.058+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 shutdown_connections 2024-08-28T20:15:52.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.058+0000 7f1853400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f18340b4b30 0x7f18340b7040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:52.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.058+0000 7f1853400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f184c10b460 0x7f184c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:52.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.058+0000 7f1853400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f184c10bdb0 0x7f184c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:52.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.058+0000 7f1853400640 1 --2- 172.21.15.1:0/3090794317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f184c105b20 0x7f184c19c480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:52.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.058+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 >> 172.21.15.1:0/3090794317 conn(0x7f184c1015b0 msgr2=0x7f184c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.059+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 shutdown_connections 2024-08-28T20:15:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:52.060+0000 7f1853400640 1 -- 172.21.15.1:0/3090794317 wait complete. 2024-08-28T20:15:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:52 smithi007 ceph-mon[25357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T20:15:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:52 smithi007 ceph-mon[25357]: osdmap e70: 12 total, 12 up, 12 in 2024-08-28T20:15:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:52 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3090794317' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T20:15:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:52 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T20:15:52.438 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:52 smithi001 ceph-mon[20984]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T20:15:52.439 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:52 smithi001 ceph-mon[20984]: osdmap e70: 12 total, 12 up, 12 in 2024-08-28T20:15:52.439 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:52 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3090794317' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T20:15:52.439 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:52 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T20:15:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:52 smithi121 ceph-mon[25248]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T20:15:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:52 smithi121 ceph-mon[25248]: osdmap e70: 12 total, 12 up, 12 in 2024-08-28T20:15:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:52 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3090794317' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T20:15:52.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:52 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T20:15:52.816 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-28T20:15:53.225 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:53.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:53 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-28T20:15:53.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:53 smithi007 ceph-mon[25357]: osdmap e71: 12 total, 12 up, 12 in 2024-08-28T20:15:53.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:53 smithi007 ceph-mon[25357]: pgmap v293: 97 pgs: 3 creating+peering, 86 unknown, 8 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:53.365 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:53 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-28T20:15:53.366 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:53 smithi001 ceph-mon[20984]: osdmap e71: 12 total, 12 up, 12 in 2024-08-28T20:15:53.366 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:53 smithi001 ceph-mon[20984]: pgmap v293: 97 pgs: 3 creating+peering, 86 unknown, 8 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:53.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:53 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-28T20:15:53.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:53 smithi121 ceph-mon[25248]: osdmap e71: 12 total, 12 up, 12 in 2024-08-28T20:15:53.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:53 smithi121 ceph-mon[25248]: pgmap v293: 97 pgs: 3 creating+peering, 86 unknown, 8 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:53.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.914+0000 7fc5b6200640 1 -- 172.21.15.1:0/1178764915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 msgr2=0x7fc5b0110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.914+0000 7fc5b6200640 1 --2- 172.21.15.1:0/1178764915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b0110210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009900 tx=0x7fc5a802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 -- 172.21.15.1:0/1178764915 shutdown_connections 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 --2- 172.21.15.1:0/1178764915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b0110210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 --2- 172.21.15.1:0/1178764915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0109090 0x7fc5b01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 --2- 172.21.15.1:0/1178764915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0103750 0x7fc5b0103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 -- 172.21.15.1:0/1178764915 >> 172.21.15.1:0/1178764915 conn(0x7fc5b00ff1e0 msgr2=0x7fc5b0101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 -- 172.21.15.1:0/1178764915 shutdown_connections 2024-08-28T20:15:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.915+0000 7fc5b6200640 1 -- 172.21.15.1:0/1178764915 wait complete. 2024-08-28T20:15:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.916+0000 7fc5b6200640 1 Processor -- start 2024-08-28T20:15:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 -- start start 2024-08-28T20:15:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0103750 0x7fc5b019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0109090 0x7fc5b019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b01a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0113700 con 0x7fc5b01099e0 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0113580 con 0x7fc5b0103750 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b6200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0113880 con 0x7fc5b0109090 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b01a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b01a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39660/0 (socket says 172.21.15.1:39660) 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b5800640 1 -- 172.21.15.1:0/547493192 learned_addr learned my addr 172.21.15.1:0/547493192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5afe00640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0109090 0x7fc5b019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.917+0000 7fc5b4e00640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0103750 0x7fc5b019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b5800640 1 -- 172.21.15.1:0/547493192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0109090 msgr2=0x7fc5b019c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b5800640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0109090 0x7fc5b019c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b5800640 1 -- 172.21.15.1:0/547493192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0103750 msgr2=0x7fc5b019c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b5800640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0103750 0x7fc5b019c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b5800640 1 -- 172.21.15.1:0/547493192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b01a2200 con 0x7fc5b01099e0 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5afe00640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0109090 0x7fc5b019c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b4e00640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0103750 0x7fc5b019c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.918+0000 7fc5b5800640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b01a1ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc5a802a910 tx=0x7fc5a8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.919+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a803f070 con 0x7fc5b01099e0 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.919+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5a8031b50 con 0x7fc5b01099e0 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.919+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8035030 con 0x7fc5b01099e0 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.919+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b01a2490 con 0x7fc5b01099e0 2024-08-28T20:15:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.919+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01a8c50 con 0x7fc5b01099e0 2024-08-28T20:15:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.920+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b01049d0 con 0x7fc5b01099e0 2024-08-28T20:15:53.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.923+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7fc5a8042070 con 0x7fc5b01099e0 2024-08-28T20:15:53.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.924+0000 7fc5ad600640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc5980b4bb0 0x7fc5980b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:53.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.924+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7fc5a8105c60 con 0x7fc5b01099e0 2024-08-28T20:15:53.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.924+0000 7fc5b4e00640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc5980b4bb0 0x7fc5980b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:53.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.925+0000 7fc5b4e00640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc5980b4bb0 0x7fc5980b70c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4005fd0 tx=0x7fc5a4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:53.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:53.927+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc5a80cc8f0 con 0x7fc5b01099e0 2024-08-28T20:15:54.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:54.164+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc5b01a8e20 con 0x7fc5b01099e0 2024-08-28T20:15:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:54 smithi001 ceph-mon[20984]: osdmap e72: 12 total, 12 up, 12 in 2024-08-28T20:15:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:54 smithi007 ceph-mon[25357]: osdmap e72: 12 total, 12 up, 12 in 2024-08-28T20:15:54.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:54 smithi121 ceph-mon[25248]: osdmap e72: 12 total, 12 up, 12 in 2024-08-28T20:15:55.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.068+0000 7fc5ad600640 1 -- 172.21.15.1:0/547493192 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc5a80d10b0 con 0x7fc5b01099e0 2024-08-28T20:15:55.070 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc5980b4bb0 msgr2=0x7fc5980b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc5980b4bb0 0x7fc5980b70c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4005fd0 tx=0x7fc5a4009500 comp rx=0 tx=0).stop 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 msgr2=0x7fc5b01a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b01a1ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc5a802a910 tx=0x7fc5a8003b90 comp rx=0 tx=0).stop 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 shutdown_connections 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc5980b4bb0 0x7fc5980b70c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:55.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5b01099e0 0x7fc5b01a1ad0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:55.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b0109090 0x7fc5b019c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:55.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 --2- 172.21.15.1:0/547493192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b0103750 0x7fc5b019c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:55.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.071+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 >> 172.21.15.1:0/547493192 conn(0x7fc5b00ff1e0 msgr2=0x7fc5b0106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:55.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.072+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 shutdown_connections 2024-08-28T20:15:55.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:55.072+0000 7fc5b6200640 1 -- 172.21.15.1:0/547493192 wait complete. 2024-08-28T20:15:55.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:55 smithi001 ceph-mon[20984]: osdmap e73: 12 total, 12 up, 12 in 2024-08-28T20:15:55.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:55 smithi001 ceph-mon[20984]: pgmap v296: 97 pgs: 21 creating+peering, 30 unknown, 46 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:55.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:55 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/547493192' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-28T20:15:55.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:55 smithi001 ceph-mon[20984]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-28T20:15:55.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:55 smithi121 ceph-mon[25248]: osdmap e73: 12 total, 12 up, 12 in 2024-08-28T20:15:55.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:55 smithi121 ceph-mon[25248]: pgmap v296: 97 pgs: 21 creating+peering, 30 unknown, 46 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:55.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:55 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/547493192' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-28T20:15:55.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:55 smithi121 ceph-mon[25248]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-28T20:15:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:55 smithi007 ceph-mon[25357]: osdmap e73: 12 total, 12 up, 12 in 2024-08-28T20:15:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:55 smithi007 ceph-mon[25357]: pgmap v296: 97 pgs: 21 creating+peering, 30 unknown, 46 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:15:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:55 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/547493192' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-28T20:15:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:55 smithi007 ceph-mon[25357]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-28T20:15:55.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:15:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:56 smithi001 ceph-mon[20984]: osdmap e74: 12 total, 12 up, 12 in 2024-08-28T20:15:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:56 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/547493192' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-28T20:15:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:56 smithi001 ceph-mon[20984]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-28T20:15:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:56 smithi001 ceph-mon[20984]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-28T20:15:56.263 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:56.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:56 smithi121 ceph-mon[25248]: osdmap e74: 12 total, 12 up, 12 in 2024-08-28T20:15:56.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:56 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/547493192' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-28T20:15:56.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:56 smithi121 ceph-mon[25248]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-28T20:15:56.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:56 smithi121 ceph-mon[25248]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-28T20:15:56.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:56 smithi007 ceph-mon[25357]: osdmap e74: 12 total, 12 up, 12 in 2024-08-28T20:15:56.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:56 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/547493192' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-28T20:15:56.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:56 smithi007 ceph-mon[25357]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-28T20:15:56.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:56 smithi007 ceph-mon[25357]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-28T20:15:56.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 -- 172.21.15.1:0/537160825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 msgr2=0x7f7c1c112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:56.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 --2- 172.21.15.1:0/537160825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 0x7f7c1c112610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009ca0 tx=0x7f7c1402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:15:56.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 -- 172.21.15.1:0/537160825 shutdown_connections 2024-08-28T20:15:56.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 --2- 172.21.15.1:0/537160825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 0x7f7c1c112610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:56.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 --2- 172.21.15.1:0/537160825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c10b490 0x7f7c1c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:56.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 --2- 172.21.15.1:0/537160825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:56.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 -- 172.21.15.1:0/537160825 >> 172.21.15.1:0/537160825 conn(0x7f7c1c101580 msgr2=0x7f7c1c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:56.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 -- 172.21.15.1:0/537160825 shutdown_connections 2024-08-28T20:15:56.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.919+0000 7f7c21400640 1 -- 172.21.15.1:0/537160825 wait complete. 2024-08-28T20:15:56.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.920+0000 7f7c21400640 1 Processor -- start 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 -- start start 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c10b490 0x7f7c1c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 0x7f7c1c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c115aa0 con 0x7f7c1c10bde0 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c115920 con 0x7f7c1c105b50 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c21400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c115c20 con 0x7f7c1c10b490 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c1a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c1a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c19c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40178/0 (socket says 172.21.15.1:40178) 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c1a800640 1 -- 172.21.15.1:0/3578138016 learned_addr learned my addr 172.21.15.1:0/3578138016 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:56.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c1b200640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 0x7f7c1c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.921+0000 7f7c11e00640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c10b490 0x7f7c1c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c1a800640 1 -- 172.21.15.1:0/3578138016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c10b490 msgr2=0x7f7c1c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c1a800640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c10b490 0x7f7c1c19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c1a800640 1 -- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 msgr2=0x7f7c1c1a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c1a800640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 0x7f7c1c1a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c1a800640 1 -- 172.21.15.1:0/3578138016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c1a2380 con 0x7f7c1c105b50 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c1a800640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c19c410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00e9f0 tx=0x7f7c0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00cd80 con 0x7f7c1c105b50 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c1a2670 con 0x7f7c1c105b50 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c0c0108e0 con 0x7f7c1c105b50 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c018980 con 0x7f7c1c105b50 2024-08-28T20:15:56.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.922+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c1a8dd0 con 0x7f7c1c105b50 2024-08-28T20:15:56.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.923+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c105f60 con 0x7f7c1c105b50 2024-08-28T20:15:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.926+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f7c0c010430 con 0x7f7c1c105b50 2024-08-28T20:15:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.927+0000 7f7c13e00640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7c000b4b30 0x7f7c000b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.928+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f7c0c0e5900 con 0x7f7c1c105b50 2024-08-28T20:15:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.928+0000 7f7c11e00640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7c000b4b30 0x7f7c000b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.928+0000 7f7c11e00640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7c000b4b30 0x7f7c000b7040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c104d40 tx=0x7f7c04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:56.929+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c0c0acae0 con 0x7f7c1c105b50 2024-08-28T20:15:57.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.125+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c1c02e430 con 0x7f7c1c105b50 2024-08-28T20:15:57.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.127+0000 7f7c13e00640 1 -- 172.21.15.1:0/3578138016 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22103 (secure 0 0 0) 0x7f7c0c0ac3e0 con 0x7f7c1c105b50 2024-08-28T20:15:57.130 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:57.130 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":74,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:15:54.165654+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7c000b4b30 msgr2=0x7f7c000b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7c000b4b30 0x7f7c000b7040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c104d40 tx=0x7f7c04005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 msgr2=0x7f7c1c19c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c19c410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00e9f0 tx=0x7f7c0c00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 shutdown_connections 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7c000b4b30 0x7f7c000b7040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c1c10bde0 0x7f7c1c1a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:57.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c10b490 0x7f7c1c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:57.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 --2- 172.21.15.1:0/3578138016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c105b50 0x7f7c1c19c410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:57.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 >> 172.21.15.1:0/3578138016 conn(0x7f7c1c101580 msgr2=0x7f7c1c109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:57.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 shutdown_connections 2024-08-28T20:15:57.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:57.130+0000 7f7c21400640 1 -- 172.21.15.1:0/3578138016 wait complete. 2024-08-28T20:15:57.466 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:57 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] up:active 2024-08-28T20:15:57.466 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:57 smithi007 ceph-mon[25357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:15:57.467 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:57 smithi007 ceph-mon[25357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:15:57.467 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:57 smithi007 ceph-mon[25357]: pgmap v298: 97 pgs: 18 creating+peering, 8 unknown, 71 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-08-28T20:15:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:57 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] up:active 2024-08-28T20:15:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:57 smithi001 ceph-mon[20984]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:15:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:57 smithi001 ceph-mon[20984]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:15:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:57 smithi001 ceph-mon[20984]: pgmap v298: 97 pgs: 18 creating+peering, 8 unknown, 71 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-08-28T20:15:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:57 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] up:active 2024-08-28T20:15:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:57 smithi121 ceph-mon[25248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:15:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:57 smithi121 ceph-mon[25248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:15:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:57 smithi121 ceph-mon[25248]: pgmap v298: 97 pgs: 18 creating+peering, 8 unknown, 71 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-08-28T20:15:57.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:15:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:58 smithi001 ceph-mon[20984]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-28T20:15:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:58 smithi001 ceph-mon[20984]: Cluster is now healthy 2024-08-28T20:15:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:58 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3578138016' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:15:58.305 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:15:58.478 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:58 smithi007 ceph-mon[25357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-28T20:15:58.478 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:58 smithi007 ceph-mon[25357]: Cluster is now healthy 2024-08-28T20:15:58.478 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:58 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3578138016' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:15:58.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:58 smithi121 ceph-mon[25248]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-28T20:15:58.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:58 smithi121 ceph-mon[25248]: Cluster is now healthy 2024-08-28T20:15:58.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:58 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3578138016' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:15:58.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 -- 172.21.15.1:0/975319345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075550 msgr2=0x7f3abc075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 --2- 172.21.15.1:0/975319345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075550 0x7f3abc075960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009900 tx=0x7f3aac02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 -- 172.21.15.1:0/975319345 shutdown_connections 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 --2- 172.21.15.1:0/975319345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc10fcb0 0x7f3abc1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 --2- 172.21.15.1:0/975319345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075ea0 0x7f3abc10f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 --2- 172.21.15.1:0/975319345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075550 0x7f3abc075960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 -- 172.21.15.1:0/975319345 >> 172.21.15.1:0/975319345 conn(0x7f3abc0ff1e0 msgr2=0x7f3abc101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 -- 172.21.15.1:0/975319345 shutdown_connections 2024-08-28T20:15:58.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.876+0000 7f3abbe00640 1 -- 172.21.15.1:0/975319345 wait complete. 2024-08-28T20:15:58.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.877+0000 7f3abbe00640 1 Processor -- start 2024-08-28T20:15:58.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.877+0000 7f3abbe00640 1 -- start start 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075550 0x7f3abc19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075ea0 0x7f3abc19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc10fcb0 0x7f3abc1a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abbe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc1158b0 con 0x7f3abc10fcb0 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc115730 con 0x7f3abc075ea0 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc115a30 con 0x7f3abc075550 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3aba000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075ea0 0x7f3abc19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3aba000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075ea0 0x7f3abc19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40182/0 (socket says 172.21.15.1:40182) 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3aba000640 1 -- 172.21.15.1:0/2793716711 learned_addr learned my addr 172.21.15.1:0/2793716711 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abaa00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075550 0x7f3abc19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abb400640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc10fcb0 0x7f3abc1a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:58.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abaa00640 1 -- 172.21.15.1:0/2793716711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075ea0 msgr2=0x7f3abc19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abaa00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075ea0 0x7f3abc19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abaa00640 1 -- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc10fcb0 msgr2=0x7f3abc1a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abaa00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc10fcb0 0x7f3abc1a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:58.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.878+0000 7f3abaa00640 1 -- 172.21.15.1:0/2793716711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc1a2230 con 0x7f3abc075550 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.879+0000 7f3abaa00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075550 0x7f3abc19c2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3aac02a9e0 tx=0x7f3aac003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.879+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac03f070 con 0x7f3abc075550 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.879+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3abc1a24c0 con 0x7f3abc075550 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.879+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3aac031b50 con 0x7f3abc075550 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.879+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac035030 con 0x7f3abc075550 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.879+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3abc1a8c80 con 0x7f3abc075550 2024-08-28T20:15:58.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.880+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3abc076a60 con 0x7f3abc075550 2024-08-28T20:15:58.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.883+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f3aac042070 con 0x7f3abc075550 2024-08-28T20:15:58.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.884+0000 7f3ab3400640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3aa00b4b30 0x7f3aa00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:15:58.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.884+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f3aac1057e0 con 0x7f3abc075550 2024-08-28T20:15:58.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.884+0000 7f3aba000640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3aa00b4b30 0x7f3aa00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:15:58.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.885+0000 7f3aba000640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3aa00b4b30 0x7f3aa00b7040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80095f0 tx=0x7f3aa8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:15:58.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:58.886+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3aac0cc9c0 con 0x7f3abc075550 2024-08-28T20:15:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.089+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3abc1a8e50 con 0x7f3abc075550 2024-08-28T20:15:59.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.091+0000 7f3ab3400640 1 -- 172.21.15.1:0/2793716711 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22103 (secure 0 0 0) 0x7f3aac0cc2c0 con 0x7f3abc075550 2024-08-28T20:15:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:15:59.093 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":74,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:15:54.165654+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:15:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3aa00b4b30 msgr2=0x7f3aa00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3aa00b4b30 0x7f3aa00b7040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80095f0 tx=0x7f3aa8005f90 comp rx=0 tx=0).stop 2024-08-28T20:15:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075550 msgr2=0x7f3abc19c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:15:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075550 0x7f3abc19c2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3aac02a9e0 tx=0x7f3aac003b90 comp rx=0 tx=0).stop 2024-08-28T20:15:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 shutdown_connections 2024-08-28T20:15:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3aa00b4b30 0x7f3aa00b7040 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3abc10fcb0 0x7f3abc1a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3abc075ea0 0x7f3abc19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 --2- 172.21.15.1:0/2793716711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3abc075550 0x7f3abc19c2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:15:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 >> 172.21.15.1:0/2793716711 conn(0x7f3abc0ff1e0 msgr2=0x7f3abc109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:15:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 shutdown_connections 2024-08-28T20:15:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:15:59.094+0000 7f3abbe00640 1 -- 172.21.15.1:0/2793716711 wait complete. 2024-08-28T20:15:59.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:15:59 smithi001 ceph-mon[20984]: pgmap v299: 97 pgs: 97 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-08-28T20:15:59.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:15:59 smithi121 ceph-mon[25248]: pgmap v299: 97 pgs: 97 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-08-28T20:15:59.564 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:15:59 smithi007 ceph-mon[25357]: pgmap v299: 97 pgs: 97 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-08-28T20:15:59.897 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-28T20:16:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:00 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2793716711' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:00.279 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:00.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:00 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2793716711' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:00.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:00 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2793716711' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 -- 172.21.15.1:0/315806627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 msgr2=0x7ff11c1125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 --2- 172.21.15.1:0/315806627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1125f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff114009ca0 tx=0x7ff11402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 -- 172.21.15.1:0/315806627 shutdown_connections 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 --2- 172.21.15.1:0/315806627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1125f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 --2- 172.21.15.1:0/315806627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c10b470 0x7ff11c10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 --2- 172.21.15.1:0/315806627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff11c105b30 0x7ff11c105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 -- 172.21.15.1:0/315806627 >> 172.21.15.1:0/315806627 conn(0x7ff11c101600 msgr2=0x7ff11c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 -- 172.21.15.1:0/315806627 shutdown_connections 2024-08-28T20:16:00.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.955+0000 7ff121400640 1 -- 172.21.15.1:0/315806627 wait complete. 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 Processor -- start 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 -- start start 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff11c105b30 0x7ff11c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c10b470 0x7ff11c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c115ad0 con 0x7ff11c10bdc0 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c115950 con 0x7ff11c105b30 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.956+0000 7ff121400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c115c50 con 0x7ff11c10b470 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33354/0 (socket says 172.21.15.1:33354) 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 -- 172.21.15.1:0/2840675246 learned_addr learned my addr 172.21.15.1:0/2840675246 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:00.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11a800640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff11c105b30 0x7ff11c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff113e00640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c10b470 0x7ff11c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 -- 172.21.15.1:0/2840675246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c10b470 msgr2=0x7ff11c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c10b470 0x7ff11c19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 -- 172.21.15.1:0/2840675246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff11c105b30 msgr2=0x7ff11c19c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff11c105b30 0x7ff11c19c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.957+0000 7ff11b200640 1 -- 172.21.15.1:0/2840675246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c1a2350 con 0x7ff11c10bdc0 2024-08-28T20:16:00.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.958+0000 7ff11b200640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1a1c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff114009430 tx=0x7ff1140317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:00.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.958+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114003b70 con 0x7ff11c10bdc0 2024-08-28T20:16:00.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.958+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff114003d10 con 0x7ff11c10bdc0 2024-08-28T20:16:00.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.958+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11402fa30 con 0x7ff11c10bdc0 2024-08-28T20:16:00.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.958+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c1a25e0 con 0x7ff11c10bdc0 2024-08-28T20:16:00.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.958+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c1a8da0 con 0x7ff11c10bdc0 2024-08-28T20:16:00.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.959+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c105f40 con 0x7ff11c10bdc0 2024-08-28T20:16:00.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.962+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7ff11402fbd0 con 0x7ff11c10bdc0 2024-08-28T20:16:00.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.963+0000 7ff113400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff1000b4b30 0x7ff1000b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:00.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.963+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7ff114106300 con 0x7ff11c10bdc0 2024-08-28T20:16:00.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.964+0000 7ff11a800640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff1000b4b30 0x7ff1000b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:00.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.964+0000 7ff11a800640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff1000b4b30 0x7ff1000b7040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009bd0 tx=0x7ff10c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:00.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:00.966+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff1140cd580 con 0x7ff11c10bdc0 2024-08-28T20:16:01.095 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:16:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: 2024-08-28T20:16:00.825+0000 7fca3190b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-28T20:16:01.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:01.206+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff11c19d510 con 0x7ff11c10bdc0 2024-08-28T20:16:01.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:01 smithi001 ceph-mon[20984]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-28T20:16:01.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:01 smithi121 ceph-mon[25248]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-28T20:16:01.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:01 smithi007 ceph-mon[25357]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-28T20:16:02.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.102+0000 7ff113400640 1 -- 172.21.15.1:0/2840675246 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7ff11c19d510 con 0x7ff11c10bdc0 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff1000b4b30 msgr2=0x7ff1000b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff1000b4b30 0x7ff1000b7040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009bd0 tx=0x7ff10c005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 msgr2=0x7ff11c1a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1a1c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff114009430 tx=0x7ff1140317c0 comp rx=0 tx=0).stop 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 shutdown_connections 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff1000b4b30 0x7ff1000b7040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff11c10bdc0 0x7ff11c1a1c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c10b470 0x7ff11c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 --2- 172.21.15.1:0/2840675246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff11c105b30 0x7ff11c19c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.106+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 >> 172.21.15.1:0/2840675246 conn(0x7ff11c101600 msgr2=0x7ff11c1089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.107+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 shutdown_connections 2024-08-28T20:16:02.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:02.107+0000 7ff121400640 1 -- 172.21.15.1:0/2840675246 wait complete. 2024-08-28T20:16:02.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:02 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2840675246' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-28T20:16:02.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:02 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2840675246' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-28T20:16:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:02 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2840675246' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-28T20:16:03.065 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-28T20:16:03.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-28T20:16:03.448 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:03.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:03 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2840675246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-28T20:16:03.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:03 smithi001 ceph-mon[20984]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:16:03.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:03 smithi001 ceph-mon[20984]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-28T20:16:03.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:03 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2840675246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-28T20:16:03.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:03 smithi121 ceph-mon[25248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:16:03.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:03 smithi121 ceph-mon[25248]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-28T20:16:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:03 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2840675246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-28T20:16:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:03 smithi007 ceph-mon[25357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:16:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:03 smithi007 ceph-mon[25357]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 -- 172.21.15.1:0/4162226508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60103730 msgr2=0x7f6d60103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 --2- 172.21.15.1:0/4162226508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60103730 0x7f6d60103b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009900 tx=0x7f6d5002a410 comp rx=0 tx=0).stop 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 -- 172.21.15.1:0/4162226508 shutdown_connections 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 --2- 172.21.15.1:0/4162226508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601099c0 0x7f6d601101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 --2- 172.21.15.1:0/4162226508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d60109070 0x7f6d60109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 --2- 172.21.15.1:0/4162226508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60103730 0x7f6d60103b40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 -- 172.21.15.1:0/4162226508 >> 172.21.15.1:0/4162226508 conn(0x7f6d600ff180 msgr2=0x7f6d601015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 -- 172.21.15.1:0/4162226508 shutdown_connections 2024-08-28T20:16:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.111+0000 7f6d65e00640 1 -- 172.21.15.1:0/4162226508 wait complete. 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.112+0000 7f6d65e00640 1 Processor -- start 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.112+0000 7f6d65e00640 1 -- start start 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d60103730 0x7f6d6019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 0x7f6d6019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601099c0 0x7f6d6019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60113690 con 0x7f6d60109070 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60113510 con 0x7f6d60103730 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60113810 con 0x7f6d601099c0 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 0x7f6d6019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 0x7f6d6019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33372/0 (socket says 172.21.15.1:33372) 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 -- 172.21.15.1:0/1151830548 learned_addr learned my addr 172.21.15.1:0/1151830548 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d64a00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d60103730 0x7f6d6019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d65400640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601099c0 0x7f6d6019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 -- 172.21.15.1:0/1151830548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601099c0 msgr2=0x7f6d6019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601099c0 0x7f6d6019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 -- 172.21.15.1:0/1151830548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d60103730 msgr2=0x7f6d6019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d60103730 0x7f6d6019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.113+0000 7f6d57e00640 1 -- 172.21.15.1:0/1151830548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601a0010 con 0x7f6d60109070 2024-08-28T20:16:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.114+0000 7f6d57e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 0x7f6d6019a640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e970 tx=0x7f6d4800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.114+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800cd80 con 0x7f6d60109070 2024-08-28T20:16:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.114+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d480035f0 con 0x7f6d60109070 2024-08-28T20:16:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.114+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601a0300 con 0x7f6d60109070 2024-08-28T20:16:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.114+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48010690 con 0x7f6d60109070 2024-08-28T20:16:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.114+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601a6a60 con 0x7f6d60109070 2024-08-28T20:16:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.115+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60103b40 con 0x7f6d60109070 2024-08-28T20:16:04.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.118+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f6d48003aa0 con 0x7f6d60109070 2024-08-28T20:16:04.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.119+0000 7f6d5e000640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6d440b4bb0 0x7f6d440b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:04.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.119+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f6d480e53a0 con 0x7f6d60109070 2024-08-28T20:16:04.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.119+0000 7f6d64a00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6d440b4bb0 0x7f6d440b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:04.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.120+0000 7f6d64a00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6d440b4bb0 0x7f6d440b70c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d50031440 tx=0x7f6d50009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:04.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.121+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6d480ac580 con 0x7f6d60109070 2024-08-28T20:16:04.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:04.356+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f6d6002e430 con 0x7f6d60109070 2024-08-28T20:16:05.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.220+0000 7f6d5e000640 1 -- 172.21.15.1:0/1151830548 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f6d480abe80 con 0x7f6d60109070 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6d440b4bb0 msgr2=0x7f6d440b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6d440b4bb0 0x7f6d440b70c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d50031440 tx=0x7f6d50009560 comp rx=0 tx=0).stop 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 msgr2=0x7f6d6019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 0x7f6d6019a640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e970 tx=0x7f6d4800ee30 comp rx=0 tx=0).stop 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 shutdown_connections 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6d440b4bb0 0x7f6d440b70c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d60109070 0x7f6d6019a640 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:05.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601099c0 0x7f6d6019f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:05.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 --2- 172.21.15.1:0/1151830548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d60103730 0x7f6d6019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:05.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.223+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 >> 172.21.15.1:0/1151830548 conn(0x7f6d600ff180 msgr2=0x7f6d601015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:05.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.224+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 shutdown_connections 2024-08-28T20:16:05.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:05.224+0000 7f6d65e00640 1 -- 172.21.15.1:0/1151830548 wait complete. 2024-08-28T20:16:05.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:05 smithi001 ceph-mon[20984]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-28T20:16:05.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:05 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1151830548' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-28T20:16:05.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:05 smithi121 ceph-mon[25248]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-28T20:16:05.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:05 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1151830548' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-28T20:16:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:05 smithi007 ceph-mon[25357]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-28T20:16:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:05 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1151830548' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-28T20:16:06.046 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-28T20:16:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:06 smithi001 ceph-mon[20984]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-28T20:16:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:06 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1151830548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-28T20:16:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:06 smithi001 ceph-mon[20984]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-28T20:16:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:06 smithi001 ceph-mon[20984]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:16:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:06 smithi001 ceph-mon[20984]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-08-28T20:16:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:06 smithi001 ceph-mon[20984]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-08-28T20:16:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:06 smithi121 ceph-mon[25248]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-28T20:16:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:06 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1151830548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-28T20:16:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:06 smithi121 ceph-mon[25248]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-28T20:16:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:06 smithi121 ceph-mon[25248]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:16:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:06 smithi121 ceph-mon[25248]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-08-28T20:16:06.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:06 smithi121 ceph-mon[25248]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-08-28T20:16:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:06 smithi007 ceph-mon[25357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-28T20:16:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:06 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1151830548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-28T20:16:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:06 smithi007 ceph-mon[25357]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-28T20:16:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:06 smithi007 ceph-mon[25357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-28T20:16:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:06 smithi007 ceph-mon[25357]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-08-28T20:16:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:06 smithi007 ceph-mon[25357]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 -- 172.21.15.1:0/324518295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d41099c0 msgr2=0x7f10d41101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 --2- 172.21.15.1:0/324518295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d41099c0 0x7f10d41101f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009ca0 tx=0x7f10cc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 -- 172.21.15.1:0/324518295 shutdown_connections 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 --2- 172.21.15.1:0/324518295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d41099c0 0x7f10d41101f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 --2- 172.21.15.1:0/324518295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4109070 0x7f10d4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 --2- 172.21.15.1:0/324518295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d4103730 0x7f10d4103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 -- 172.21.15.1:0/324518295 >> 172.21.15.1:0/324518295 conn(0x7f10d40ff180 msgr2=0x7f10d41015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 -- 172.21.15.1:0/324518295 shutdown_connections 2024-08-28T20:16:07.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.098+0000 7f10d3200640 1 -- 172.21.15.1:0/324518295 wait complete. 2024-08-28T20:16:07.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.099+0000 7f10d3200640 1 Processor -- start 2024-08-28T20:16:07.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.099+0000 7f10d3200640 1 -- start start 2024-08-28T20:16:07.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 0x7f10d419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:07.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d4109070 0x7f10d419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d41099c0 0x7f10d419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d3200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4113670 con 0x7f10d4109070 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10d41134f0 con 0x7f10d4103730 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10d41137f0 con 0x7f10d41099c0 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 0x7f10d419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 0x7f10d419a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35530/0 (socket says 172.21.15.1:35530) 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 -- 172.21.15.1:0/61823173 learned_addr learned my addr 172.21.15.1:0/61823173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10cbe00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d4109070 0x7f10d419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:07.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d2800640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d41099c0 0x7f10d419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 -- 172.21.15.1:0/61823173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d41099c0 msgr2=0x7f10d419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d41099c0 0x7f10d419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 -- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d4109070 msgr2=0x7f10d419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d4109070 0x7f10d419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d1e00640 1 -- 172.21.15.1:0/61823173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d419ff70 con 0x7f10d4103730 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.100+0000 7f10d2800640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d41099c0 0x7f10d419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:16:07.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.101+0000 7f10d1e00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 0x7f10d419a000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10c400e9f0 tx=0x7f10c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.101+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c400cd80 con 0x7f10d4103730 2024-08-28T20:16:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.101+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d41a0260 con 0x7f10d4103730 2024-08-28T20:16:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.101+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10c40108e0 con 0x7f10d4103730 2024-08-28T20:16:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.101+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4018980 con 0x7f10d4103730 2024-08-28T20:16:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.101+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d41a69c0 con 0x7f10d4103730 2024-08-28T20:16:07.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.102+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d4103b40 con 0x7f10d4103730 2024-08-28T20:16:07.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.105+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f10c4010430 con 0x7f10d4103730 2024-08-28T20:16:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.107+0000 7f10caa00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10b80b4b30 0x7f10b80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.107+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f10c40e5900 con 0x7f10d4103730 2024-08-28T20:16:07.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.107+0000 7f10cbe00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10b80b4b30 0x7f10b80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:07.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.108+0000 7f10cbe00640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10b80b4b30 0x7f10b80b7040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0095f0 tx=0x7f10bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:07.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.108+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f10c40acae0 con 0x7f10d4103730 2024-08-28T20:16:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:07.350+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f10d402e430 con 0x7f10d4103730 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] up:active 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: Cluster is now healthy 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-08-28T20:16:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:07 smithi007 ceph-mon[25357]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] up:active 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: Cluster is now healthy 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-08-28T20:16:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:07 smithi001 ceph-mon[20984]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-28T20:16:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-08-28T20:16:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] up:active 2024-08-28T20:16:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-28T20:16:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-28T20:16:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: Cluster is now healthy 2024-08-28T20:16:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-08-28T20:16:07.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-08-28T20:16:07.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:07 smithi121 ceph-mon[25248]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-28T20:16:08.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.250+0000 7f10caa00640 1 -- 172.21.15.1:0/61823173 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f10c40ac3e0 con 0x7f10d4103730 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.254+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10b80b4b30 msgr2=0x7f10b80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.254+0000 7f10d3200640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10b80b4b30 0x7f10b80b7040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0095f0 tx=0x7f10bc005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.254+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 msgr2=0x7f10d419a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.254+0000 7f10d3200640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 0x7f10d419a000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10c400e9f0 tx=0x7f10c400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 shutdown_connections 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10b80b4b30 0x7f10b80b7040 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:08.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10d4109070 0x7f10d419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:08.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d41099c0 0x7f10d419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:08.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 --2- 172.21.15.1:0/61823173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10d4103730 0x7f10d419a000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:08.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 >> 172.21.15.1:0/61823173 conn(0x7f10d40ff180 msgr2=0x7f10d41015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:08.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 shutdown_connections 2024-08-28T20:16:08.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:08.255+0000 7f10d3200640 1 -- 172.21.15.1:0/61823173 wait complete. 2024-08-28T20:16:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] up:active 2024-08-28T20:16:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-08-28T20:16:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/61823173' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T20:16:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T20:16:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]} : dispatch 2024-08-28T20:16:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-08-28T20:16:08.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:08 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-08-28T20:16:08.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] up:active 2024-08-28T20:16:08.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-08-28T20:16:08.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/61823173' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T20:16:08.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T20:16:08.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-08-28T20:16:08.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:08 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-08-28T20:16:08.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] up:active 2024-08-28T20:16:08.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/61823173' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-08-28T20:16:08.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:08 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-08-28T20:16:09.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-28T20:16:09.436 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: pgmap v304: 97 pgs: 97 active+clean; 580 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 5 op/s 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]}]': finished 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-08-28T20:16:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-28T20:16:09.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-28T20:16:09.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-08-28T20:16:09.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-08-28T20:16:09.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-08-28T20:16:09.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: osdmap e75: 12 total, 12 up, 12 in 2024-08-28T20:16:09.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:09 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:16:09.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: pgmap v304: 97 pgs: 97 active+clean; 580 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 5 op/s 2024-08-28T20:16:09.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: osdmap e75: 12 total, 12 up, 12 in 2024-08-28T20:16:09.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:09 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:16:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: pgmap v304: 97 pgs: 97 active+clean; 580 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 5 op/s 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [7, 11]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-08-28T20:16:09.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: osdmap e75: 12 total, 12 up, 12 in 2024-08-28T20:16:09.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:09 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:16:10.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3854516818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 msgr2=0x7f1ab41101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3854516818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41101f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009ca0 tx=0x7f1aac02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3854516818 shutdown_connections 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3854516818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41101f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3854516818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab4109070 0x7f1ab4109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3854516818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab4103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3854516818 >> 172.21.15.1:0/3854516818 conn(0x7f1ab40ff180 msgr2=0x7f1ab41015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3854516818 shutdown_connections 2024-08-28T20:16:10.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.074+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3854516818 wait complete. 2024-08-28T20:16:10.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 Processor -- start 2024-08-28T20:16:10.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 -- start start 2024-08-28T20:16:10.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:10.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab4109070 0x7f1ab419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4113690 con 0x7f1ab41099c0 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4113510 con 0x7f1ab4103730 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab8a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4113810 con 0x7f1ab4109070 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.076+0000 7f1ab3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab419c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35560/0 (socket says 172.21.15.1:35560) 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 -- 172.21.15.1:0/3944894012 learned_addr learned my addr 172.21.15.1:0/3944894012 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3e00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab2a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab4109070 0x7f1ab419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:10.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 -- 172.21.15.1:0/3944894012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab4109070 msgr2=0x7f1ab419c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab4109070 0x7f1ab419c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 -- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 msgr2=0x7f1ab41a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 -- 172.21.15.1:0/3944894012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab41a21f0 con 0x7f1ab4103730 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3e00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.077+0000 7f1ab3400640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab419c280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400e9f0 tx=0x7f1aa400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.078+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400cd80 con 0x7f1ab4103730 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.078+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab41a24e0 con 0x7f1ab4103730 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.078+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa40108e0 con 0x7f1ab4103730 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.078+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4018980 con 0x7f1ab4103730 2024-08-28T20:16:10.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.078+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab41a8c40 con 0x7f1ab4103730 2024-08-28T20:16:10.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.079+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab4103b40 con 0x7f1ab4103730 2024-08-28T20:16:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.082+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f1aa4010430 con 0x7f1ab4103730 2024-08-28T20:16:10.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.083+0000 7f1aabe00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1a980b4b30 0x7f1a980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:10.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.084+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f1aa40e5970 con 0x7f1ab4103730 2024-08-28T20:16:10.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.084+0000 7f1ab2a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1a980b4b30 0x7f1a980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:10.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.084+0000 7f1ab2a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1a980b4b30 0x7f1a980b7040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4105830 tx=0x7f1aa0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:10.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.085+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1aa40ac3e0 con 0x7f1ab4103730 2024-08-28T20:16:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:10.318+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f1ab419d3b0 con 0x7f1ab4103730 2024-08-28T20:16:10.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:10 smithi007 ceph-mon[25357]: osdmap e76: 12 total, 12 up, 12 in 2024-08-28T20:16:10.631 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:10 smithi121 ceph-mon[25248]: osdmap e76: 12 total, 12 up, 12 in 2024-08-28T20:16:10.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:10 smithi001 ceph-mon[20984]: osdmap e76: 12 total, 12 up, 12 in 2024-08-28T20:16:11.265 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:16:10 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: 2024-08-28T20:16:10.826+0000 7fca3190b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-28T20:16:11.265 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:16:10 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: 2024-08-28T20:16:10.827+0000 7fca3190b640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-28T20:16:11.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.272+0000 7f1aabe00640 1 -- 172.21.15.1:0/3944894012 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f1aa40b0ba0 con 0x7f1ab4103730 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1a980b4b30 msgr2=0x7f1a980b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1a980b4b30 0x7f1a980b7040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4105830 tx=0x7f1aa0005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 msgr2=0x7f1ab419c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab419c280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400e9f0 tx=0x7f1aa400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 shutdown_connections 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1a980b4b30 0x7f1a980b7040 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:11.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ab41099c0 0x7f1ab41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab4109070 0x7f1ab419c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 --2- 172.21.15.1:0/3944894012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab4103730 0x7f1ab419c280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 >> 172.21.15.1:0/3944894012 conn(0x7f1ab40ff180 msgr2=0x7f1ab41086e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 shutdown_connections 2024-08-28T20:16:11.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:11.275+0000 7f1ab8a00640 1 -- 172.21.15.1:0/3944894012 wait complete. 2024-08-28T20:16:11.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:11 smithi007 ceph-mon[25357]: pgmap v307: 97 pgs: 6 peering, 91 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-08-28T20:16:11.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:11 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3944894012' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T20:16:11.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:11 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T20:16:11.636 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:11 smithi001 ceph-mon[20984]: pgmap v307: 97 pgs: 6 peering, 91 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-08-28T20:16:11.637 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:11 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3944894012' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T20:16:11.637 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:11 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T20:16:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:11 smithi121 ceph-mon[25248]: pgmap v307: 97 pgs: 6 peering, 91 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-08-28T20:16:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:11 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3944894012' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T20:16:11.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:11 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T20:16:11.992 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-08-28T20:16:11.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-28T20:16:12.375 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:12.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:12 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-28T20:16:12.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:12 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:16:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:12 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-28T20:16:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:12 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:16:12.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:12 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-28T20:16:12.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:12 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:16:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 -- 172.21.15.1:0/1291002698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 msgr2=0x7f43601125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 --2- 172.21.15.1:0/1291002698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 0x7f43601125f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4358009ca0 tx=0x7f435802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 -- 172.21.15.1:0/1291002698 shutdown_connections 2024-08-28T20:16:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 --2- 172.21.15.1:0/1291002698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 0x7f43601125f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 --2- 172.21.15.1:0/1291002698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436010b470 0x7f436010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 --2- 172.21.15.1:0/1291002698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4360105b30 0x7f4360105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 -- 172.21.15.1:0/1291002698 >> 172.21.15.1:0/1291002698 conn(0x7f4360101600 msgr2=0x7f4360103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 -- 172.21.15.1:0/1291002698 shutdown_connections 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.019+0000 7f4367000640 1 -- 172.21.15.1:0/1291002698 wait complete. 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.020+0000 7f4367000640 1 Processor -- start 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 -- start start 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 0x7f436019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f436010b470 0x7f436019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:13.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 0x7f43601a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:13.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4360115a80 con 0x7f436010bdc0 2024-08-28T20:16:13.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4360115900 con 0x7f4360105b30 2024-08-28T20:16:13.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4367000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4360115c00 con 0x7f436010b470 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f435fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 0x7f436019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f435fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 0x7f436019c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35578/0 (socket says 172.21.15.1:35578) 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4357400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f436010b470 0x7f436019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f435fe00640 1 -- 172.21.15.1:0/93018786 learned_addr learned my addr 172.21.15.1:0/93018786 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.021+0000 7f4365000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 0x7f43601a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435fe00640 1 -- 172.21.15.1:0/93018786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f436010b470 msgr2=0x7f436019c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435fe00640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f436010b470 0x7f436019c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435fe00640 1 -- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 msgr2=0x7f43601a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435fe00640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 0x7f43601a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435fe00640 1 -- 172.21.15.1:0/93018786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43601a23a0 con 0x7f4360105b30 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f4357400640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f436010b470 0x7f436019c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435fe00640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 0x7f436019c430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f435000e9f0 tx=0x7f435000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000cd80 con 0x7f4360105b30 2024-08-28T20:16:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43500054d0 con 0x7f4360105b30 2024-08-28T20:16:13.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.022+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43601a2690 con 0x7f4360105b30 2024-08-28T20:16:13.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.023+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350010690 con 0x7f4360105b30 2024-08-28T20:16:13.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.023+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43601a8df0 con 0x7f4360105b30 2024-08-28T20:16:13.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.024+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4360105f40 con 0x7f4360105b30 2024-08-28T20:16:13.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.026+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 152576+0+0 (secure 0 0 0) 0x7f4350004e30 con 0x7f4360105b30 2024-08-28T20:16:13.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.028+0000 7f435d600640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43440b4bb0 0x7f43440b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:13.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.028+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f43500e56b0 con 0x7f4360105b30 2024-08-28T20:16:13.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.028+0000 7f4357400640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43440b4bb0 0x7f43440b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:13.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.029+0000 7f4357400640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43440b4bb0 0x7f43440b70c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f43480095f0 tx=0x7f4348005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:13.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.029+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4350056130 con 0x7f4360105b30 2024-08-28T20:16:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.252+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f43600635a0 con 0x7f43440b4bb0 2024-08-28T20:16:13.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.286+0000 7f435d600640 1 -- 172.21.15.1:0/93018786 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f43600635a0 con 0x7f43440b4bb0 2024-08-28T20:16:13.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43440b4bb0 msgr2=0x7f43440b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:13.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43440b4bb0 0x7f43440b70c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f43480095f0 tx=0x7f4348005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:13.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 msgr2=0x7f436019c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:13.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 0x7f436019c430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f435000e9f0 tx=0x7f435000edf0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 shutdown_connections 2024-08-28T20:16:13.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43440b4bb0 0x7f43440b70c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f436010bdc0 0x7f43601a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f436010b470 0x7f436019c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 --2- 172.21.15.1:0/93018786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4360105b30 0x7f436019c430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:13.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 >> 172.21.15.1:0/93018786 conn(0x7f4360101600 msgr2=0x7f436010aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:13.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 shutdown_connections 2024-08-28T20:16:13.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:13.289+0000 7f4367000640 1 -- 172.21.15.1:0/93018786 wait complete. 2024-08-28T20:16:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:13 smithi007 ceph-mon[25357]: pgmap v308: 97 pgs: 6 peering, 91 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.7 KiB/s wr, 9 op/s 2024-08-28T20:16:13.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:13 smithi001 ceph-mon[20984]: pgmap v308: 97 pgs: 6 peering, 91 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.7 KiB/s wr, 9 op/s 2024-08-28T20:16:13.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:16:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:16:13.259+0000 7fb8f8000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T20:16:13.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:16:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:16:13.259+0000 7fb8f8000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T20:16:13.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:16:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:16:13.259+0000 7fb8f8000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T20:16:13.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:16:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:16:13.259+0000 7fb8f8000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T20:16:13.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:16:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:16:13.259+0000 7fb8f8000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T20:16:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:13 smithi121 ceph-mon[25248]: pgmap v308: 97 pgs: 6 peering, 91 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.7 KiB/s wr, 9 op/s 2024-08-28T20:16:14.218 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-28T20:16:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:14 smithi001 ceph-mon[20984]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:14 smithi007 ceph-mon[25357]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:14.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:14 smithi121 ceph-mon[25248]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:15.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 -- 172.21.15.1:0/1431508513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400754d0 msgr2=0x7f0b400758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 --2- 172.21.15.1:0/1431508513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400754d0 0x7f0b400758e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009900 tx=0x7f0b3002a410 comp rx=0 tx=0).stop 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 -- 172.21.15.1:0/1431508513 shutdown_connections 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 --2- 172.21.15.1:0/1431508513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 0x7f0b40112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 --2- 172.21.15.1:0/1431508513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b40075e20 0x7f0b4010f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 --2- 172.21.15.1:0/1431508513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b400754d0 0x7f0b400758e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 -- 172.21.15.1:0/1431508513 >> 172.21.15.1:0/1431508513 conn(0x7f0b4007b5f0 msgr2=0x7f0b4007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 -- 172.21.15.1:0/1431508513 shutdown_connections 2024-08-28T20:16:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.237+0000 7f0b45200640 1 -- 172.21.15.1:0/1431508513 wait complete. 2024-08-28T20:16:15.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 Processor -- start 2024-08-28T20:16:15.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 -- start start 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b400754d0 0x7f0b4019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 0x7f0b4019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 0x7f0b401a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40115a70 con 0x7f0b40075e20 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b401158f0 con 0x7f0b4010fee0 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b45200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40115bf0 con 0x7f0b400754d0 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 0x7f0b4019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b3e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 0x7f0b401a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b3de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b400754d0 0x7f0b4019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.239+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 0x7f0b4019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56408/0 (socket says 172.21.15.1:56408) 2024-08-28T20:16:15.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3d400640 1 -- 172.21.15.1:0/1362030108 learned_addr learned my addr 172.21.15.1:0/1362030108 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 0x7f0b401a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35628/0 (socket says 172.21.15.1:35628) 2024-08-28T20:16:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3de00640 1 -- 172.21.15.1:0/1362030108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 msgr2=0x7f0b401a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3de00640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 0x7f0b401a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3de00640 1 -- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 msgr2=0x7f0b4019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3de00640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 0x7f0b4019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3de00640 1 -- 172.21.15.1:0/1362030108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b401a24f0 con 0x7f0b400754d0 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3d400640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 0x7f0b4019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.240+0000 7f0b3de00640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b400754d0 0x7f0b4019c580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b3002aa00 tx=0x7f0b30003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.241+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3003f070 con 0x7f0b400754d0 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.241+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b401a2780 con 0x7f0b400754d0 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.241+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b30031b50 con 0x7f0b400754d0 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.241+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30035030 con 0x7f0b400754d0 2024-08-28T20:16:15.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.241+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b401a8f40 con 0x7f0b400754d0 2024-08-28T20:16:15.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.242+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b400769e0 con 0x7f0b400754d0 2024-08-28T20:16:15.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.244+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f0b30042070 con 0x7f0b400754d0 2024-08-28T20:16:15.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.246+0000 7f0b36a00640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0b240b4c40 0x7f0b240b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:15.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.246+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f0b301059e0 con 0x7f0b400754d0 2024-08-28T20:16:15.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.246+0000 7f0b3d400640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0b240b4c40 0x7f0b240b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:15.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.247+0000 7f0b3d400640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0b240b4c40 0x7f0b240b7150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b40111c50 tx=0x7f0b2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:15.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.248+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0b300cc2f0 con 0x7f0b400754d0 2024-08-28T20:16:15.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.473+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0b40109080 con 0x7f0b240b4c40 2024-08-28T20:16:15.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:15 smithi001 ceph-mon[20984]: pgmap v309: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.1 KiB/s wr, 13 op/s; 87 B/s, 1 objects/s recovering 2024-08-28T20:16:15.476 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:15 smithi001 ceph-mon[20984]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-28T20:16:15.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.503+0000 7f0b36a00640 1 -- 172.21.15.1:0/1362030108 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b40109080 con 0x7f0b240b4c40 2024-08-28T20:16:15.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0b240b4c40 msgr2=0x7f0b240b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:15.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0b240b4c40 0x7f0b240b7150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b40111c50 tx=0x7f0b2c005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:15.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b400754d0 msgr2=0x7f0b4019c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b400754d0 0x7f0b4019c580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b3002aa00 tx=0x7f0b30003b90 comp rx=0 tx=0).stop 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 shutdown_connections 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0b240b4c40 0x7f0b240b7150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b40075e20 0x7f0b4019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4010fee0 0x7f0b401a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 --2- 172.21.15.1:0/1362030108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b400754d0 0x7f0b4019c580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 >> 172.21.15.1:0/1362030108 conn(0x7f0b4007b5f0 msgr2=0x7f0b40108970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 shutdown_connections 2024-08-28T20:16:15.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:15.505+0000 7f0b45200640 1 -- 172.21.15.1:0/1362030108 wait complete. 2024-08-28T20:16:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:15 smithi007 ceph-mon[25357]: pgmap v309: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.1 KiB/s wr, 13 op/s; 87 B/s, 1 objects/s recovering 2024-08-28T20:16:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:15 smithi007 ceph-mon[25357]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-28T20:16:15.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:15 smithi121 ceph-mon[25248]: pgmap v309: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.1 KiB/s wr, 13 op/s; 87 B/s, 1 objects/s recovering 2024-08-28T20:16:15.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:15 smithi121 ceph-mon[25248]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-28T20:16:16.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-28T20:16:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:16 smithi007 ceph-mon[25357]: from='client.24781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:16.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:16 smithi001 ceph-mon[20984]: from='client.24781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:16.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:16 smithi121 ceph-mon[25248]: from='client.24781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 -- 172.21.15.1:0/4008922320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 msgr2=0x7fa03c103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 --2- 172.21.15.1:0/4008922320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c103b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa030009900 tx=0x7fa03002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 -- 172.21.15.1:0/4008922320 shutdown_connections 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 --2- 172.21.15.1:0/4008922320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 0x7fa03c110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 --2- 172.21.15.1:0/4008922320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa03c109090 0x7fa03c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 --2- 172.21.15.1:0/4008922320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c103b60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 -- 172.21.15.1:0/4008922320 >> 172.21.15.1:0/4008922320 conn(0x7fa03c0ff1e0 msgr2=0x7fa03c101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:17.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 -- 172.21.15.1:0/4008922320 shutdown_connections 2024-08-28T20:16:17.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.451+0000 7fa042e00640 1 -- 172.21.15.1:0/4008922320 wait complete. 2024-08-28T20:16:17.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 Processor -- start 2024-08-28T20:16:17.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 -- start start 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c19c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa03c109090 0x7fa03c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 0x7fa03c1a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c1136e0 con 0x7fa03c103750 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c113560 con 0x7fa03c1099e0 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa042e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c113860 con 0x7fa03c109090 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.453+0000 7fa041a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c19c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c19c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35718/0 (socket says 172.21.15.1:35718) 2024-08-28T20:16:17.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 -- 172.21.15.1:0/2558074434 learned_addr learned my addr 172.21.15.1:0/2558074434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:17.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041000640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa03c109090 0x7fa03c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:17.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa042400640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 0x7fa03c1a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:17.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 -- 172.21.15.1:0/2558074434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa03c109090 msgr2=0x7fa03c19c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa03c109090 0x7fa03c19c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 -- 172.21.15.1:0/2558074434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 msgr2=0x7fa03c1a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 0x7fa03c1a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 -- 172.21.15.1:0/2558074434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c1a2260 con 0x7fa03c103750 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa042400640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 0x7fa03c1a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.454+0000 7fa041a00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c19c2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa030005ab0 tx=0x7fa030003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.455+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03003f070 con 0x7fa03c103750 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.455+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa030031d60 con 0x7fa03c103750 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.455+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030035030 con 0x7fa03c103750 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.455+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c1a24f0 con 0x7fa03c103750 2024-08-28T20:16:17.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.455+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c1a8cb0 con 0x7fa03c103750 2024-08-28T20:16:17.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.456+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03c1049d0 con 0x7fa03c103750 2024-08-28T20:16:17.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.458+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fa030042070 con 0x7fa03c103750 2024-08-28T20:16:17.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.460+0000 7fa03a000640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa0240b4bc0 0x7fa0240b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:17.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.461+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa030105c50 con 0x7fa03c103750 2024-08-28T20:16:17.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.461+0000 7fa041000640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa0240b4bc0 0x7fa0240b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:17.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.461+0000 7fa041000640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa0240b4bc0 0x7fa0240b70d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa03c105850 tx=0x7fa02800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:17.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.465+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0300ccbb0 con 0x7fa03c103750 2024-08-28T20:16:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:17 smithi007 ceph-mon[25357]: pgmap v310: 97 pgs: 97 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 KiB/s wr, 14 op/s; 288 B/s, 2 objects/s recovering 2024-08-28T20:16:17.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.687+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa03c10f470 con 0x7fa0240b4bc0 2024-08-28T20:16:17.690 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:17 smithi001 ceph-mon[20984]: pgmap v310: 97 pgs: 97 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 KiB/s wr, 14 op/s; 288 B/s, 2 objects/s recovering 2024-08-28T20:16:17.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.695+0000 7fa03a000640 1 -- 172.21.15.1:0/2558074434 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa03c10f470 con 0x7fa0240b4bc0 2024-08-28T20:16:17.697 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/5b31db88-89a0-4243-807a-a62a4b405510 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa0240b4bc0 msgr2=0x7fa0240b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa0240b4bc0 0x7fa0240b70d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa03c105850 tx=0x7fa02800b390 comp rx=0 tx=0).stop 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 msgr2=0x7fa03c19c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c19c2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa030005ab0 tx=0x7fa030003cd0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 shutdown_connections 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa0240b4bc0 0x7fa0240b70d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa03c1099e0 0x7fa03c1a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa03c109090 0x7fa03c19c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 --2- 172.21.15.1:0/2558074434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa03c103750 0x7fa03c19c2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.697+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 >> 172.21.15.1:0/2558074434 conn(0x7fa03c0ff1e0 msgr2=0x7fa03c108790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:17.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.698+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 shutdown_connections 2024-08-28T20:16:17.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:17.698+0000 7fa042e00640 1 -- 172.21.15.1:0/2558074434 wait complete. 2024-08-28T20:16:17.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:17 smithi121 ceph-mon[25248]: pgmap v310: 97 pgs: 97 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 KiB/s wr, 14 op/s; 288 B/s, 2 objects/s recovering 2024-08-28T20:16:18.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:18 smithi001 ceph-mon[20984]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:18.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:18 smithi007 ceph-mon[25357]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:18.598 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-28T20:16:18.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:18 smithi121 ceph-mon[25248]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:19.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:19 smithi001 ceph-mon[20984]: pgmap v311: 97 pgs: 97 active+clean; 589 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.1 KiB/s wr, 12 op/s; 233 B/s, 1 objects/s recovering 2024-08-28T20:16:19.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 -- 172.21.15.1:0/85647810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a810b2a0 msgr2=0x7f81a810b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 --2- 172.21.15.1:0/85647810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a810b2a0 0x7f81a810b6b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8194009900 tx=0x7f819402a410 comp rx=0 tx=0).stop 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 -- 172.21.15.1:0/85647810 shutdown_connections 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 --2- 172.21.15.1:0/85647810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a810b2a0 0x7f81a810b6b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 --2- 172.21.15.1:0/85647810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a810bbf0 0x7f81a8112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 --2- 172.21.15.1:0/85647810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81a8105960 0x7f81a8105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 -- 172.21.15.1:0/85647810 >> 172.21.15.1:0/85647810 conn(0x7f81a8101410 msgr2=0x7f81a8103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:19.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 -- 172.21.15.1:0/85647810 shutdown_connections 2024-08-28T20:16:19.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.559+0000 7f81aea00640 1 -- 172.21.15.1:0/85647810 wait complete. 2024-08-28T20:16:19.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.560+0000 7f81aea00640 1 Processor -- start 2024-08-28T20:16:19.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.560+0000 7f81aea00640 1 -- start start 2024-08-28T20:16:19.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.560+0000 7f81aea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 0x7f81a819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:19.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.560+0000 7f81aea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81a810b2a0 0x7f81a819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:19.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81aea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a810bbf0 0x7f81a81a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81aea00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8115900 con 0x7f81a8105960 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81aea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8115780 con 0x7f81a810b2a0 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81aea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8115a80 con 0x7f81a810bbf0 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 0x7f81a819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 0x7f81a819c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35738/0 (socket says 172.21.15.1:35738) 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 -- 172.21.15.1:0/125773587 learned_addr learned my addr 172.21.15.1:0/125773587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ae000640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a810bbf0 0x7f81a81a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81acc00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81a810b2a0 0x7f81a819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 -- 172.21.15.1:0/125773587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a810bbf0 msgr2=0x7f81a81a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a810bbf0 0x7f81a81a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 -- 172.21.15.1:0/125773587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81a810b2a0 msgr2=0x7f81a819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81a810b2a0 0x7f81a819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.561+0000 7f81ad600640 1 -- 172.21.15.1:0/125773587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a81a2200 con 0x7f81a8105960 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.562+0000 7f81ad600640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 0x7f81a819c290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f819c00e9f0 tx=0x7f819c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.562+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c00cd80 con 0x7f81a8105960 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.562+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a81a24f0 con 0x7f81a8105960 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.562+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f819c0108e0 con 0x7f81a8105960 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.562+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c018980 con 0x7f81a8105960 2024-08-28T20:16:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.562+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a81a8c50 con 0x7f81a8105960 2024-08-28T20:16:19.568 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:19 smithi007 ceph-mon[25357]: pgmap v311: 97 pgs: 97 active+clean; 589 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.1 KiB/s wr, 12 op/s; 233 B/s, 1 objects/s recovering 2024-08-28T20:16:19.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.563+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a8105d70 con 0x7f81a8105960 2024-08-28T20:16:19.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.567+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f819c010430 con 0x7f81a8105960 2024-08-28T20:16:19.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.569+0000 7f81a6000640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81900b4c40 0x7f81900b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:19.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.569+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f819c0e5ab0 con 0x7f81a8105960 2024-08-28T20:16:19.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.569+0000 7f81acc00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81900b4c40 0x7f81900b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:19.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.570+0000 7f81acc00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81900b4c40 0x7f81900b7150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f819402aa00 tx=0x7f8194005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:19.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.571+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f819c0ac3c0 con 0x7f81a8105960 2024-08-28T20:16:19.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:19 smithi121 ceph-mon[25248]: pgmap v311: 97 pgs: 97 active+clean; 589 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.1 KiB/s wr, 12 op/s; 233 B/s, 1 objects/s recovering 2024-08-28T20:16:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.793+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f81a80635a0 con 0x7f81900b4c40 2024-08-28T20:16:19.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.820+0000 7f81a6000640 1 -- 172.21.15.1:0/125773587 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f81a80635a0 con 0x7f81900b4c40 2024-08-28T20:16:19.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81900b4c40 msgr2=0x7f81900b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:19.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81900b4c40 0x7f81900b7150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f819402aa00 tx=0x7f8194005a20 comp rx=0 tx=0).stop 2024-08-28T20:16:19.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 msgr2=0x7f81a819c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 0x7f81a819c290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f819c00e9f0 tx=0x7f819c00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 shutdown_connections 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81900b4c40 0x7f81900b7150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a810bbf0 0x7f81a81a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81a810b2a0 0x7f81a819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 --2- 172.21.15.1:0/125773587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a8105960 0x7f81a819c290 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 >> 172.21.15.1:0/125773587 conn(0x7f81a8101410 msgr2=0x7f81a810a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 shutdown_connections 2024-08-28T20:16:19.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:19.823+0000 7f81aea00640 1 -- 172.21.15.1:0/125773587 wait complete. 2024-08-28T20:16:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:20 smithi001 ceph-mon[20984]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:20 smithi007 ceph-mon[25357]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:20.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-28T20:16:20.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:20 smithi121 ceph-mon[25248]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:21.096 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:21.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:21 smithi001 ceph-mon[20984]: pgmap v312: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.8 KiB/s wr, 10 op/s; 211 B/s, 1 objects/s recovering 2024-08-28T20:16:21.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:21 smithi007 ceph-mon[25357]: pgmap v312: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.8 KiB/s wr, 10 op/s; 211 B/s, 1 objects/s recovering 2024-08-28T20:16:21.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 -- 172.21.15.1:0/2762634452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 msgr2=0x7f2ea0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 --2- 172.21.15.1:0/2762634452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea0103d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e9002a410 comp rx=0 tx=0).stop 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 -- 172.21.15.1:0/2762634452 shutdown_connections 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 --2- 172.21.15.1:0/2762634452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0109bb0 0x7f2ea01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 --2- 172.21.15.1:0/2762634452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0109260 0x7f2ea0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 --2- 172.21.15.1:0/2762634452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea0103d30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 -- 172.21.15.1:0/2762634452 >> 172.21.15.1:0/2762634452 conn(0x7f2ea00ff330 msgr2=0x7f2ea0101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.720+0000 7f2ea6800640 1 -- 172.21.15.1:0/2762634452 shutdown_connections 2024-08-28T20:16:21.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.721+0000 7f2ea6800640 1 -- 172.21.15.1:0/2762634452 wait complete. 2024-08-28T20:16:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 Processor -- start 2024-08-28T20:16:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 -- start start 2024-08-28T20:16:21.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0109260 0x7f2ea00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0109bb0 0x7f2ea0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01138c0 con 0x7f2ea0103920 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0113740 con 0x7f2ea0109260 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2ea6800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0113a40 con 0x7f2ea0109bb0 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.722+0000 7f2e9f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea00754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35746/0 (socket says 172.21.15.1:35746) 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 -- 172.21.15.1:0/4126007152 learned_addr learned my addr 172.21.15.1:0/4126007152 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9fe00640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0109bb0 0x7f2ea0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:21.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9ea00640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0109260 0x7f2ea00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 -- 172.21.15.1:0/4126007152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0109bb0 msgr2=0x7f2ea0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0109bb0 0x7f2ea0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 -- 172.21.15.1:0/4126007152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0109260 msgr2=0x7f2ea00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0109260 0x7f2ea00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.723+0000 7f2e9f400640 1 -- 172.21.15.1:0/4126007152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea01a8530 con 0x7f2ea0103920 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.724+0000 7f2e9f400640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea00754b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e90005ab0 tx=0x7f2e90003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.724+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9003f070 con 0x7f2ea0103920 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.724+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e90031b60 con 0x7f2ea0103920 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.724+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90035030 con 0x7f2ea0103920 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.724+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea01a87c0 con 0x7f2ea0103920 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.724+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea01a8c50 con 0x7f2ea0103920 2024-08-28T20:16:21.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.725+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea0103d30 con 0x7f2ea0103920 2024-08-28T20:16:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:21 smithi121 ceph-mon[25248]: pgmap v312: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.8 KiB/s wr, 10 op/s; 211 B/s, 1 objects/s recovering 2024-08-28T20:16:21.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.729+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f2e90042070 con 0x7f2ea0103920 2024-08-28T20:16:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.731+0000 7f2e97e00640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bc0 0x7f2e840b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:21.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.731+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2e901061e0 con 0x7f2ea0103920 2024-08-28T20:16:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.731+0000 7f2e9ea00640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bc0 0x7f2e840b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.731+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2e900ccaf0 con 0x7f2ea0103920 2024-08-28T20:16:21.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.732+0000 7f2e9ea00640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bc0 0x7f2e840b70d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0101b70 tx=0x7f2e8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:21.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.960+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2ea00635a0 con 0x7f2e840b4bc0 2024-08-28T20:16:21.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.967+0000 7f2e97e00640 1 -- 172.21.15.1:0/4126007152 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2ea00635a0 con 0x7f2e840b4bc0 2024-08-28T20:16:21.970 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/94f8b253-5e25-406d-94ab-b0f8ba69907a 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bc0 msgr2=0x7f2e840b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bc0 0x7f2e840b70d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0101b70 tx=0x7f2e8c005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 msgr2=0x7f2ea00754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea00754b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e90005ab0 tx=0x7f2e90003c10 comp rx=0 tx=0).stop 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 shutdown_connections 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bc0 0x7f2e840b70d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0109bb0 0x7f2ea0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0109260 0x7f2ea00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 --2- 172.21.15.1:0/4126007152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea0103920 0x7f2ea00754b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 >> 172.21.15.1:0/4126007152 conn(0x7f2ea00ff330 msgr2=0x7f2ea0102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 shutdown_connections 2024-08-28T20:16:21.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:21.970+0000 7f2ea6800640 1 -- 172.21.15.1:0/4126007152 wait complete. 2024-08-28T20:16:22.985 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:16:23.367 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:23 smithi007 ceph-mon[25357]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:23 smithi007 ceph-mon[25357]: pgmap v313: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 192 B/s, 1 objects/s recovering 2024-08-28T20:16:23.712 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:23 smithi001 ceph-mon[20984]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:23.713 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:23 smithi001 ceph-mon[20984]: pgmap v313: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 192 B/s, 1 objects/s recovering 2024-08-28T20:16:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:23 smithi121 ceph-mon[25248]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:16:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:23 smithi121 ceph-mon[25248]: pgmap v313: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 192 B/s, 1 objects/s recovering 2024-08-28T20:16:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 -- 172.21.15.1:0/779321926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810b460 msgr2=0x7f55f810b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 --2- 172.21.15.1:0/779321926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810b460 0x7f55f810b870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009860 tx=0x7f55e002a340 comp rx=0 tx=0).stop 2024-08-28T20:16:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 -- 172.21.15.1:0/779321926 shutdown_connections 2024-08-28T20:16:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 --2- 172.21.15.1:0/779321926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f810bdb0 0x7f55f81125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 --2- 172.21.15.1:0/779321926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810b460 0x7f55f810b870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 --2- 172.21.15.1:0/779321926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f8105b20 0x7f55f8105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 -- 172.21.15.1:0/779321926 >> 172.21.15.1:0/779321926 conn(0x7f55f81015b0 msgr2=0x7f55f8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:24.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 -- 172.21.15.1:0/779321926 shutdown_connections 2024-08-28T20:16:24.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.016+0000 7f55fee00640 1 -- 172.21.15.1:0/779321926 wait complete. 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.017+0000 7f55fee00640 1 Processor -- start 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.017+0000 7f55fee00640 1 -- start start 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fee00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 0x7f55f819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810b460 0x7f55f819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fee00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810bdb0 0x7f55f81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fee00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8115a70 con 0x7f55f8105b20 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81158f0 con 0x7f55f810b460 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fee00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8115bf0 con 0x7f55f810bdb0 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 0x7f55f819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:24.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 0x7f55f819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35766/0 (socket says 172.21.15.1:35766) 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55ef400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810b460 0x7f55f819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55f7e00640 1 -- 172.21.15.1:0/929496690 learned_addr learned my addr 172.21.15.1:0/929496690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.018+0000 7f55fce00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810bdb0 0x7f55f81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55ef400640 1 -- 172.21.15.1:0/929496690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810bdb0 msgr2=0x7f55f81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55ef400640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810bdb0 0x7f55f81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55ef400640 1 -- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 msgr2=0x7f55f819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55ef400640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 0x7f55f819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55ef400640 1 -- 172.21.15.1:0/929496690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f81a23f0 con 0x7f55f810b460 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55fce00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810bdb0 0x7f55f81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55f7e00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 0x7f55f819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55ef400640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810b460 0x7f55f819ca20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55e002a860 tx=0x7f55e0032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0040020 con 0x7f55f810b460 2024-08-28T20:16:24.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e0030e10 con 0x7f55f810b460 2024-08-28T20:16:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f81a2680 con 0x7f55f810b460 2024-08-28T20:16:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0037040 con 0x7f55f810b460 2024-08-28T20:16:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.019+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f81a8e40 con 0x7f55f810b460 2024-08-28T20:16:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.020+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f8106da0 con 0x7f55f810b460 2024-08-28T20:16:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.023+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f55e0043020 con 0x7f55f810b460 2024-08-28T20:16:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.024+0000 7f55f5600640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f55dc0b4bc0 0x7f55dc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.025+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f55e01055e0 con 0x7f55f810b460 2024-08-28T20:16:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.025+0000 7f55f7e00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f55dc0b4bc0 0x7f55dc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:24.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.025+0000 7f55f7e00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f55dc0b4bc0 0x7f55dc0b70d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55e800f7d0 tx=0x7f55e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:24.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.026+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f55e004a020 con 0x7f55f810b460 2024-08-28T20:16:24.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.259+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55f8105f30 con 0x7f55f810b460 2024-08-28T20:16:24.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.260+0000 7f55f5600640 1 -- 172.21.15.1:0/929496690 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7f55f8105f30 con 0x7f55f810b460 2024-08-28T20:16:24.263 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:24.263 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-08-28T20:16:11:262914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:16:10.320965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:16:24.263 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:16:24.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.262+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f55dc0b4bc0 msgr2=0x7f55dc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:24.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.262+0000 7f55fee00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f55dc0b4bc0 0x7f55dc0b70d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55e800f7d0 tx=0x7f55e8009500 comp rx=0 tx=0).stop 2024-08-28T20:16:24.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810b460 msgr2=0x7f55f819ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:24.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810b460 0x7f55f819ca20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55e002a860 tx=0x7f55e0032d50 comp rx=0 tx=0).stop 2024-08-28T20:16:24.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 shutdown_connections 2024-08-28T20:16:24.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f55dc0b4bc0 0x7f55dc0b70d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55f810bdb0 0x7f55f81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810b460 0x7f55f819ca20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 --2- 172.21.15.1:0/929496690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55f8105b20 0x7f55f819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:24.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 >> 172.21.15.1:0/929496690 conn(0x7f55f81015b0 msgr2=0x7f55f81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:24.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 shutdown_connections 2024-08-28T20:16:24.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:24.263+0000 7f55fee00640 1 -- 172.21.15.1:0/929496690 wait complete. 2024-08-28T20:16:24.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:24 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/929496690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:16:24.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:24 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/929496690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:16:24.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:24 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/929496690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:16:25.007 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:16:25.395 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:25.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:25 smithi001 ceph-mon[20984]: pgmap v314: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 192 B/s, 1 objects/s recovering 2024-08-28T20:16:25.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:25 smithi121 ceph-mon[25248]: pgmap v314: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 192 B/s, 1 objects/s recovering 2024-08-28T20:16:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:25 smithi007 ceph-mon[25357]: pgmap v314: 97 pgs: 97 active+clean; 603 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 192 B/s, 1 objects/s recovering 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 -- 172.21.15.1:0/797824312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee8075550 msgr2=0x7f3ee8075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 --2- 172.21.15.1:0/797824312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee8075550 0x7f3ee8075960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009900 tx=0x7f3edc02a410 comp rx=0 tx=0).stop 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 -- 172.21.15.1:0/797824312 shutdown_connections 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 --2- 172.21.15.1:0/797824312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee810fe80 0x7f3ee81122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 --2- 172.21.15.1:0/797824312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee8075ea0 0x7f3ee810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 --2- 172.21.15.1:0/797824312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee8075550 0x7f3ee8075960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:25.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 -- 172.21.15.1:0/797824312 >> 172.21.15.1:0/797824312 conn(0x7f3ee80ff370 msgr2=0x7f3ee81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 -- 172.21.15.1:0/797824312 shutdown_connections 2024-08-28T20:16:25.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.987+0000 7f3ef0400640 1 -- 172.21.15.1:0/797824312 wait complete. 2024-08-28T20:16:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.988+0000 7f3ef0400640 1 Processor -- start 2024-08-28T20:16:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.988+0000 7f3ef0400640 1 -- start start 2024-08-28T20:16:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3ef0400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 0x7f3ee819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3ef0400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee8075ea0 0x7f3ee819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:25.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3ef0400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee810fe80 0x7f3ee81a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3ef0400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8115a30 con 0x7f3ee810fe80 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3ef0400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81158b0 con 0x7f3ee8075550 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3ef0400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8115bb0 con 0x7f3ee8075ea0 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 0x7f3ee819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 0x7f3ee819c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41266/0 (socket says 172.21.15.1:41266) 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 -- 172.21.15.1:0/1075720790 learned_addr learned my addr 172.21.15.1:0/1075720790 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eee400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee810fe80 0x7f3ee81a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eed000640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee8075ea0 0x7f3ee819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 -- 172.21.15.1:0/1075720790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee8075ea0 msgr2=0x7f3ee819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:25.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee8075ea0 0x7f3ee819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 -- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee810fe80 msgr2=0x7f3ee81a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee810fe80 0x7f3ee81a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.989+0000 7f3eeda00640 1 -- 172.21.15.1:0/1075720790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81a23d0 con 0x7f3ee8075550 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.990+0000 7f3eeda00640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 0x7f3ee819c460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3edc005940 tx=0x7f3edc0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.990+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc03f030 con 0x7f3ee8075550 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.990+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3edc0044c0 con 0x7f3ee8075550 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.990+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee81a2660 con 0x7f3ee8075550 2024-08-28T20:16:25.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.990+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc035070 con 0x7f3ee8075550 2024-08-28T20:16:25.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.990+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee81a8e20 con 0x7f3ee8075550 2024-08-28T20:16:25.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.991+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee8075960 con 0x7f3ee8075550 2024-08-28T20:16:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.994+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f3edc042030 con 0x7f3ee8075550 2024-08-28T20:16:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.995+0000 7f3ee6000640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3ed00b4c40 0x7f3ed00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:25.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.996+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3edc105810 con 0x7f3ee8075550 2024-08-28T20:16:25.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.996+0000 7f3eed000640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3ed00b4c40 0x7f3ed00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:25.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.996+0000 7f3eed000640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3ed00b4c40 0x7f3ed00b7150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ee81122e0 tx=0x7f3ed4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:25.997+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3edc0cc120 con 0x7f3ee8075550 2024-08-28T20:16:26.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.194+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ee81a9080 con 0x7f3ee8075550 2024-08-28T20:16:26.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.196+0000 7f3ee6000640 1 -- 172.21.15.1:0/1075720790 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7f3edc0e6e20 con 0x7f3ee8075550 2024-08-28T20:16:26.199 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:26.199 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3ed00b4c40 msgr2=0x7f3ed00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3ed00b4c40 0x7f3ed00b7150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ee81122e0 tx=0x7f3ed4005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 msgr2=0x7f3ee819c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 0x7f3ee819c460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3edc005940 tx=0x7f3edc0040c0 comp rx=0 tx=0).stop 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 shutdown_connections 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3ed00b4c40 0x7f3ed00b7150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ee810fe80 0x7f3ee81a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee8075ea0 0x7f3ee819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 --2- 172.21.15.1:0/1075720790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ee8075550 0x7f3ee819c460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 >> 172.21.15.1:0/1075720790 conn(0x7f3ee80ff370 msgr2=0x7f3ee8109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 shutdown_connections 2024-08-28T20:16:26.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:26.199+0000 7f3ef0400640 1 -- 172.21.15.1:0/1075720790 wait complete. 2024-08-28T20:16:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1075720790' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:26.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1075720790' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:26.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1075720790' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:27.040 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-28T20:16:27.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T20:16:27.418 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:27.716 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:27 smithi007 ceph-mon[25357]: pgmap v315: 97 pgs: 97 active+clean; 627 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 KiB/s wr, 9 op/s; 134 B/s, 0 objects/s recovering 2024-08-28T20:16:27.726 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:27 smithi001 ceph-mon[20984]: pgmap v315: 97 pgs: 97 active+clean; 627 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 KiB/s wr, 9 op/s; 134 B/s, 0 objects/s recovering 2024-08-28T20:16:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:27 smithi121 ceph-mon[25248]: pgmap v315: 97 pgs: 97 active+clean; 627 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 KiB/s wr, 9 op/s; 134 B/s, 0 objects/s recovering 2024-08-28T20:16:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 -- 172.21.15.1:0/3899058449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 msgr2=0x7f3020105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 --2- 172.21.15.1:0/3899058449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f3020105f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3010009900 tx=0x7f301002a410 comp rx=0 tx=0).stop 2024-08-28T20:16:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 -- 172.21.15.1:0/3899058449 shutdown_connections 2024-08-28T20:16:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 --2- 172.21.15.1:0/3899058449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010bdc0 0x7f30201125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 --2- 172.21.15.1:0/3899058449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302010b470 0x7f302010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 --2- 172.21.15.1:0/3899058449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f3020105f40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 -- 172.21.15.1:0/3899058449 >> 172.21.15.1:0/3899058449 conn(0x7f3020101600 msgr2=0x7f3020103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.056+0000 7f3025800640 1 -- 172.21.15.1:0/3899058449 shutdown_connections 2024-08-28T20:16:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.057+0000 7f3025800640 1 -- 172.21.15.1:0/3899058449 wait complete. 2024-08-28T20:16:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.058+0000 7f3025800640 1 Processor -- start 2024-08-28T20:16:28.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.058+0000 7f3025800640 1 -- start start 2024-08-28T20:16:28.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3025800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f302019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:28.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3025800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010b470 0x7f302019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3025800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302010bdc0 0x7f30201a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3025800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3020115a80 con 0x7f3020105b30 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3025800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3020115900 con 0x7f302010bdc0 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3025800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3020115c00 con 0x7f302010b470 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f301ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f302019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f301ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f302019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56586/0 (socket says 172.21.15.1:56586) 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f3016000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010b470 0x7f302019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f301ea00640 1 -- 172.21.15.1:0/3741382 learned_addr learned my addr 172.21.15.1:0/3741382 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.059+0000 7f301f400640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302010bdc0 0x7f30201a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f301ea00640 1 -- 172.21.15.1:0/3741382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010b470 msgr2=0x7f302019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f301ea00640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010b470 0x7f302019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f301ea00640 1 -- 172.21.15.1:0/3741382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302010bdc0 msgr2=0x7f30201a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:28.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f301ea00640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302010bdc0 0x7f30201a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f301ea00640 1 -- 172.21.15.1:0/3741382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201a23e0 con 0x7f3020105b30 2024-08-28T20:16:28.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f3016000640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010b470 0x7f302019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:28.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.060+0000 7f301ea00640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f302019c470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3010005940 tx=0x7f30100040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:28.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.061+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301003f030 con 0x7f3020105b30 2024-08-28T20:16:28.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.061+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30100044c0 con 0x7f3020105b30 2024-08-28T20:16:28.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.061+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30201a2670 con 0x7f3020105b30 2024-08-28T20:16:28.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.061+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010035070 con 0x7f3020105b30 2024-08-28T20:16:28.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.061+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30201a8e30 con 0x7f3020105b30 2024-08-28T20:16:28.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.062+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3020106db0 con 0x7f3020105b30 2024-08-28T20:16:28.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.066+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f3010042030 con 0x7f3020105b30 2024-08-28T20:16:28.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.067+0000 7f3017e00640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f30040b4bc0 0x7f30040b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:28.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.068+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f30101058b0 con 0x7f3020105b30 2024-08-28T20:16:28.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.068+0000 7f3016000640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f30040b4bc0 0x7f30040b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:28.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.068+0000 7f3016000640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f30040b4bc0 0x7f30040b70d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3020104e50 tx=0x7f3008005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:28.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.070+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30100cc220 con 0x7f3020105b30 2024-08-28T20:16:28.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.266+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30200635a0 con 0x7f30040b4bc0 2024-08-28T20:16:28.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.271+0000 7f3017e00640 1 -- 172.21.15.1:0/3741382 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258702 (secure 0 0 0) 0x7f30200635a0 con 0x7f30040b4bc0 2024-08-28T20:16:28.278 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:28.279 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-08-28T20:16:28.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f30040b4bc0 msgr2=0x7f30040b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:28.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f30040b4bc0 0x7f30040b70d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3020104e50 tx=0x7f3008005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:28.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 msgr2=0x7f302019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:28.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f302019c470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3010005940 tx=0x7f30100040c0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 shutdown_connections 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f30040b4bc0 0x7f30040b70d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f302010bdc0 0x7f30201a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f302010b470 0x7f302019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 --2- 172.21.15.1:0/3741382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3020105b30 0x7f302019c470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 >> 172.21.15.1:0/3741382 conn(0x7f3020101600 msgr2=0x7f302010ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 shutdown_connections 2024-08-28T20:16:28.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:28.276+0000 7f3025800640 1 -- 172.21.15.1:0/3741382 wait complete. 2024-08-28T20:16:29.201 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-08-28T20:16:28.168330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641794,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":276,"num_write_kb":2245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":2954152,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373572,"kb_used_data":11832,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568252,"statfs":{"total":1151940427776,"available":1151557890048,"internally_reserved":0,"allocated":12115968,"data_stored":6769650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39213,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":82,"num_write":23,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003756"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258561+0000","last_change":"2024-08-28T20:15:53.090200+0000","last_active":"2024-08-28T20:16:09.258561+0000","last_peered":"2024-08-28T20:16:09.258561+0000","last_clean":"2024-08-28T20:16:09.258561+0000","last_became_active":"2024-08-28T20:15:53.089819+0000","last_became_peered":"2024-08-28T20:15:53.089819+0000","last_unstale":"2024-08-28T20:16:09.258561+0000","last_undegraded":"2024-08-28T20:16:09.258561+0000","last_fullsized":"2024-08-28T20:16:09.258561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:24:35.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260865+0000","last_change":"2024-08-28T20:15:53.094139+0000","last_active":"2024-08-28T20:16:09.260865+0000","last_peered":"2024-08-28T20:16:09.260865+0000","last_clean":"2024-08-28T20:16:09.260865+0000","last_became_active":"2024-08-28T20:15:53.093920+0000","last_became_peered":"2024-08-28T20:15:53.093920+0000","last_unstale":"2024-08-28T20:16:09.260865+0000","last_undegraded":"2024-08-28T20:16:09.260865+0000","last_fullsized":"2024-08-28T20:16:09.260865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:50:00.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261007+0000","last_change":"2024-08-28T20:15:53.087364+0000","last_active":"2024-08-28T20:16:09.261007+0000","last_peered":"2024-08-28T20:16:09.261007+0000","last_clean":"2024-08-28T20:16:09.261007+0000","last_became_active":"2024-08-28T20:15:53.087030+0000","last_became_peered":"2024-08-28T20:15:53.087030+0000","last_unstale":"2024-08-28T20:16:09.261007+0000","last_undegraded":"2024-08-28T20:16:09.261007+0000","last_fullsized":"2024-08-28T20:16:09.261007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:27:40.000046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255390+0000","last_change":"2024-08-28T20:15:53.072409+0000","last_active":"2024-08-28T20:16:09.255390+0000","last_peered":"2024-08-28T20:16:09.255390+0000","last_clean":"2024-08-28T20:16:09.255390+0000","last_became_active":"2024-08-28T20:15:53.071946+0000","last_became_peered":"2024-08-28T20:15:53.071946+0000","last_unstale":"2024-08-28T20:16:09.255390+0000","last_undegraded":"2024-08-28T20:16:09.255390+0000","last_fullsized":"2024-08-28T20:16:09.255390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:14:07.246976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254046+0000","last_change":"2024-08-28T20:15:53.084238+0000","last_active":"2024-08-28T20:16:09.254046+0000","last_peered":"2024-08-28T20:16:09.254046+0000","last_clean":"2024-08-28T20:16:09.254046+0000","last_became_active":"2024-08-28T20:15:53.083835+0000","last_became_peered":"2024-08-28T20:15:53.083835+0000","last_unstale":"2024-08-28T20:16:09.254046+0000","last_undegraded":"2024-08-28T20:16:09.254046+0000","last_fullsized":"2024-08-28T20:16:09.254046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:50:19.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250676+0000","last_change":"2024-08-28T20:15:53.071186+0000","last_active":"2024-08-28T20:16:09.250676+0000","last_peered":"2024-08-28T20:16:09.250676+0000","last_clean":"2024-08-28T20:16:09.250676+0000","last_became_active":"2024-08-28T20:15:53.070764+0000","last_became_peered":"2024-08-28T20:15:53.070764+0000","last_unstale":"2024-08-28T20:16:09.250676+0000","last_undegraded":"2024-08-28T20:16:09.250676+0000","last_fullsized":"2024-08-28T20:16:09.250676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:21.079888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256210+0000","last_change":"2024-08-28T20:15:53.079022+0000","last_active":"2024-08-28T20:16:09.256210+0000","last_peered":"2024-08-28T20:16:09.256210+0000","last_clean":"2024-08-28T20:16:09.256210+0000","last_became_active":"2024-08-28T20:15:53.078618+0000","last_became_peered":"2024-08-28T20:15:53.078618+0000","last_unstale":"2024-08-28T20:16:09.256210+0000","last_undegraded":"2024-08-28T20:16:09.256210+0000","last_fullsized":"2024-08-28T20:16:09.256210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:49:09.296997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250232+0000","last_change":"2024-08-28T20:15:53.068898+0000","last_active":"2024-08-28T20:16:09.250232+0000","last_peered":"2024-08-28T20:16:09.250232+0000","last_clean":"2024-08-28T20:16:09.250232+0000","last_became_active":"2024-08-28T20:15:53.068578+0000","last_became_peered":"2024-08-28T20:15:53.068578+0000","last_unstale":"2024-08-28T20:16:09.250232+0000","last_undegraded":"2024-08-28T20:16:09.250232+0000","last_fullsized":"2024-08-28T20:16:09.250232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:53:30.220402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255901+0000","last_change":"2024-08-28T20:15:53.077445+0000","last_active":"2024-08-28T20:16:09.255901+0000","last_peered":"2024-08-28T20:16:09.255901+0000","last_clean":"2024-08-28T20:16:09.255901+0000","last_became_active":"2024-08-28T20:15:53.077060+0000","last_became_peered":"2024-08-28T20:15:53.077060+0000","last_unstale":"2024-08-28T20:16:09.255901+0000","last_undegraded":"2024-08-28T20:16:09.255901+0000","last_fullsized":"2024-08-28T20:16:09.255901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:52.441510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259634+0000","last_change":"2024-08-28T20:16:09.259500+0000","last_active":"2024-08-28T20:16:09.259634+0000","last_peered":"2024-08-28T20:16:09.259634+0000","last_clean":"2024-08-28T20:16:09.259634+0000","last_became_active":"2024-08-28T20:16:09.258797+0000","last_became_peered":"2024-08-28T20:16:09.258797+0000","last_unstale":"2024-08-28T20:16:09.259634+0000","last_undegraded":"2024-08-28T20:16:09.259634+0000","last_fullsized":"2024-08-28T20:16:09.259634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:08.497860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256722+0000","last_change":"2024-08-28T20:15:53.080978+0000","last_active":"2024-08-28T20:16:09.256722+0000","last_peered":"2024-08-28T20:16:09.256722+0000","last_clean":"2024-08-28T20:16:09.256722+0000","last_became_active":"2024-08-28T20:15:53.080608+0000","last_became_peered":"2024-08-28T20:15:53.080608+0000","last_unstale":"2024-08-28T20:16:09.256722+0000","last_undegraded":"2024-08-28T20:16:09.256722+0000","last_fullsized":"2024-08-28T20:16:09.256722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:18:03.005125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256938+0000","last_change":"2024-08-28T20:15:53.067312+0000","last_active":"2024-08-28T20:16:09.256938+0000","last_peered":"2024-08-28T20:16:09.256938+0000","last_clean":"2024-08-28T20:16:09.256938+0000","last_became_active":"2024-08-28T20:15:53.066802+0000","last_became_peered":"2024-08-28T20:15:53.066802+0000","last_unstale":"2024-08-28T20:16:09.256938+0000","last_undegraded":"2024-08-28T20:16:09.256938+0000","last_fullsized":"2024-08-28T20:16:09.256938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:27:28.079309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253418+0000","last_change":"2024-08-28T20:15:53.077877+0000","last_active":"2024-08-28T20:16:09.253418+0000","last_peered":"2024-08-28T20:16:09.253418+0000","last_clean":"2024-08-28T20:16:09.253418+0000","last_became_active":"2024-08-28T20:15:53.077374+0000","last_became_peered":"2024-08-28T20:15:53.077374+0000","last_unstale":"2024-08-28T20:16:09.253418+0000","last_undegraded":"2024-08-28T20:16:09.253418+0000","last_fullsized":"2024-08-28T20:16:09.253418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:27:34.692183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260489+0000","last_change":"2024-08-28T20:15:53.090043+0000","last_active":"2024-08-28T20:16:09.260489+0000","last_peered":"2024-08-28T20:16:09.260489+0000","last_clean":"2024-08-28T20:16:09.260489+0000","last_became_active":"2024-08-28T20:15:53.089693+0000","last_became_peered":"2024-08-28T20:15:53.089693+0000","last_unstale":"2024-08-28T20:16:09.260489+0000","last_undegraded":"2024-08-28T20:16:09.260489+0000","last_fullsized":"2024-08-28T20:16:09.260489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:04:10.505280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259563+0000","last_change":"2024-08-28T20:15:53.090981+0000","last_active":"2024-08-28T20:16:09.259563+0000","last_peered":"2024-08-28T20:16:09.259563+0000","last_clean":"2024-08-28T20:16:09.259563+0000","last_became_active":"2024-08-28T20:15:53.087896+0000","last_became_peered":"2024-08-28T20:15:53.087896+0000","last_unstale":"2024-08-28T20:16:09.259563+0000","last_undegraded":"2024-08-28T20:16:09.259563+0000","last_fullsized":"2024-08-28T20:16:09.259563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:35.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254797+0000","last_change":"2024-08-28T20:15:53.090219+0000","last_active":"2024-08-28T20:16:09.254797+0000","last_peered":"2024-08-28T20:16:09.254797+0000","last_clean":"2024-08-28T20:16:09.254797+0000","last_became_active":"2024-08-28T20:15:53.089683+0000","last_became_peered":"2024-08-28T20:15:53.089683+0000","last_unstale":"2024-08-28T20:16:09.254797+0000","last_undegraded":"2024-08-28T20:16:09.254797+0000","last_fullsized":"2024-08-28T20:16:09.254797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:12:04.413154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258615+0000","last_change":"2024-08-28T20:15:53.091256+0000","last_active":"2024-08-28T20:16:09.258615+0000","last_peered":"2024-08-28T20:16:09.258615+0000","last_clean":"2024-08-28T20:16:09.258615+0000","last_became_active":"2024-08-28T20:15:53.090869+0000","last_became_peered":"2024-08-28T20:15:53.090869+0000","last_unstale":"2024-08-28T20:16:09.258615+0000","last_undegraded":"2024-08-28T20:16:09.258615+0000","last_fullsized":"2024-08-28T20:16:09.258615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:35:49.475470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255033+0000","last_change":"2024-08-28T20:15:53.077695+0000","last_active":"2024-08-28T20:16:09.255033+0000","last_peered":"2024-08-28T20:16:09.255033+0000","last_clean":"2024-08-28T20:16:09.255033+0000","last_became_active":"2024-08-28T20:15:53.077243+0000","last_became_peered":"2024-08-28T20:15:53.077243+0000","last_unstale":"2024-08-28T20:16:09.255033+0000","last_undegraded":"2024-08-28T20:16:09.255033+0000","last_fullsized":"2024-08-28T20:16:09.255033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:09:37.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254063+0000","last_change":"2024-08-28T20:15:53.095662+0000","last_active":"2024-08-28T20:16:09.254063+0000","last_peered":"2024-08-28T20:16:09.254063+0000","last_clean":"2024-08-28T20:16:09.254063+0000","last_became_active":"2024-08-28T20:15:53.095211+0000","last_became_peered":"2024-08-28T20:15:53.095211+0000","last_unstale":"2024-08-28T20:16:09.254063+0000","last_undegraded":"2024-08-28T20:16:09.254063+0000","last_fullsized":"2024-08-28T20:16:09.254063+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:58.137756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258204+0000","last_change":"2024-08-28T20:15:53.076938+0000","last_active":"2024-08-28T20:16:09.258204+0000","last_peered":"2024-08-28T20:16:09.258204+0000","last_clean":"2024-08-28T20:16:09.258204+0000","last_became_active":"2024-08-28T20:15:53.076445+0000","last_became_peered":"2024-08-28T20:15:53.076445+0000","last_unstale":"2024-08-28T20:16:09.258204+0000","last_undegraded":"2024-08-28T20:16:09.258204+0000","last_fullsized":"2024-08-28T20:16:09.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:13:53.477053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253506+0000","last_change":"2024-08-28T20:15:53.094262+0000","last_active":"2024-08-28T20:16:09.253506+0000","last_peered":"2024-08-28T20:16:09.253506+0000","last_clean":"2024-08-28T20:16:09.253506+0000","last_became_active":"2024-08-28T20:15:53.093927+0000","last_became_peered":"2024-08-28T20:15:53.093927+0000","last_unstale":"2024-08-28T20:16:09.253506+0000","last_undegraded":"2024-08-28T20:16:09.253506+0000","last_fullsized":"2024-08-28T20:16:09.253506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:04:46.586527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255159+0000","last_change":"2024-08-28T20:15:53.081244+0000","last_active":"2024-08-28T20:16:09.255159+0000","last_peered":"2024-08-28T20:16:09.255159+0000","last_clean":"2024-08-28T20:16:09.255159+0000","last_became_active":"2024-08-28T20:15:53.080813+0000","last_became_peered":"2024-08-28T20:15:53.080813+0000","last_unstale":"2024-08-28T20:16:09.255159+0000","last_undegraded":"2024-08-28T20:16:09.255159+0000","last_fullsized":"2024-08-28T20:16:09.255159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:31.052514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250252+0000","last_change":"2024-08-28T20:15:53.084469+0000","last_active":"2024-08-28T20:16:09.250252+0000","last_peered":"2024-08-28T20:16:09.250252+0000","last_clean":"2024-08-28T20:16:09.250252+0000","last_became_active":"2024-08-28T20:15:53.083815+0000","last_became_peered":"2024-08-28T20:15:53.083815+0000","last_unstale":"2024-08-28T20:16:09.250252+0000","last_undegraded":"2024-08-28T20:16:09.250252+0000","last_fullsized":"2024-08-28T20:16:09.250252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:36.615505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251099+0000","last_change":"2024-08-28T20:15:53.063396+0000","last_active":"2024-08-28T20:16:09.251099+0000","last_peered":"2024-08-28T20:16:09.251099+0000","last_clean":"2024-08-28T20:16:09.251099+0000","last_became_active":"2024-08-28T20:15:53.062970+0000","last_became_peered":"2024-08-28T20:15:53.062970+0000","last_unstale":"2024-08-28T20:16:09.251099+0000","last_undegraded":"2024-08-28T20:16:09.251099+0000","last_fullsized":"2024-08-28T20:16:09.251099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:50:44.559623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250848+0000","last_change":"2024-08-28T20:15:53.085787+0000","last_active":"2024-08-28T20:16:09.250848+0000","last_peered":"2024-08-28T20:16:09.250848+0000","last_clean":"2024-08-28T20:16:09.250848+0000","last_became_active":"2024-08-28T20:15:53.085449+0000","last_became_peered":"2024-08-28T20:15:53.085449+0000","last_unstale":"2024-08-28T20:16:09.250848+0000","last_undegraded":"2024-08-28T20:16:09.250848+0000","last_fullsized":"2024-08-28T20:16:09.250848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:00:35.687940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254477+0000","last_change":"2024-08-28T20:15:53.079482+0000","last_active":"2024-08-28T20:16:09.254477+0000","last_peered":"2024-08-28T20:16:09.254477+0000","last_clean":"2024-08-28T20:16:09.254477+0000","last_became_active":"2024-08-28T20:15:53.079046+0000","last_became_peered":"2024-08-28T20:15:53.079046+0000","last_unstale":"2024-08-28T20:16:09.254477+0000","last_undegraded":"2024-08-28T20:16:09.254477+0000","last_fullsized":"2024-08-28T20:16:09.254477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:51:50.026095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258263+0000","last_change":"2024-08-28T20:15:53.075651+0000","last_active":"2024-08-28T20:16:09.258263+0000","last_peered":"2024-08-28T20:16:09.258263+0000","last_clean":"2024-08-28T20:16:09.258263+0000","last_became_active":"2024-08-28T20:15:53.075231+0000","last_became_peered":"2024-08-28T20:15:53.075231+0000","last_unstale":"2024-08-28T20:16:09.258263+0000","last_undegraded":"2024-08-28T20:16:09.258263+0000","last_fullsized":"2024-08-28T20:16:09.258263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:50.828987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253693+0000","last_change":"2024-08-28T20:15:53.097623+0000","last_active":"2024-08-28T20:16:09.253693+0000","last_peered":"2024-08-28T20:16:09.253693+0000","last_clean":"2024-08-28T20:16:09.253693+0000","last_became_active":"2024-08-28T20:15:53.095633+0000","last_became_peered":"2024-08-28T20:15:53.095633+0000","last_unstale":"2024-08-28T20:16:09.253693+0000","last_undegraded":"2024-08-28T20:16:09.253693+0000","last_fullsized":"2024-08-28T20:16:09.253693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:05.559906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260644+0000","last_change":"2024-08-28T20:15:53.078030+0000","last_active":"2024-08-28T20:16:09.260644+0000","last_peered":"2024-08-28T20:16:09.260644+0000","last_clean":"2024-08-28T20:16:09.260644+0000","last_became_active":"2024-08-28T20:15:53.076535+0000","last_became_peered":"2024-08-28T20:15:53.076535+0000","last_unstale":"2024-08-28T20:16:09.260644+0000","last_undegraded":"2024-08-28T20:16:09.260644+0000","last_fullsized":"2024-08-28T20:16:09.260644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:33:07.028039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253467+0000","last_change":"2024-08-28T20:15:53.096481+0000","last_active":"2024-08-28T20:16:09.253467+0000","last_peered":"2024-08-28T20:16:09.253467+0000","last_clean":"2024-08-28T20:16:09.253467+0000","last_became_active":"2024-08-28T20:15:53.096098+0000","last_became_peered":"2024-08-28T20:15:53.096098+0000","last_unstale":"2024-08-28T20:16:09.253467+0000","last_undegraded":"2024-08-28T20:16:09.253467+0000","last_fullsized":"2024-08-28T20:16:09.253467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:31:35.450650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254251+0000","last_change":"2024-08-28T20:15:53.070940+0000","last_active":"2024-08-28T20:16:09.254251+0000","last_peered":"2024-08-28T20:16:09.254251+0000","last_clean":"2024-08-28T20:16:09.254251+0000","last_became_active":"2024-08-28T20:15:53.070559+0000","last_became_peered":"2024-08-28T20:15:53.070559+0000","last_unstale":"2024-08-28T20:16:09.254251+0000","last_undegraded":"2024-08-28T20:16:09.254251+0000","last_fullsized":"2024-08-28T20:16:09.254251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:04:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257928+0000","last_change":"2024-08-28T20:15:53.071293+0000","last_active":"2024-08-28T20:16:09.257928+0000","last_peered":"2024-08-28T20:16:09.257928+0000","last_clean":"2024-08-28T20:16:09.257928+0000","last_became_active":"2024-08-28T20:15:53.070937+0000","last_became_peered":"2024-08-28T20:15:53.070937+0000","last_unstale":"2024-08-28T20:16:09.257928+0000","last_undegraded":"2024-08-28T20:16:09.257928+0000","last_fullsized":"2024-08-28T20:16:09.257928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:20:03.463030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254102+0000","last_change":"2024-08-28T20:15:53.080834+0000","last_active":"2024-08-28T20:16:09.254102+0000","last_peered":"2024-08-28T20:16:09.254102+0000","last_clean":"2024-08-28T20:16:09.254102+0000","last_became_active":"2024-08-28T20:15:53.080446+0000","last_became_peered":"2024-08-28T20:15:53.080446+0000","last_unstale":"2024-08-28T20:16:09.254102+0000","last_undegraded":"2024-08-28T20:16:09.254102+0000","last_fullsized":"2024-08-28T20:16:09.254102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:30:31.404656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":55,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:25.295322+0000","last_change":"2024-08-28T20:15:50.038701+0000","last_active":"2024-08-28T20:16:25.295322+0000","last_peered":"2024-08-28T20:16:25.295322+0000","last_clean":"2024-08-28T20:16:25.295322+0000","last_became_active":"2024-08-28T20:15:50.038383+0000","last_became_peered":"2024-08-28T20:15:50.038383+0000","last_unstale":"2024-08-28T20:16:25.295322+0000","last_undegraded":"2024-08-28T20:16:25.295322+0000","last_fullsized":"2024-08-28T20:16:25.295322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:20:03.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251526+0000","last_change":"2024-08-28T20:15:53.058433+0000","last_active":"2024-08-28T20:16:09.251526+0000","last_peered":"2024-08-28T20:16:09.251526+0000","last_clean":"2024-08-28T20:16:09.251526+0000","last_became_active":"2024-08-28T20:15:53.058088+0000","last_became_peered":"2024-08-28T20:15:53.058088+0000","last_unstale":"2024-08-28T20:16:09.251526+0000","last_undegraded":"2024-08-28T20:16:09.251526+0000","last_fullsized":"2024-08-28T20:16:09.251526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:58:10.507808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.264327+0000","last_change":"2024-08-28T20:16:09.264205+0000","last_active":"2024-08-28T20:16:09.264327+0000","last_peered":"2024-08-28T20:16:09.264327+0000","last_clean":"2024-08-28T20:16:09.264327+0000","last_became_active":"2024-08-28T20:16:09.257407+0000","last_became_peered":"2024-08-28T20:16:09.257407+0000","last_unstale":"2024-08-28T20:16:09.264327+0000","last_undegraded":"2024-08-28T20:16:09.264327+0000","last_fullsized":"2024-08-28T20:16:09.264327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:57:44.507993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252938+0000","last_change":"2024-08-28T20:15:50.038447+0000","last_active":"2024-08-28T20:16:09.252938+0000","last_peered":"2024-08-28T20:16:09.252938+0000","last_clean":"2024-08-28T20:16:09.252938+0000","last_became_active":"2024-08-28T20:15:50.037428+0000","last_became_peered":"2024-08-28T20:15:50.037428+0000","last_unstale":"2024-08-28T20:16:09.252938+0000","last_undegraded":"2024-08-28T20:16:09.252938+0000","last_fullsized":"2024-08-28T20:16:09.252938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:31:36.805904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250318+0000","last_change":"2024-08-28T20:15:53.086731+0000","last_active":"2024-08-28T20:16:09.250318+0000","last_peered":"2024-08-28T20:16:09.250318+0000","last_clean":"2024-08-28T20:16:09.250318+0000","last_became_active":"2024-08-28T20:15:53.086300+0000","last_became_peered":"2024-08-28T20:15:53.086300+0000","last_unstale":"2024-08-28T20:16:09.250318+0000","last_undegraded":"2024-08-28T20:16:09.250318+0000","last_fullsized":"2024-08-28T20:16:09.250318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:33:30.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251493+0000","last_change":"2024-08-28T20:15:50.037252+0000","last_active":"2024-08-28T20:16:09.251493+0000","last_peered":"2024-08-28T20:16:09.251493+0000","last_clean":"2024-08-28T20:16:09.251493+0000","last_became_active":"2024-08-28T20:15:50.036778+0000","last_became_peered":"2024-08-28T20:15:50.036778+0000","last_unstale":"2024-08-28T20:16:09.251493+0000","last_undegraded":"2024-08-28T20:16:09.251493+0000","last_fullsized":"2024-08-28T20:16:09.251493+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:11:16.685741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254245+0000","last_change":"2024-08-28T20:15:53.070510+0000","last_active":"2024-08-28T20:16:09.254245+0000","last_peered":"2024-08-28T20:16:09.254245+0000","last_clean":"2024-08-28T20:16:09.254245+0000","last_became_active":"2024-08-28T20:15:53.070006+0000","last_became_peered":"2024-08-28T20:15:53.070006+0000","last_unstale":"2024-08-28T20:16:09.254245+0000","last_undegraded":"2024-08-28T20:16:09.254245+0000","last_fullsized":"2024-08-28T20:16:09.254245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:06.081692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":46,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:22.290032+0000","last_change":"2024-08-28T20:15:50.036777+0000","last_active":"2024-08-28T20:16:22.290032+0000","last_peered":"2024-08-28T20:16:22.290032+0000","last_clean":"2024-08-28T20:16:22.290032+0000","last_became_active":"2024-08-28T20:15:50.036329+0000","last_became_peered":"2024-08-28T20:15:50.036329+0000","last_unstale":"2024-08-28T20:16:22.290032+0000","last_undegraded":"2024-08-28T20:16:22.290032+0000","last_fullsized":"2024-08-28T20:16:22.290032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:58:06.285314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255588+0000","last_change":"2024-08-28T20:15:53.077888+0000","last_active":"2024-08-28T20:16:09.255588+0000","last_peered":"2024-08-28T20:16:09.255588+0000","last_clean":"2024-08-28T20:16:09.255588+0000","last_became_active":"2024-08-28T20:15:53.074925+0000","last_became_peered":"2024-08-28T20:15:53.074925+0000","last_unstale":"2024-08-28T20:16:09.255588+0000","last_undegraded":"2024-08-28T20:16:09.255588+0000","last_fullsized":"2024-08-28T20:16:09.255588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:18:59.262238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256613+0000","last_change":"2024-08-28T20:15:50.038654+0000","last_active":"2024-08-28T20:16:09.256613+0000","last_peered":"2024-08-28T20:16:09.256613+0000","last_clean":"2024-08-28T20:16:09.256613+0000","last_became_active":"2024-08-28T20:15:50.038208+0000","last_became_peered":"2024-08-28T20:15:50.038208+0000","last_unstale":"2024-08-28T20:16:09.256613+0000","last_undegraded":"2024-08-28T20:16:09.256613+0000","last_fullsized":"2024-08-28T20:16:09.256613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:20.845229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259937+0000","last_change":"2024-08-28T20:15:53.085682+0000","last_active":"2024-08-28T20:16:09.259937+0000","last_peered":"2024-08-28T20:16:09.259937+0000","last_clean":"2024-08-28T20:16:09.259937+0000","last_became_active":"2024-08-28T20:15:53.085312+0000","last_became_peered":"2024-08-28T20:15:53.085312+0000","last_unstale":"2024-08-28T20:16:09.259937+0000","last_undegraded":"2024-08-28T20:16:09.259937+0000","last_fullsized":"2024-08-28T20:16:09.259937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:36:21.112522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251741+0000","last_change":"2024-08-28T20:15:50.194955+0000","last_active":"2024-08-28T20:16:09.251741+0000","last_peered":"2024-08-28T20:16:09.251741+0000","last_clean":"2024-08-28T20:16:09.251741+0000","last_became_active":"2024-08-28T20:15:50.194473+0000","last_became_peered":"2024-08-28T20:15:50.194473+0000","last_unstale":"2024-08-28T20:16:09.251741+0000","last_undegraded":"2024-08-28T20:16:09.251741+0000","last_fullsized":"2024-08-28T20:16:09.251741+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:29:21.702692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255283+0000","last_change":"2024-08-28T20:15:53.075495+0000","last_active":"2024-08-28T20:16:09.255283+0000","last_peered":"2024-08-28T20:16:09.255283+0000","last_clean":"2024-08-28T20:16:09.255283+0000","last_became_active":"2024-08-28T20:15:53.071017+0000","last_became_peered":"2024-08-28T20:15:53.071017+0000","last_unstale":"2024-08-28T20:16:09.255283+0000","last_undegraded":"2024-08-28T20:16:09.255283+0000","last_fullsized":"2024-08-28T20:16:09.255283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:20:17.809878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'22","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:23.291552+0000","last_change":"2024-08-28T20:16:09.288268+0000","last_active":"2024-08-28T20:16:23.291552+0000","last_peered":"2024-08-28T20:16:23.291552+0000","last_clean":"2024-08-28T20:16:23.291552+0000","last_became_active":"2024-08-28T20:16:09.259977+0000","last_became_peered":"2024-08-28T20:16:09.259977+0000","last_unstale":"2024-08-28T20:16:23.291552+0000","last_undegraded":"2024-08-28T20:16:23.291552+0000","last_fullsized":"2024-08-28T20:16:23.291552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:10:36.700199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":63,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255423+0000","last_change":"2024-08-28T20:15:53.073649+0000","last_active":"2024-08-28T20:16:09.255423+0000","last_peered":"2024-08-28T20:16:09.255423+0000","last_clean":"2024-08-28T20:16:09.255423+0000","last_became_active":"2024-08-28T20:15:53.073314+0000","last_became_peered":"2024-08-28T20:15:53.073314+0000","last_unstale":"2024-08-28T20:16:09.255423+0000","last_undegraded":"2024-08-28T20:16:09.255423+0000","last_fullsized":"2024-08-28T20:16:09.255423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:12.160611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254043+0000","last_change":"2024-08-28T20:15:50.038301+0000","last_active":"2024-08-28T20:16:09.254043+0000","last_peered":"2024-08-28T20:16:09.254043+0000","last_clean":"2024-08-28T20:16:09.254043+0000","last_became_active":"2024-08-28T20:15:50.037068+0000","last_became_peered":"2024-08-28T20:15:50.037068+0000","last_unstale":"2024-08-28T20:16:09.254043+0000","last_undegraded":"2024-08-28T20:16:09.254043+0000","last_fullsized":"2024-08-28T20:16:09.254043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:55:55.874707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252981+0000","last_change":"2024-08-28T20:15:53.085561+0000","last_active":"2024-08-28T20:16:09.252981+0000","last_peered":"2024-08-28T20:16:09.252981+0000","last_clean":"2024-08-28T20:16:09.252981+0000","last_became_active":"2024-08-28T20:15:53.085184+0000","last_became_peered":"2024-08-28T20:15:53.085184+0000","last_unstale":"2024-08-28T20:16:09.252981+0000","last_undegraded":"2024-08-28T20:16:09.252981+0000","last_fullsized":"2024-08-28T20:16:09.252981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:19:29.992874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251181+0000","last_change":"2024-08-28T20:15:50.040070+0000","last_active":"2024-08-28T20:16:09.251181+0000","last_peered":"2024-08-28T20:16:09.251181+0000","last_clean":"2024-08-28T20:16:09.251181+0000","last_became_active":"2024-08-28T20:15:50.039613+0000","last_became_peered":"2024-08-28T20:15:50.039613+0000","last_unstale":"2024-08-28T20:16:09.251181+0000","last_undegraded":"2024-08-28T20:16:09.251181+0000","last_fullsized":"2024-08-28T20:16:09.251181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:58:55.014173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.263222+0000","last_change":"2024-08-28T20:16:09.263069+0000","last_active":"2024-08-28T20:16:09.263222+0000","last_peered":"2024-08-28T20:16:09.263222+0000","last_clean":"2024-08-28T20:16:09.263222+0000","last_became_active":"2024-08-28T20:16:09.262112+0000","last_became_peered":"2024-08-28T20:16:09.262112+0000","last_unstale":"2024-08-28T20:16:09.263222+0000","last_undegraded":"2024-08-28T20:16:09.263222+0000","last_fullsized":"2024-08-28T20:16:09.263222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:48.595659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:22.290533+0000","last_change":"2024-08-28T20:16:09.268467+0000","last_active":"2024-08-28T20:16:22.290533+0000","last_peered":"2024-08-28T20:16:22.290533+0000","last_clean":"2024-08-28T20:16:22.290533+0000","last_became_active":"2024-08-28T20:16:09.262061+0000","last_became_peered":"2024-08-28T20:16:09.262061+0000","last_unstale":"2024-08-28T20:16:22.290533+0000","last_undegraded":"2024-08-28T20:16:22.290533+0000","last_fullsized":"2024-08-28T20:16:22.290533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:24:13.257421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255761+0000","last_change":"2024-08-28T20:15:53.079473+0000","last_active":"2024-08-28T20:16:09.255761+0000","last_peered":"2024-08-28T20:16:09.255761+0000","last_clean":"2024-08-28T20:16:09.255761+0000","last_became_active":"2024-08-28T20:15:53.079103+0000","last_became_peered":"2024-08-28T20:15:53.079103+0000","last_unstale":"2024-08-28T20:16:09.255761+0000","last_undegraded":"2024-08-28T20:16:09.255761+0000","last_fullsized":"2024-08-28T20:16:09.255761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:43:59.476622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.283415+0000","last_change":"2024-08-28T20:16:09.282923+0000","last_active":"2024-08-28T20:16:09.283415+0000","last_peered":"2024-08-28T20:16:09.283415+0000","last_clean":"2024-08-28T20:16:09.283415+0000","last_became_active":"2024-08-28T20:16:09.262506+0000","last_became_peered":"2024-08-28T20:16:09.262506+0000","last_unstale":"2024-08-28T20:16:09.283415+0000","last_undegraded":"2024-08-28T20:16:09.283415+0000","last_fullsized":"2024-08-28T20:16:09.283415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:37:49.969128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,4],"acting":[11,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260986+0000","last_change":"2024-08-28T20:16:09.260875+0000","last_active":"2024-08-28T20:16:09.260986+0000","last_peered":"2024-08-28T20:16:09.260986+0000","last_clean":"2024-08-28T20:16:09.260986+0000","last_became_active":"2024-08-28T20:16:09.260450+0000","last_became_peered":"2024-08-28T20:16:09.260450+0000","last_unstale":"2024-08-28T20:16:09.260986+0000","last_undegraded":"2024-08-28T20:16:09.260986+0000","last_fullsized":"2024-08-28T20:16:09.260986+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:12:15.671882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255671+0000","last_change":"2024-08-28T20:15:50.032115+0000","last_active":"2024-08-28T20:16:09.255671+0000","last_peered":"2024-08-28T20:16:09.255671+0000","last_clean":"2024-08-28T20:16:09.255671+0000","last_became_active":"2024-08-28T20:15:50.031743+0000","last_became_peered":"2024-08-28T20:15:50.031743+0000","last_unstale":"2024-08-28T20:16:09.255671+0000","last_undegraded":"2024-08-28T20:16:09.255671+0000","last_fullsized":"2024-08-28T20:16:09.255671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:48.764221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257991+0000","last_change":"2024-08-28T20:15:53.072928+0000","last_active":"2024-08-28T20:16:09.257991+0000","last_peered":"2024-08-28T20:16:09.257991+0000","last_clean":"2024-08-28T20:16:09.257991+0000","last_became_active":"2024-08-28T20:15:53.072550+0000","last_became_peered":"2024-08-28T20:15:53.072550+0000","last_unstale":"2024-08-28T20:16:09.257991+0000","last_undegraded":"2024-08-28T20:16:09.257991+0000","last_fullsized":"2024-08-28T20:16:09.257991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:02.518088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254273+0000","last_change":"2024-08-28T20:15:50.037322+0000","last_active":"2024-08-28T20:16:09.254273+0000","last_peered":"2024-08-28T20:16:09.254273+0000","last_clean":"2024-08-28T20:16:09.254273+0000","last_became_active":"2024-08-28T20:15:50.036886+0000","last_became_peered":"2024-08-28T20:15:50.036886+0000","last_unstale":"2024-08-28T20:16:09.254273+0000","last_undegraded":"2024-08-28T20:16:09.254273+0000","last_fullsized":"2024-08-28T20:16:09.254273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:27:33.370255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256787+0000","last_change":"2024-08-28T20:15:53.070188+0000","last_active":"2024-08-28T20:16:09.256787+0000","last_peered":"2024-08-28T20:16:09.256787+0000","last_clean":"2024-08-28T20:16:09.256787+0000","last_became_active":"2024-08-28T20:15:53.069576+0000","last_became_peered":"2024-08-28T20:15:53.069576+0000","last_unstale":"2024-08-28T20:16:09.256787+0000","last_undegraded":"2024-08-28T20:16:09.256787+0000","last_fullsized":"2024-08-28T20:16:09.256787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:40.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251992+0000","last_change":"2024-08-28T20:15:50.037700+0000","last_active":"2024-08-28T20:16:09.251992+0000","last_peered":"2024-08-28T20:16:09.251992+0000","last_clean":"2024-08-28T20:16:09.251992+0000","last_became_active":"2024-08-28T20:15:50.037114+0000","last_became_peered":"2024-08-28T20:15:50.037114+0000","last_unstale":"2024-08-28T20:16:09.251992+0000","last_undegraded":"2024-08-28T20:16:09.251992+0000","last_fullsized":"2024-08-28T20:16:09.251992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:18:04.478513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256616+0000","last_change":"2024-08-28T20:15:53.080964+0000","last_active":"2024-08-28T20:16:09.256616+0000","last_peered":"2024-08-28T20:16:09.256616+0000","last_clean":"2024-08-28T20:16:09.256616+0000","last_became_active":"2024-08-28T20:15:53.080575+0000","last_became_peered":"2024-08-28T20:15:53.080575+0000","last_unstale":"2024-08-28T20:16:09.256616+0000","last_undegraded":"2024-08-28T20:16:09.256616+0000","last_fullsized":"2024-08-28T20:16:09.256616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:27:22.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255568+0000","last_change":"2024-08-28T20:15:50.195346+0000","last_active":"2024-08-28T20:16:09.255568+0000","last_peered":"2024-08-28T20:16:09.255568+0000","last_clean":"2024-08-28T20:16:09.255568+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255568+0000","last_undegraded":"2024-08-28T20:16:09.255568+0000","last_fullsized":"2024-08-28T20:16:09.255568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:57.094246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256860+0000","last_change":"2024-08-28T20:15:53.081887+0000","last_active":"2024-08-28T20:16:09.256860+0000","last_peered":"2024-08-28T20:16:09.256860+0000","last_clean":"2024-08-28T20:16:09.256860+0000","last_became_active":"2024-08-28T20:15:53.081468+0000","last_became_peered":"2024-08-28T20:15:53.081468+0000","last_unstale":"2024-08-28T20:16:09.256860+0000","last_undegraded":"2024-08-28T20:16:09.256860+0000","last_fullsized":"2024-08-28T20:16:09.256860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:36:56.711342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256111+0000","last_change":"2024-08-28T20:14:34.441400+0000","last_active":"2024-08-28T20:16:09.256111+0000","last_peered":"2024-08-28T20:16:09.256111+0000","last_clean":"2024-08-28T20:16:09.256111+0000","last_became_active":"2024-08-28T20:14:34.435613+0000","last_became_peered":"2024-08-28T20:14:34.435613+0000","last_unstale":"2024-08-28T20:16:09.256111+0000","last_undegraded":"2024-08-28T20:16:09.256111+0000","last_fullsized":"2024-08-28T20:16:09.256111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_clean_scrub_stamp":"2024-08-28T20:11:05.289764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:44:58.327028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256253+0000","last_change":"2024-08-28T20:15:50.034574+0000","last_active":"2024-08-28T20:16:09.256253+0000","last_peered":"2024-08-28T20:16:09.256253+0000","last_clean":"2024-08-28T20:16:09.256253+0000","last_became_active":"2024-08-28T20:15:50.034191+0000","last_became_peered":"2024-08-28T20:15:50.034191+0000","last_unstale":"2024-08-28T20:16:09.256253+0000","last_undegraded":"2024-08-28T20:16:09.256253+0000","last_fullsized":"2024-08-28T20:16:09.256253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:02:17.165360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250475+0000","last_change":"2024-08-28T20:15:53.079974+0000","last_active":"2024-08-28T20:16:09.250475+0000","last_peered":"2024-08-28T20:16:09.250475+0000","last_clean":"2024-08-28T20:16:09.250475+0000","last_became_active":"2024-08-28T20:15:53.079263+0000","last_became_peered":"2024-08-28T20:15:53.079263+0000","last_unstale":"2024-08-28T20:16:09.250475+0000","last_undegraded":"2024-08-28T20:16:09.250475+0000","last_fullsized":"2024-08-28T20:16:09.250475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:06:09.158005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255980+0000","last_change":"2024-08-28T20:15:50.032856+0000","last_active":"2024-08-28T20:16:09.255980+0000","last_peered":"2024-08-28T20:16:09.255980+0000","last_clean":"2024-08-28T20:16:09.255980+0000","last_became_active":"2024-08-28T20:15:50.032378+0000","last_became_peered":"2024-08-28T20:15:50.032378+0000","last_unstale":"2024-08-28T20:16:09.255980+0000","last_undegraded":"2024-08-28T20:16:09.255980+0000","last_fullsized":"2024-08-28T20:16:09.255980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:10:43.559574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252851+0000","last_change":"2024-08-28T20:15:53.082998+0000","last_active":"2024-08-28T20:16:09.252851+0000","last_peered":"2024-08-28T20:16:09.252851+0000","last_clean":"2024-08-28T20:16:09.252851+0000","last_became_active":"2024-08-28T20:15:53.082579+0000","last_became_peered":"2024-08-28T20:15:53.082579+0000","last_unstale":"2024-08-28T20:16:09.252851+0000","last_undegraded":"2024-08-28T20:16:09.252851+0000","last_fullsized":"2024-08-28T20:16:09.252851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:56:31.892013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:26.296040+0000","last_change":"2024-08-28T20:15:50.195181+0000","last_active":"2024-08-28T20:16:26.296040+0000","last_peered":"2024-08-28T20:16:26.296040+0000","last_clean":"2024-08-28T20:16:26.296040+0000","last_became_active":"2024-08-28T20:15:50.194233+0000","last_became_peered":"2024-08-28T20:15:50.194233+0000","last_unstale":"2024-08-28T20:16:26.296040+0000","last_undegraded":"2024-08-28T20:16:26.296040+0000","last_fullsized":"2024-08-28T20:16:26.296040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:10:18.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251255+0000","last_change":"2024-08-28T20:15:53.065425+0000","last_active":"2024-08-28T20:16:09.251255+0000","last_peered":"2024-08-28T20:16:09.251255+0000","last_clean":"2024-08-28T20:16:09.251255+0000","last_became_active":"2024-08-28T20:15:53.065021+0000","last_became_peered":"2024-08-28T20:15:53.065021+0000","last_unstale":"2024-08-28T20:16:09.251255+0000","last_undegraded":"2024-08-28T20:16:09.251255+0000","last_fullsized":"2024-08-28T20:16:09.251255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:40.792120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256421+0000","last_change":"2024-08-28T20:15:50.038730+0000","last_active":"2024-08-28T20:16:09.256421+0000","last_peered":"2024-08-28T20:16:09.256421+0000","last_clean":"2024-08-28T20:16:09.256421+0000","last_became_active":"2024-08-28T20:15:50.036791+0000","last_became_peered":"2024-08-28T20:15:50.036791+0000","last_unstale":"2024-08-28T20:16:09.256421+0000","last_undegraded":"2024-08-28T20:16:09.256421+0000","last_fullsized":"2024-08-28T20:16:09.256421+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:18:51.484781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250942+0000","last_change":"2024-08-28T20:15:53.087092+0000","last_active":"2024-08-28T20:16:09.250942+0000","last_peered":"2024-08-28T20:16:09.250942+0000","last_clean":"2024-08-28T20:16:09.250942+0000","last_became_active":"2024-08-28T20:15:53.086614+0000","last_became_peered":"2024-08-28T20:15:53.086614+0000","last_unstale":"2024-08-28T20:16:09.250942+0000","last_undegraded":"2024-08-28T20:16:09.250942+0000","last_fullsized":"2024-08-28T20:16:09.250942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:47:00.962576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254705+0000","last_change":"2024-08-28T20:15:50.194838+0000","last_active":"2024-08-28T20:16:09.254705+0000","last_peered":"2024-08-28T20:16:09.254705+0000","last_clean":"2024-08-28T20:16:09.254705+0000","last_became_active":"2024-08-28T20:15:50.194378+0000","last_became_peered":"2024-08-28T20:15:50.194378+0000","last_unstale":"2024-08-28T20:16:09.254705+0000","last_undegraded":"2024-08-28T20:16:09.254705+0000","last_fullsized":"2024-08-28T20:16:09.254705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:53:56.395001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250871+0000","last_change":"2024-08-28T20:15:53.089721+0000","last_active":"2024-08-28T20:16:09.250871+0000","last_peered":"2024-08-28T20:16:09.250871+0000","last_clean":"2024-08-28T20:16:09.250871+0000","last_became_active":"2024-08-28T20:15:53.089240+0000","last_became_peered":"2024-08-28T20:15:53.089240+0000","last_unstale":"2024-08-28T20:16:09.250871+0000","last_undegraded":"2024-08-28T20:16:09.250871+0000","last_fullsized":"2024-08-28T20:16:09.250871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:55.859753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255661+0000","last_change":"2024-08-28T20:15:50.195290+0000","last_active":"2024-08-28T20:16:09.255661+0000","last_peered":"2024-08-28T20:16:09.255661+0000","last_clean":"2024-08-28T20:16:09.255661+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255661+0000","last_undegraded":"2024-08-28T20:16:09.255661+0000","last_fullsized":"2024-08-28T20:16:09.255661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:44.915047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253801+0000","last_change":"2024-08-28T20:15:53.079572+0000","last_active":"2024-08-28T20:16:09.253801+0000","last_peered":"2024-08-28T20:16:09.253801+0000","last_clean":"2024-08-28T20:16:09.253801+0000","last_became_active":"2024-08-28T20:15:53.074745+0000","last_became_peered":"2024-08-28T20:15:53.074745+0000","last_unstale":"2024-08-28T20:16:09.253801+0000","last_undegraded":"2024-08-28T20:16:09.253801+0000","last_fullsized":"2024-08-28T20:16:09.253801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:44.989383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'8","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:21.079745+0000","last_change":"2024-08-28T20:15:50.040420+0000","last_active":"2024-08-28T20:16:21.079745+0000","last_peered":"2024-08-28T20:16:21.079745+0000","last_clean":"2024-08-28T20:16:21.079745+0000","last_became_active":"2024-08-28T20:15:50.039932+0000","last_became_peered":"2024-08-28T20:15:50.039932+0000","last_unstale":"2024-08-28T20:16:21.079745+0000","last_undegraded":"2024-08-28T20:16:21.079745+0000","last_fullsized":"2024-08-28T20:16:21.079745+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:13.062974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250922+0000","last_change":"2024-08-28T20:15:53.073177+0000","last_active":"2024-08-28T20:16:09.250922+0000","last_peered":"2024-08-28T20:16:09.250922+0000","last_clean":"2024-08-28T20:16:09.250922+0000","last_became_active":"2024-08-28T20:15:53.072323+0000","last_became_peered":"2024-08-28T20:15:53.072323+0000","last_unstale":"2024-08-28T20:16:09.250922+0000","last_undegraded":"2024-08-28T20:16:09.250922+0000","last_fullsized":"2024-08-28T20:16:09.250922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:18:43.672990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253954+0000","last_change":"2024-08-28T20:15:50.114223+0000","last_active":"2024-08-28T20:16:09.253954+0000","last_peered":"2024-08-28T20:16:09.253954+0000","last_clean":"2024-08-28T20:16:09.253954+0000","last_became_active":"2024-08-28T20:15:50.113798+0000","last_became_peered":"2024-08-28T20:15:50.113798+0000","last_unstale":"2024-08-28T20:16:09.253954+0000","last_undegraded":"2024-08-28T20:16:09.253954+0000","last_fullsized":"2024-08-28T20:16:09.253954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:24:56.354493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261002+0000","last_change":"2024-08-28T20:15:53.097744+0000","last_active":"2024-08-28T20:16:09.261002+0000","last_peered":"2024-08-28T20:16:09.261002+0000","last_clean":"2024-08-28T20:16:09.261002+0000","last_became_active":"2024-08-28T20:15:53.096093+0000","last_became_peered":"2024-08-28T20:15:53.096093+0000","last_unstale":"2024-08-28T20:16:09.261002+0000","last_undegraded":"2024-08-28T20:16:09.261002+0000","last_fullsized":"2024-08-28T20:16:09.261002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:40:36.650309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254952+0000","last_change":"2024-08-28T20:15:50.194574+0000","last_active":"2024-08-28T20:16:09.254952+0000","last_peered":"2024-08-28T20:16:09.254952+0000","last_clean":"2024-08-28T20:16:09.254952+0000","last_became_active":"2024-08-28T20:15:50.194174+0000","last_became_peered":"2024-08-28T20:15:50.194174+0000","last_unstale":"2024-08-28T20:16:09.254952+0000","last_undegraded":"2024-08-28T20:16:09.254952+0000","last_fullsized":"2024-08-28T20:16:09.254952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:07:30.795200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253928+0000","last_change":"2024-08-28T20:15:53.074015+0000","last_active":"2024-08-28T20:16:09.253928+0000","last_peered":"2024-08-28T20:16:09.253928+0000","last_clean":"2024-08-28T20:16:09.253928+0000","last_became_active":"2024-08-28T20:15:53.073641+0000","last_became_peered":"2024-08-28T20:15:53.073641+0000","last_unstale":"2024-08-28T20:16:09.253928+0000","last_undegraded":"2024-08-28T20:16:09.253928+0000","last_fullsized":"2024-08-28T20:16:09.253928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:55.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250392+0000","last_change":"2024-08-28T20:15:50.038105+0000","last_active":"2024-08-28T20:16:09.250392+0000","last_peered":"2024-08-28T20:16:09.250392+0000","last_clean":"2024-08-28T20:16:09.250392+0000","last_became_active":"2024-08-28T20:15:50.037721+0000","last_became_peered":"2024-08-28T20:15:50.037721+0000","last_unstale":"2024-08-28T20:16:09.250392+0000","last_undegraded":"2024-08-28T20:16:09.250392+0000","last_fullsized":"2024-08-28T20:16:09.250392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:24:58.941095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258053+0000","last_change":"2024-08-28T20:15:53.090160+0000","last_active":"2024-08-28T20:16:09.258053+0000","last_peered":"2024-08-28T20:16:09.258053+0000","last_clean":"2024-08-28T20:16:09.258053+0000","last_became_active":"2024-08-28T20:15:53.089739+0000","last_became_peered":"2024-08-28T20:15:53.089739+0000","last_unstale":"2024-08-28T20:16:09.258053+0000","last_undegraded":"2024-08-28T20:16:09.258053+0000","last_fullsized":"2024-08-28T20:16:09.258053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:51:32.384124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253620+0000","last_change":"2024-08-28T20:15:50.036817+0000","last_active":"2024-08-28T20:16:09.253620+0000","last_peered":"2024-08-28T20:16:09.253620+0000","last_clean":"2024-08-28T20:16:09.253620+0000","last_became_active":"2024-08-28T20:15:50.036425+0000","last_became_peered":"2024-08-28T20:15:50.036425+0000","last_unstale":"2024-08-28T20:16:09.253620+0000","last_undegraded":"2024-08-28T20:16:09.253620+0000","last_fullsized":"2024-08-28T20:16:09.253620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:16:59.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250559+0000","last_change":"2024-08-28T20:15:53.090616+0000","last_active":"2024-08-28T20:16:09.250559+0000","last_peered":"2024-08-28T20:16:09.250559+0000","last_clean":"2024-08-28T20:16:09.250559+0000","last_became_active":"2024-08-28T20:15:53.089204+0000","last_became_peered":"2024-08-28T20:15:53.089204+0000","last_unstale":"2024-08-28T20:16:09.250559+0000","last_undegraded":"2024-08-28T20:16:09.250559+0000","last_fullsized":"2024-08-28T20:16:09.250559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:24:39.423756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":45,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.269132+0000","last_change":"2024-08-28T20:16:09.268949+0000","last_active":"2024-08-28T20:16:09.269132+0000","last_peered":"2024-08-28T20:16:09.269132+0000","last_clean":"2024-08-28T20:16:09.269132+0000","last_became_active":"2024-08-28T20:16:09.258665+0000","last_became_peered":"2024-08-28T20:16:09.258665+0000","last_unstale":"2024-08-28T20:16:09.269132+0000","last_undegraded":"2024-08-28T20:16:09.269132+0000","last_fullsized":"2024-08-28T20:16:09.269132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:43:11.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256137+0000","last_change":"2024-08-28T20:15:53.075853+0000","last_active":"2024-08-28T20:16:09.256137+0000","last_peered":"2024-08-28T20:16:09.256137+0000","last_clean":"2024-08-28T20:16:09.256137+0000","last_became_active":"2024-08-28T20:15:53.075429+0000","last_became_peered":"2024-08-28T20:15:53.075429+0000","last_unstale":"2024-08-28T20:16:09.256137+0000","last_undegraded":"2024-08-28T20:16:09.256137+0000","last_fullsized":"2024-08-28T20:16:09.256137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:09.301878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257135+0000","last_change":"2024-08-28T20:16:09.256999+0000","last_active":"2024-08-28T20:16:09.257135+0000","last_peered":"2024-08-28T20:16:09.257135+0000","last_clean":"2024-08-28T20:16:09.257135+0000","last_became_active":"2024-08-28T20:16:09.256508+0000","last_became_peered":"2024-08-28T20:16:09.256508+0000","last_unstale":"2024-08-28T20:16:09.257135+0000","last_undegraded":"2024-08-28T20:16:09.257135+0000","last_fullsized":"2024-08-28T20:16:09.257135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T08:08:23.494703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254657+0000","last_change":"2024-08-28T20:15:50.040047+0000","last_active":"2024-08-28T20:16:09.254657+0000","last_peered":"2024-08-28T20:16:09.254657+0000","last_clean":"2024-08-28T20:16:09.254657+0000","last_became_active":"2024-08-28T20:15:50.039656+0000","last_became_peered":"2024-08-28T20:15:50.039656+0000","last_unstale":"2024-08-28T20:16:09.254657+0000","last_undegraded":"2024-08-28T20:16:09.254657+0000","last_fullsized":"2024-08-28T20:16:09.254657+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:13:30.986352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255216+0000","last_change":"2024-08-28T20:15:53.076441+0000","last_active":"2024-08-28T20:16:09.255216+0000","last_peered":"2024-08-28T20:16:09.255216+0000","last_clean":"2024-08-28T20:16:09.255216+0000","last_became_active":"2024-08-28T20:15:53.076091+0000","last_became_peered":"2024-08-28T20:15:53.076091+0000","last_unstale":"2024-08-28T20:16:09.255216+0000","last_undegraded":"2024-08-28T20:16:09.255216+0000","last_fullsized":"2024-08-28T20:16:09.255216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:45:13.500267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255533+0000","last_change":"2024-08-28T20:15:50.034114+0000","last_active":"2024-08-28T20:16:09.255533+0000","last_peered":"2024-08-28T20:16:09.255533+0000","last_clean":"2024-08-28T20:16:09.255533+0000","last_became_active":"2024-08-28T20:15:50.033681+0000","last_became_peered":"2024-08-28T20:15:50.033681+0000","last_unstale":"2024-08-28T20:16:09.255533+0000","last_undegraded":"2024-08-28T20:16:09.255533+0000","last_fullsized":"2024-08-28T20:16:09.255533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:06:09.372632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260281+0000","last_change":"2024-08-28T20:15:53.088870+0000","last_active":"2024-08-28T20:16:09.260281+0000","last_peered":"2024-08-28T20:16:09.260281+0000","last_clean":"2024-08-28T20:16:09.260281+0000","last_became_active":"2024-08-28T20:15:53.088536+0000","last_became_peered":"2024-08-28T20:15:53.088536+0000","last_unstale":"2024-08-28T20:16:09.260281+0000","last_undegraded":"2024-08-28T20:16:09.260281+0000","last_fullsized":"2024-08-28T20:16:09.260281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:20:28.927016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250862+0000","last_change":"2024-08-28T20:15:50.194803+0000","last_active":"2024-08-28T20:16:09.250862+0000","last_peered":"2024-08-28T20:16:09.250862+0000","last_clean":"2024-08-28T20:16:09.250862+0000","last_became_active":"2024-08-28T20:15:50.194351+0000","last_became_peered":"2024-08-28T20:15:50.194351+0000","last_unstale":"2024-08-28T20:16:09.250862+0000","last_undegraded":"2024-08-28T20:16:09.250862+0000","last_fullsized":"2024-08-28T20:16:09.250862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:44:14.751785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250705+0000","last_change":"2024-08-28T20:15:53.083914+0000","last_active":"2024-08-28T20:16:09.250705+0000","last_peered":"2024-08-28T20:16:09.250705+0000","last_clean":"2024-08-28T20:16:09.250705+0000","last_became_active":"2024-08-28T20:15:53.081282+0000","last_became_peered":"2024-08-28T20:15:53.081282+0000","last_unstale":"2024-08-28T20:16:09.250705+0000","last_undegraded":"2024-08-28T20:16:09.250705+0000","last_fullsized":"2024-08-28T20:16:09.250705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:21.373284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255271+0000","last_change":"2024-08-28T20:15:50.034299+0000","last_active":"2024-08-28T20:16:09.255271+0000","last_peered":"2024-08-28T20:16:09.255271+0000","last_clean":"2024-08-28T20:16:09.255271+0000","last_became_active":"2024-08-28T20:15:50.033858+0000","last_became_peered":"2024-08-28T20:15:50.033858+0000","last_unstale":"2024-08-28T20:16:09.255271+0000","last_undegraded":"2024-08-28T20:16:09.255271+0000","last_fullsized":"2024-08-28T20:16:09.255271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:38:41.264067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51192,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":151,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2312,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":153576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841556,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":405362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005081,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1042943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168606,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":404507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364834,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":404315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528360,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36748,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708404,"statfs":{"total":95995035648,"available":95957405696,"internally_reserved":0,"allocated":1437696,"data_stored":995769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":403896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855410,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":996041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":451636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":404207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":843776,"data_stored":405318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":450489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":405167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":47947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T20:16:29.205 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T20:16:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:29 smithi001 ceph-mon[20984]: pgmap v316: 97 pgs: 97 active+clean; 627 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-08-28T20:16:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:29 smithi001 ceph-mon[20984]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:16:29.584 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:29 smithi121 ceph-mon[25248]: pgmap v316: 97 pgs: 97 active+clean; 627 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-08-28T20:16:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:29 smithi121 ceph-mon[25248]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:16:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:29 smithi007 ceph-mon[25357]: pgmap v316: 97 pgs: 97 active+clean; 627 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-08-28T20:16:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:29 smithi007 ceph-mon[25357]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:16:30.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 -- 172.21.15.1:0/142488877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 msgr2=0x7f2c50103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 --2- 172.21.15.1:0/142488877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 0x7f2c50103d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009900 tx=0x7f2c4402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 -- 172.21.15.1:0/142488877 shutdown_connections 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 --2- 172.21.15.1:0/142488877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c501103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 --2- 172.21.15.1:0/142488877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c50109240 0x7f2c50109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 --2- 172.21.15.1:0/142488877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 0x7f2c50103d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 -- 172.21.15.1:0/142488877 >> 172.21.15.1:0/142488877 conn(0x7f2c5007b5f0 msgr2=0x7f2c5007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 -- 172.21.15.1:0/142488877 shutdown_connections 2024-08-28T20:16:30.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.191+0000 7f2c58800640 1 -- 172.21.15.1:0/142488877 wait complete. 2024-08-28T20:16:30.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.192+0000 7f2c58800640 1 Processor -- start 2024-08-28T20:16:30.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.192+0000 7f2c58800640 1 -- start start 2024-08-28T20:16:30.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c58800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 0x7f2c5019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:30.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c58800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c50109240 0x7f2c5019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:30.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c58800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c5019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:30.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c58800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501138a0 con 0x7f2c50103900 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c58800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50113720 con 0x7f2c50109b90 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c58800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50113a20 con 0x7f2c50109240 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c56800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c5019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c56800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c5019fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55650/0 (socket says 172.21.15.1:55650) 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c56800640 1 -- 172.21.15.1:0/2703124092 learned_addr learned my addr 172.21.15.1:0/2703124092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c55400640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c50109240 0x7f2c5019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c55e00640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 0x7f2c5019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:30.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c56800640 1 -- 172.21.15.1:0/2703124092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c50109240 msgr2=0x7f2c5019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.193+0000 7f2c56800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c50109240 0x7f2c5019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.194+0000 7f2c56800640 1 -- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 msgr2=0x7f2c5019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.194+0000 7f2c56800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 0x7f2c5019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.194+0000 7f2c56800640 1 -- 172.21.15.1:0/2703124092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c501a00c0 con 0x7f2c50109b90 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.194+0000 7f2c56800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c5019fa50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00eaa0 tx=0x7f2c4c00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.195+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004d20 con 0x7f2c50109b90 2024-08-28T20:16:30.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.195+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c501a03b0 con 0x7f2c50109b90 2024-08-28T20:16:30.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.195+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c005020 con 0x7f2c50109b90 2024-08-28T20:16:30.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.195+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0116b0 con 0x7f2c50109b90 2024-08-28T20:16:30.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.195+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c501a6bd0 con 0x7f2c50109b90 2024-08-28T20:16:30.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.196+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c50103d10 con 0x7f2c50109b90 2024-08-28T20:16:30.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.198+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f2c4c0051d0 con 0x7f2c50109b90 2024-08-28T20:16:30.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.200+0000 7f2c4aa00640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2c380b4c70 0x7f2c380b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:30.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.200+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2c4c0e5830 con 0x7f2c50109b90 2024-08-28T20:16:30.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.200+0000 7f2c55e00640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2c380b4c70 0x7f2c380b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:30.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.201+0000 7f2c55e00640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2c380b4c70 0x7f2c380b7180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c44005ab0 tx=0x7f2c44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:30.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.201+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c4c016030 con 0x7f2c50109b90 2024-08-28T20:16:30.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.394+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c500635a0 con 0x7f2c380b4c70 2024-08-28T20:16:30.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.400+0000 7f2c4aa00640 1 -- 172.21.15.1:0/2703124092 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258706 (secure 0 0 0) 0x7f2c500635a0 con 0x7f2c380b4c70 2024-08-28T20:16:30.405 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:30.406 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-08-28T20:16:30.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2c380b4c70 msgr2=0x7f2c380b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:30.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2c380b4c70 0x7f2c380b7180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c44005ab0 tx=0x7f2c44005a20 comp rx=0 tx=0).stop 2024-08-28T20:16:30.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 msgr2=0x7f2c5019fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:30.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c5019fa50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00eaa0 tx=0x7f2c4c00eea0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 shutdown_connections 2024-08-28T20:16:30.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2c380b4c70 0x7f2c380b7180 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c50109b90 0x7f2c5019fa50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c50109240 0x7f2c5019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 --2- 172.21.15.1:0/2703124092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c50103900 0x7f2c5019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:30.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 >> 172.21.15.1:0/2703124092 conn(0x7f2c5007b5f0 msgr2=0x7f2c50107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:30.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 shutdown_connections 2024-08-28T20:16:30.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:30.405+0000 7f2c58800640 1 -- 172.21.15.1:0/2703124092 wait complete. 2024-08-28T20:16:31.219 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-08-28T20:16:30.168832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649946,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":222,"num_read_kb":200,"num_write":285,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":2954152,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373588,"kb_used_data":11848,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568236,"statfs":{"total":1151940427776,"available":1151557873664,"internally_reserved":0,"allocated":12132352,"data_stored":6785954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46974,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":94,"num_write":31,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003478"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258561+0000","last_change":"2024-08-28T20:15:53.090200+0000","last_active":"2024-08-28T20:16:09.258561+0000","last_peered":"2024-08-28T20:16:09.258561+0000","last_clean":"2024-08-28T20:16:09.258561+0000","last_became_active":"2024-08-28T20:15:53.089819+0000","last_became_peered":"2024-08-28T20:15:53.089819+0000","last_unstale":"2024-08-28T20:16:09.258561+0000","last_undegraded":"2024-08-28T20:16:09.258561+0000","last_fullsized":"2024-08-28T20:16:09.258561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:24:35.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260865+0000","last_change":"2024-08-28T20:15:53.094139+0000","last_active":"2024-08-28T20:16:09.260865+0000","last_peered":"2024-08-28T20:16:09.260865+0000","last_clean":"2024-08-28T20:16:09.260865+0000","last_became_active":"2024-08-28T20:15:53.093920+0000","last_became_peered":"2024-08-28T20:15:53.093920+0000","last_unstale":"2024-08-28T20:16:09.260865+0000","last_undegraded":"2024-08-28T20:16:09.260865+0000","last_fullsized":"2024-08-28T20:16:09.260865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:50:00.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261007+0000","last_change":"2024-08-28T20:15:53.087364+0000","last_active":"2024-08-28T20:16:09.261007+0000","last_peered":"2024-08-28T20:16:09.261007+0000","last_clean":"2024-08-28T20:16:09.261007+0000","last_became_active":"2024-08-28T20:15:53.087030+0000","last_became_peered":"2024-08-28T20:15:53.087030+0000","last_unstale":"2024-08-28T20:16:09.261007+0000","last_undegraded":"2024-08-28T20:16:09.261007+0000","last_fullsized":"2024-08-28T20:16:09.261007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:27:40.000046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255390+0000","last_change":"2024-08-28T20:15:53.072409+0000","last_active":"2024-08-28T20:16:09.255390+0000","last_peered":"2024-08-28T20:16:09.255390+0000","last_clean":"2024-08-28T20:16:09.255390+0000","last_became_active":"2024-08-28T20:15:53.071946+0000","last_became_peered":"2024-08-28T20:15:53.071946+0000","last_unstale":"2024-08-28T20:16:09.255390+0000","last_undegraded":"2024-08-28T20:16:09.255390+0000","last_fullsized":"2024-08-28T20:16:09.255390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:14:07.246976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254046+0000","last_change":"2024-08-28T20:15:53.084238+0000","last_active":"2024-08-28T20:16:09.254046+0000","last_peered":"2024-08-28T20:16:09.254046+0000","last_clean":"2024-08-28T20:16:09.254046+0000","last_became_active":"2024-08-28T20:15:53.083835+0000","last_became_peered":"2024-08-28T20:15:53.083835+0000","last_unstale":"2024-08-28T20:16:09.254046+0000","last_undegraded":"2024-08-28T20:16:09.254046+0000","last_fullsized":"2024-08-28T20:16:09.254046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:50:19.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250676+0000","last_change":"2024-08-28T20:15:53.071186+0000","last_active":"2024-08-28T20:16:09.250676+0000","last_peered":"2024-08-28T20:16:09.250676+0000","last_clean":"2024-08-28T20:16:09.250676+0000","last_became_active":"2024-08-28T20:15:53.070764+0000","last_became_peered":"2024-08-28T20:15:53.070764+0000","last_unstale":"2024-08-28T20:16:09.250676+0000","last_undegraded":"2024-08-28T20:16:09.250676+0000","last_fullsized":"2024-08-28T20:16:09.250676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:21.079888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256210+0000","last_change":"2024-08-28T20:15:53.079022+0000","last_active":"2024-08-28T20:16:09.256210+0000","last_peered":"2024-08-28T20:16:09.256210+0000","last_clean":"2024-08-28T20:16:09.256210+0000","last_became_active":"2024-08-28T20:15:53.078618+0000","last_became_peered":"2024-08-28T20:15:53.078618+0000","last_unstale":"2024-08-28T20:16:09.256210+0000","last_undegraded":"2024-08-28T20:16:09.256210+0000","last_fullsized":"2024-08-28T20:16:09.256210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:49:09.296997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250232+0000","last_change":"2024-08-28T20:15:53.068898+0000","last_active":"2024-08-28T20:16:09.250232+0000","last_peered":"2024-08-28T20:16:09.250232+0000","last_clean":"2024-08-28T20:16:09.250232+0000","last_became_active":"2024-08-28T20:15:53.068578+0000","last_became_peered":"2024-08-28T20:15:53.068578+0000","last_unstale":"2024-08-28T20:16:09.250232+0000","last_undegraded":"2024-08-28T20:16:09.250232+0000","last_fullsized":"2024-08-28T20:16:09.250232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:53:30.220402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255901+0000","last_change":"2024-08-28T20:15:53.077445+0000","last_active":"2024-08-28T20:16:09.255901+0000","last_peered":"2024-08-28T20:16:09.255901+0000","last_clean":"2024-08-28T20:16:09.255901+0000","last_became_active":"2024-08-28T20:15:53.077060+0000","last_became_peered":"2024-08-28T20:15:53.077060+0000","last_unstale":"2024-08-28T20:16:09.255901+0000","last_undegraded":"2024-08-28T20:16:09.255901+0000","last_fullsized":"2024-08-28T20:16:09.255901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:52.441510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259634+0000","last_change":"2024-08-28T20:16:09.259500+0000","last_active":"2024-08-28T20:16:09.259634+0000","last_peered":"2024-08-28T20:16:09.259634+0000","last_clean":"2024-08-28T20:16:09.259634+0000","last_became_active":"2024-08-28T20:16:09.258797+0000","last_became_peered":"2024-08-28T20:16:09.258797+0000","last_unstale":"2024-08-28T20:16:09.259634+0000","last_undegraded":"2024-08-28T20:16:09.259634+0000","last_fullsized":"2024-08-28T20:16:09.259634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:08.497860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256722+0000","last_change":"2024-08-28T20:15:53.080978+0000","last_active":"2024-08-28T20:16:09.256722+0000","last_peered":"2024-08-28T20:16:09.256722+0000","last_clean":"2024-08-28T20:16:09.256722+0000","last_became_active":"2024-08-28T20:15:53.080608+0000","last_became_peered":"2024-08-28T20:15:53.080608+0000","last_unstale":"2024-08-28T20:16:09.256722+0000","last_undegraded":"2024-08-28T20:16:09.256722+0000","last_fullsized":"2024-08-28T20:16:09.256722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:18:03.005125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256938+0000","last_change":"2024-08-28T20:15:53.067312+0000","last_active":"2024-08-28T20:16:09.256938+0000","last_peered":"2024-08-28T20:16:09.256938+0000","last_clean":"2024-08-28T20:16:09.256938+0000","last_became_active":"2024-08-28T20:15:53.066802+0000","last_became_peered":"2024-08-28T20:15:53.066802+0000","last_unstale":"2024-08-28T20:16:09.256938+0000","last_undegraded":"2024-08-28T20:16:09.256938+0000","last_fullsized":"2024-08-28T20:16:09.256938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:27:28.079309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253418+0000","last_change":"2024-08-28T20:15:53.077877+0000","last_active":"2024-08-28T20:16:09.253418+0000","last_peered":"2024-08-28T20:16:09.253418+0000","last_clean":"2024-08-28T20:16:09.253418+0000","last_became_active":"2024-08-28T20:15:53.077374+0000","last_became_peered":"2024-08-28T20:15:53.077374+0000","last_unstale":"2024-08-28T20:16:09.253418+0000","last_undegraded":"2024-08-28T20:16:09.253418+0000","last_fullsized":"2024-08-28T20:16:09.253418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:27:34.692183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260489+0000","last_change":"2024-08-28T20:15:53.090043+0000","last_active":"2024-08-28T20:16:09.260489+0000","last_peered":"2024-08-28T20:16:09.260489+0000","last_clean":"2024-08-28T20:16:09.260489+0000","last_became_active":"2024-08-28T20:15:53.089693+0000","last_became_peered":"2024-08-28T20:15:53.089693+0000","last_unstale":"2024-08-28T20:16:09.260489+0000","last_undegraded":"2024-08-28T20:16:09.260489+0000","last_fullsized":"2024-08-28T20:16:09.260489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:04:10.505280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259563+0000","last_change":"2024-08-28T20:15:53.090981+0000","last_active":"2024-08-28T20:16:09.259563+0000","last_peered":"2024-08-28T20:16:09.259563+0000","last_clean":"2024-08-28T20:16:09.259563+0000","last_became_active":"2024-08-28T20:15:53.087896+0000","last_became_peered":"2024-08-28T20:15:53.087896+0000","last_unstale":"2024-08-28T20:16:09.259563+0000","last_undegraded":"2024-08-28T20:16:09.259563+0000","last_fullsized":"2024-08-28T20:16:09.259563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:35.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254797+0000","last_change":"2024-08-28T20:15:53.090219+0000","last_active":"2024-08-28T20:16:09.254797+0000","last_peered":"2024-08-28T20:16:09.254797+0000","last_clean":"2024-08-28T20:16:09.254797+0000","last_became_active":"2024-08-28T20:15:53.089683+0000","last_became_peered":"2024-08-28T20:15:53.089683+0000","last_unstale":"2024-08-28T20:16:09.254797+0000","last_undegraded":"2024-08-28T20:16:09.254797+0000","last_fullsized":"2024-08-28T20:16:09.254797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:12:04.413154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258615+0000","last_change":"2024-08-28T20:15:53.091256+0000","last_active":"2024-08-28T20:16:09.258615+0000","last_peered":"2024-08-28T20:16:09.258615+0000","last_clean":"2024-08-28T20:16:09.258615+0000","last_became_active":"2024-08-28T20:15:53.090869+0000","last_became_peered":"2024-08-28T20:15:53.090869+0000","last_unstale":"2024-08-28T20:16:09.258615+0000","last_undegraded":"2024-08-28T20:16:09.258615+0000","last_fullsized":"2024-08-28T20:16:09.258615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:35:49.475470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255033+0000","last_change":"2024-08-28T20:15:53.077695+0000","last_active":"2024-08-28T20:16:09.255033+0000","last_peered":"2024-08-28T20:16:09.255033+0000","last_clean":"2024-08-28T20:16:09.255033+0000","last_became_active":"2024-08-28T20:15:53.077243+0000","last_became_peered":"2024-08-28T20:15:53.077243+0000","last_unstale":"2024-08-28T20:16:09.255033+0000","last_undegraded":"2024-08-28T20:16:09.255033+0000","last_fullsized":"2024-08-28T20:16:09.255033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:09:37.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254063+0000","last_change":"2024-08-28T20:15:53.095662+0000","last_active":"2024-08-28T20:16:09.254063+0000","last_peered":"2024-08-28T20:16:09.254063+0000","last_clean":"2024-08-28T20:16:09.254063+0000","last_became_active":"2024-08-28T20:15:53.095211+0000","last_became_peered":"2024-08-28T20:15:53.095211+0000","last_unstale":"2024-08-28T20:16:09.254063+0000","last_undegraded":"2024-08-28T20:16:09.254063+0000","last_fullsized":"2024-08-28T20:16:09.254063+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:58.137756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258204+0000","last_change":"2024-08-28T20:15:53.076938+0000","last_active":"2024-08-28T20:16:09.258204+0000","last_peered":"2024-08-28T20:16:09.258204+0000","last_clean":"2024-08-28T20:16:09.258204+0000","last_became_active":"2024-08-28T20:15:53.076445+0000","last_became_peered":"2024-08-28T20:15:53.076445+0000","last_unstale":"2024-08-28T20:16:09.258204+0000","last_undegraded":"2024-08-28T20:16:09.258204+0000","last_fullsized":"2024-08-28T20:16:09.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:13:53.477053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253506+0000","last_change":"2024-08-28T20:15:53.094262+0000","last_active":"2024-08-28T20:16:09.253506+0000","last_peered":"2024-08-28T20:16:09.253506+0000","last_clean":"2024-08-28T20:16:09.253506+0000","last_became_active":"2024-08-28T20:15:53.093927+0000","last_became_peered":"2024-08-28T20:15:53.093927+0000","last_unstale":"2024-08-28T20:16:09.253506+0000","last_undegraded":"2024-08-28T20:16:09.253506+0000","last_fullsized":"2024-08-28T20:16:09.253506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:04:46.586527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255159+0000","last_change":"2024-08-28T20:15:53.081244+0000","last_active":"2024-08-28T20:16:09.255159+0000","last_peered":"2024-08-28T20:16:09.255159+0000","last_clean":"2024-08-28T20:16:09.255159+0000","last_became_active":"2024-08-28T20:15:53.080813+0000","last_became_peered":"2024-08-28T20:15:53.080813+0000","last_unstale":"2024-08-28T20:16:09.255159+0000","last_undegraded":"2024-08-28T20:16:09.255159+0000","last_fullsized":"2024-08-28T20:16:09.255159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:31.052514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250252+0000","last_change":"2024-08-28T20:15:53.084469+0000","last_active":"2024-08-28T20:16:09.250252+0000","last_peered":"2024-08-28T20:16:09.250252+0000","last_clean":"2024-08-28T20:16:09.250252+0000","last_became_active":"2024-08-28T20:15:53.083815+0000","last_became_peered":"2024-08-28T20:15:53.083815+0000","last_unstale":"2024-08-28T20:16:09.250252+0000","last_undegraded":"2024-08-28T20:16:09.250252+0000","last_fullsized":"2024-08-28T20:16:09.250252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:36.615505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251099+0000","last_change":"2024-08-28T20:15:53.063396+0000","last_active":"2024-08-28T20:16:09.251099+0000","last_peered":"2024-08-28T20:16:09.251099+0000","last_clean":"2024-08-28T20:16:09.251099+0000","last_became_active":"2024-08-28T20:15:53.062970+0000","last_became_peered":"2024-08-28T20:15:53.062970+0000","last_unstale":"2024-08-28T20:16:09.251099+0000","last_undegraded":"2024-08-28T20:16:09.251099+0000","last_fullsized":"2024-08-28T20:16:09.251099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:50:44.559623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250848+0000","last_change":"2024-08-28T20:15:53.085787+0000","last_active":"2024-08-28T20:16:09.250848+0000","last_peered":"2024-08-28T20:16:09.250848+0000","last_clean":"2024-08-28T20:16:09.250848+0000","last_became_active":"2024-08-28T20:15:53.085449+0000","last_became_peered":"2024-08-28T20:15:53.085449+0000","last_unstale":"2024-08-28T20:16:09.250848+0000","last_undegraded":"2024-08-28T20:16:09.250848+0000","last_fullsized":"2024-08-28T20:16:09.250848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:00:35.687940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254477+0000","last_change":"2024-08-28T20:15:53.079482+0000","last_active":"2024-08-28T20:16:09.254477+0000","last_peered":"2024-08-28T20:16:09.254477+0000","last_clean":"2024-08-28T20:16:09.254477+0000","last_became_active":"2024-08-28T20:15:53.079046+0000","last_became_peered":"2024-08-28T20:15:53.079046+0000","last_unstale":"2024-08-28T20:16:09.254477+0000","last_undegraded":"2024-08-28T20:16:09.254477+0000","last_fullsized":"2024-08-28T20:16:09.254477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:51:50.026095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258263+0000","last_change":"2024-08-28T20:15:53.075651+0000","last_active":"2024-08-28T20:16:09.258263+0000","last_peered":"2024-08-28T20:16:09.258263+0000","last_clean":"2024-08-28T20:16:09.258263+0000","last_became_active":"2024-08-28T20:15:53.075231+0000","last_became_peered":"2024-08-28T20:15:53.075231+0000","last_unstale":"2024-08-28T20:16:09.258263+0000","last_undegraded":"2024-08-28T20:16:09.258263+0000","last_fullsized":"2024-08-28T20:16:09.258263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:50.828987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253693+0000","last_change":"2024-08-28T20:15:53.097623+0000","last_active":"2024-08-28T20:16:09.253693+0000","last_peered":"2024-08-28T20:16:09.253693+0000","last_clean":"2024-08-28T20:16:09.253693+0000","last_became_active":"2024-08-28T20:15:53.095633+0000","last_became_peered":"2024-08-28T20:15:53.095633+0000","last_unstale":"2024-08-28T20:16:09.253693+0000","last_undegraded":"2024-08-28T20:16:09.253693+0000","last_fullsized":"2024-08-28T20:16:09.253693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:05.559906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260644+0000","last_change":"2024-08-28T20:15:53.078030+0000","last_active":"2024-08-28T20:16:09.260644+0000","last_peered":"2024-08-28T20:16:09.260644+0000","last_clean":"2024-08-28T20:16:09.260644+0000","last_became_active":"2024-08-28T20:15:53.076535+0000","last_became_peered":"2024-08-28T20:15:53.076535+0000","last_unstale":"2024-08-28T20:16:09.260644+0000","last_undegraded":"2024-08-28T20:16:09.260644+0000","last_fullsized":"2024-08-28T20:16:09.260644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:33:07.028039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253467+0000","last_change":"2024-08-28T20:15:53.096481+0000","last_active":"2024-08-28T20:16:09.253467+0000","last_peered":"2024-08-28T20:16:09.253467+0000","last_clean":"2024-08-28T20:16:09.253467+0000","last_became_active":"2024-08-28T20:15:53.096098+0000","last_became_peered":"2024-08-28T20:15:53.096098+0000","last_unstale":"2024-08-28T20:16:09.253467+0000","last_undegraded":"2024-08-28T20:16:09.253467+0000","last_fullsized":"2024-08-28T20:16:09.253467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:31:35.450650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254251+0000","last_change":"2024-08-28T20:15:53.070940+0000","last_active":"2024-08-28T20:16:09.254251+0000","last_peered":"2024-08-28T20:16:09.254251+0000","last_clean":"2024-08-28T20:16:09.254251+0000","last_became_active":"2024-08-28T20:15:53.070559+0000","last_became_peered":"2024-08-28T20:15:53.070559+0000","last_unstale":"2024-08-28T20:16:09.254251+0000","last_undegraded":"2024-08-28T20:16:09.254251+0000","last_fullsized":"2024-08-28T20:16:09.254251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:04:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257928+0000","last_change":"2024-08-28T20:15:53.071293+0000","last_active":"2024-08-28T20:16:09.257928+0000","last_peered":"2024-08-28T20:16:09.257928+0000","last_clean":"2024-08-28T20:16:09.257928+0000","last_became_active":"2024-08-28T20:15:53.070937+0000","last_became_peered":"2024-08-28T20:15:53.070937+0000","last_unstale":"2024-08-28T20:16:09.257928+0000","last_undegraded":"2024-08-28T20:16:09.257928+0000","last_fullsized":"2024-08-28T20:16:09.257928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:20:03.463030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254102+0000","last_change":"2024-08-28T20:15:53.080834+0000","last_active":"2024-08-28T20:16:09.254102+0000","last_peered":"2024-08-28T20:16:09.254102+0000","last_clean":"2024-08-28T20:16:09.254102+0000","last_became_active":"2024-08-28T20:15:53.080446+0000","last_became_peered":"2024-08-28T20:15:53.080446+0000","last_unstale":"2024-08-28T20:16:09.254102+0000","last_undegraded":"2024-08-28T20:16:09.254102+0000","last_fullsized":"2024-08-28T20:16:09.254102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:30:31.404656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":55,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:25.295322+0000","last_change":"2024-08-28T20:15:50.038701+0000","last_active":"2024-08-28T20:16:25.295322+0000","last_peered":"2024-08-28T20:16:25.295322+0000","last_clean":"2024-08-28T20:16:25.295322+0000","last_became_active":"2024-08-28T20:15:50.038383+0000","last_became_peered":"2024-08-28T20:15:50.038383+0000","last_unstale":"2024-08-28T20:16:25.295322+0000","last_undegraded":"2024-08-28T20:16:25.295322+0000","last_fullsized":"2024-08-28T20:16:25.295322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:20:03.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251526+0000","last_change":"2024-08-28T20:15:53.058433+0000","last_active":"2024-08-28T20:16:09.251526+0000","last_peered":"2024-08-28T20:16:09.251526+0000","last_clean":"2024-08-28T20:16:09.251526+0000","last_became_active":"2024-08-28T20:15:53.058088+0000","last_became_peered":"2024-08-28T20:15:53.058088+0000","last_unstale":"2024-08-28T20:16:09.251526+0000","last_undegraded":"2024-08-28T20:16:09.251526+0000","last_fullsized":"2024-08-28T20:16:09.251526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:58:10.507808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.264327+0000","last_change":"2024-08-28T20:16:09.264205+0000","last_active":"2024-08-28T20:16:09.264327+0000","last_peered":"2024-08-28T20:16:09.264327+0000","last_clean":"2024-08-28T20:16:09.264327+0000","last_became_active":"2024-08-28T20:16:09.257407+0000","last_became_peered":"2024-08-28T20:16:09.257407+0000","last_unstale":"2024-08-28T20:16:09.264327+0000","last_undegraded":"2024-08-28T20:16:09.264327+0000","last_fullsized":"2024-08-28T20:16:09.264327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:57:44.507993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252938+0000","last_change":"2024-08-28T20:15:50.038447+0000","last_active":"2024-08-28T20:16:09.252938+0000","last_peered":"2024-08-28T20:16:09.252938+0000","last_clean":"2024-08-28T20:16:09.252938+0000","last_became_active":"2024-08-28T20:15:50.037428+0000","last_became_peered":"2024-08-28T20:15:50.037428+0000","last_unstale":"2024-08-28T20:16:09.252938+0000","last_undegraded":"2024-08-28T20:16:09.252938+0000","last_fullsized":"2024-08-28T20:16:09.252938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:31:36.805904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250318+0000","last_change":"2024-08-28T20:15:53.086731+0000","last_active":"2024-08-28T20:16:09.250318+0000","last_peered":"2024-08-28T20:16:09.250318+0000","last_clean":"2024-08-28T20:16:09.250318+0000","last_became_active":"2024-08-28T20:15:53.086300+0000","last_became_peered":"2024-08-28T20:15:53.086300+0000","last_unstale":"2024-08-28T20:16:09.250318+0000","last_undegraded":"2024-08-28T20:16:09.250318+0000","last_fullsized":"2024-08-28T20:16:09.250318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:33:30.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251493+0000","last_change":"2024-08-28T20:15:50.037252+0000","last_active":"2024-08-28T20:16:09.251493+0000","last_peered":"2024-08-28T20:16:09.251493+0000","last_clean":"2024-08-28T20:16:09.251493+0000","last_became_active":"2024-08-28T20:15:50.036778+0000","last_became_peered":"2024-08-28T20:15:50.036778+0000","last_unstale":"2024-08-28T20:16:09.251493+0000","last_undegraded":"2024-08-28T20:16:09.251493+0000","last_fullsized":"2024-08-28T20:16:09.251493+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:11:16.685741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254245+0000","last_change":"2024-08-28T20:15:53.070510+0000","last_active":"2024-08-28T20:16:09.254245+0000","last_peered":"2024-08-28T20:16:09.254245+0000","last_clean":"2024-08-28T20:16:09.254245+0000","last_became_active":"2024-08-28T20:15:53.070006+0000","last_became_peered":"2024-08-28T20:15:53.070006+0000","last_unstale":"2024-08-28T20:16:09.254245+0000","last_undegraded":"2024-08-28T20:16:09.254245+0000","last_fullsized":"2024-08-28T20:16:09.254245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:06.081692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":51,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:27.297791+0000","last_change":"2024-08-28T20:15:50.036777+0000","last_active":"2024-08-28T20:16:27.297791+0000","last_peered":"2024-08-28T20:16:27.297791+0000","last_clean":"2024-08-28T20:16:27.297791+0000","last_became_active":"2024-08-28T20:15:50.036329+0000","last_became_peered":"2024-08-28T20:15:50.036329+0000","last_unstale":"2024-08-28T20:16:27.297791+0000","last_undegraded":"2024-08-28T20:16:27.297791+0000","last_fullsized":"2024-08-28T20:16:27.297791+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:58:06.285314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255588+0000","last_change":"2024-08-28T20:15:53.077888+0000","last_active":"2024-08-28T20:16:09.255588+0000","last_peered":"2024-08-28T20:16:09.255588+0000","last_clean":"2024-08-28T20:16:09.255588+0000","last_became_active":"2024-08-28T20:15:53.074925+0000","last_became_peered":"2024-08-28T20:15:53.074925+0000","last_unstale":"2024-08-28T20:16:09.255588+0000","last_undegraded":"2024-08-28T20:16:09.255588+0000","last_fullsized":"2024-08-28T20:16:09.255588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:18:59.262238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256613+0000","last_change":"2024-08-28T20:15:50.038654+0000","last_active":"2024-08-28T20:16:09.256613+0000","last_peered":"2024-08-28T20:16:09.256613+0000","last_clean":"2024-08-28T20:16:09.256613+0000","last_became_active":"2024-08-28T20:15:50.038208+0000","last_became_peered":"2024-08-28T20:15:50.038208+0000","last_unstale":"2024-08-28T20:16:09.256613+0000","last_undegraded":"2024-08-28T20:16:09.256613+0000","last_fullsized":"2024-08-28T20:16:09.256613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:20.845229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259937+0000","last_change":"2024-08-28T20:15:53.085682+0000","last_active":"2024-08-28T20:16:09.259937+0000","last_peered":"2024-08-28T20:16:09.259937+0000","last_clean":"2024-08-28T20:16:09.259937+0000","last_became_active":"2024-08-28T20:15:53.085312+0000","last_became_peered":"2024-08-28T20:15:53.085312+0000","last_unstale":"2024-08-28T20:16:09.259937+0000","last_undegraded":"2024-08-28T20:16:09.259937+0000","last_fullsized":"2024-08-28T20:16:09.259937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:36:21.112522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251741+0000","last_change":"2024-08-28T20:15:50.194955+0000","last_active":"2024-08-28T20:16:09.251741+0000","last_peered":"2024-08-28T20:16:09.251741+0000","last_clean":"2024-08-28T20:16:09.251741+0000","last_became_active":"2024-08-28T20:15:50.194473+0000","last_became_peered":"2024-08-28T20:15:50.194473+0000","last_unstale":"2024-08-28T20:16:09.251741+0000","last_undegraded":"2024-08-28T20:16:09.251741+0000","last_fullsized":"2024-08-28T20:16:09.251741+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:29:21.702692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255283+0000","last_change":"2024-08-28T20:15:53.075495+0000","last_active":"2024-08-28T20:16:09.255283+0000","last_peered":"2024-08-28T20:16:09.255283+0000","last_clean":"2024-08-28T20:16:09.255283+0000","last_became_active":"2024-08-28T20:15:53.071017+0000","last_became_peered":"2024-08-28T20:15:53.071017+0000","last_unstale":"2024-08-28T20:16:09.255283+0000","last_undegraded":"2024-08-28T20:16:09.255283+0000","last_fullsized":"2024-08-28T20:16:09.255283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:20:17.809878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'25","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:28.299972+0000","last_change":"2024-08-28T20:16:09.288268+0000","last_active":"2024-08-28T20:16:28.299972+0000","last_peered":"2024-08-28T20:16:28.299972+0000","last_clean":"2024-08-28T20:16:28.299972+0000","last_became_active":"2024-08-28T20:16:09.259977+0000","last_became_peered":"2024-08-28T20:16:09.259977+0000","last_unstale":"2024-08-28T20:16:28.299972+0000","last_undegraded":"2024-08-28T20:16:28.299972+0000","last_fullsized":"2024-08-28T20:16:28.299972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:10:36.700199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54952,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":76,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255423+0000","last_change":"2024-08-28T20:15:53.073649+0000","last_active":"2024-08-28T20:16:09.255423+0000","last_peered":"2024-08-28T20:16:09.255423+0000","last_clean":"2024-08-28T20:16:09.255423+0000","last_became_active":"2024-08-28T20:15:53.073314+0000","last_became_peered":"2024-08-28T20:15:53.073314+0000","last_unstale":"2024-08-28T20:16:09.255423+0000","last_undegraded":"2024-08-28T20:16:09.255423+0000","last_fullsized":"2024-08-28T20:16:09.255423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:12.160611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254043+0000","last_change":"2024-08-28T20:15:50.038301+0000","last_active":"2024-08-28T20:16:09.254043+0000","last_peered":"2024-08-28T20:16:09.254043+0000","last_clean":"2024-08-28T20:16:09.254043+0000","last_became_active":"2024-08-28T20:15:50.037068+0000","last_became_peered":"2024-08-28T20:15:50.037068+0000","last_unstale":"2024-08-28T20:16:09.254043+0000","last_undegraded":"2024-08-28T20:16:09.254043+0000","last_fullsized":"2024-08-28T20:16:09.254043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:55:55.874707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252981+0000","last_change":"2024-08-28T20:15:53.085561+0000","last_active":"2024-08-28T20:16:09.252981+0000","last_peered":"2024-08-28T20:16:09.252981+0000","last_clean":"2024-08-28T20:16:09.252981+0000","last_became_active":"2024-08-28T20:15:53.085184+0000","last_became_peered":"2024-08-28T20:15:53.085184+0000","last_unstale":"2024-08-28T20:16:09.252981+0000","last_undegraded":"2024-08-28T20:16:09.252981+0000","last_fullsized":"2024-08-28T20:16:09.252981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:19:29.992874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251181+0000","last_change":"2024-08-28T20:15:50.040070+0000","last_active":"2024-08-28T20:16:09.251181+0000","last_peered":"2024-08-28T20:16:09.251181+0000","last_clean":"2024-08-28T20:16:09.251181+0000","last_became_active":"2024-08-28T20:15:50.039613+0000","last_became_peered":"2024-08-28T20:15:50.039613+0000","last_unstale":"2024-08-28T20:16:09.251181+0000","last_undegraded":"2024-08-28T20:16:09.251181+0000","last_fullsized":"2024-08-28T20:16:09.251181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:58:55.014173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.263222+0000","last_change":"2024-08-28T20:16:09.263069+0000","last_active":"2024-08-28T20:16:09.263222+0000","last_peered":"2024-08-28T20:16:09.263222+0000","last_clean":"2024-08-28T20:16:09.263222+0000","last_became_active":"2024-08-28T20:16:09.262112+0000","last_became_peered":"2024-08-28T20:16:09.262112+0000","last_unstale":"2024-08-28T20:16:09.263222+0000","last_undegraded":"2024-08-28T20:16:09.263222+0000","last_fullsized":"2024-08-28T20:16:09.263222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:48.595659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":67,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:27.298593+0000","last_change":"2024-08-28T20:16:09.268467+0000","last_active":"2024-08-28T20:16:27.298593+0000","last_peered":"2024-08-28T20:16:27.298593+0000","last_clean":"2024-08-28T20:16:27.298593+0000","last_became_active":"2024-08-28T20:16:09.262061+0000","last_became_peered":"2024-08-28T20:16:09.262061+0000","last_unstale":"2024-08-28T20:16:27.298593+0000","last_undegraded":"2024-08-28T20:16:27.298593+0000","last_fullsized":"2024-08-28T20:16:27.298593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:24:13.257421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255761+0000","last_change":"2024-08-28T20:15:53.079473+0000","last_active":"2024-08-28T20:16:09.255761+0000","last_peered":"2024-08-28T20:16:09.255761+0000","last_clean":"2024-08-28T20:16:09.255761+0000","last_became_active":"2024-08-28T20:15:53.079103+0000","last_became_peered":"2024-08-28T20:15:53.079103+0000","last_unstale":"2024-08-28T20:16:09.255761+0000","last_undegraded":"2024-08-28T20:16:09.255761+0000","last_fullsized":"2024-08-28T20:16:09.255761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:43:59.476622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.283415+0000","last_change":"2024-08-28T20:16:09.282923+0000","last_active":"2024-08-28T20:16:09.283415+0000","last_peered":"2024-08-28T20:16:09.283415+0000","last_clean":"2024-08-28T20:16:09.283415+0000","last_became_active":"2024-08-28T20:16:09.262506+0000","last_became_peered":"2024-08-28T20:16:09.262506+0000","last_unstale":"2024-08-28T20:16:09.283415+0000","last_undegraded":"2024-08-28T20:16:09.283415+0000","last_fullsized":"2024-08-28T20:16:09.283415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:37:49.969128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,4],"acting":[11,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260986+0000","last_change":"2024-08-28T20:16:09.260875+0000","last_active":"2024-08-28T20:16:09.260986+0000","last_peered":"2024-08-28T20:16:09.260986+0000","last_clean":"2024-08-28T20:16:09.260986+0000","last_became_active":"2024-08-28T20:16:09.260450+0000","last_became_peered":"2024-08-28T20:16:09.260450+0000","last_unstale":"2024-08-28T20:16:09.260986+0000","last_undegraded":"2024-08-28T20:16:09.260986+0000","last_fullsized":"2024-08-28T20:16:09.260986+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:12:15.671882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255671+0000","last_change":"2024-08-28T20:15:50.032115+0000","last_active":"2024-08-28T20:16:09.255671+0000","last_peered":"2024-08-28T20:16:09.255671+0000","last_clean":"2024-08-28T20:16:09.255671+0000","last_became_active":"2024-08-28T20:15:50.031743+0000","last_became_peered":"2024-08-28T20:15:50.031743+0000","last_unstale":"2024-08-28T20:16:09.255671+0000","last_undegraded":"2024-08-28T20:16:09.255671+0000","last_fullsized":"2024-08-28T20:16:09.255671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:48.764221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257991+0000","last_change":"2024-08-28T20:15:53.072928+0000","last_active":"2024-08-28T20:16:09.257991+0000","last_peered":"2024-08-28T20:16:09.257991+0000","last_clean":"2024-08-28T20:16:09.257991+0000","last_became_active":"2024-08-28T20:15:53.072550+0000","last_became_peered":"2024-08-28T20:15:53.072550+0000","last_unstale":"2024-08-28T20:16:09.257991+0000","last_undegraded":"2024-08-28T20:16:09.257991+0000","last_fullsized":"2024-08-28T20:16:09.257991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:02.518088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254273+0000","last_change":"2024-08-28T20:15:50.037322+0000","last_active":"2024-08-28T20:16:09.254273+0000","last_peered":"2024-08-28T20:16:09.254273+0000","last_clean":"2024-08-28T20:16:09.254273+0000","last_became_active":"2024-08-28T20:15:50.036886+0000","last_became_peered":"2024-08-28T20:15:50.036886+0000","last_unstale":"2024-08-28T20:16:09.254273+0000","last_undegraded":"2024-08-28T20:16:09.254273+0000","last_fullsized":"2024-08-28T20:16:09.254273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:27:33.370255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256787+0000","last_change":"2024-08-28T20:15:53.070188+0000","last_active":"2024-08-28T20:16:09.256787+0000","last_peered":"2024-08-28T20:16:09.256787+0000","last_clean":"2024-08-28T20:16:09.256787+0000","last_became_active":"2024-08-28T20:15:53.069576+0000","last_became_peered":"2024-08-28T20:15:53.069576+0000","last_unstale":"2024-08-28T20:16:09.256787+0000","last_undegraded":"2024-08-28T20:16:09.256787+0000","last_fullsized":"2024-08-28T20:16:09.256787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:40.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251992+0000","last_change":"2024-08-28T20:15:50.037700+0000","last_active":"2024-08-28T20:16:09.251992+0000","last_peered":"2024-08-28T20:16:09.251992+0000","last_clean":"2024-08-28T20:16:09.251992+0000","last_became_active":"2024-08-28T20:15:50.037114+0000","last_became_peered":"2024-08-28T20:15:50.037114+0000","last_unstale":"2024-08-28T20:16:09.251992+0000","last_undegraded":"2024-08-28T20:16:09.251992+0000","last_fullsized":"2024-08-28T20:16:09.251992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:18:04.478513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256616+0000","last_change":"2024-08-28T20:15:53.080964+0000","last_active":"2024-08-28T20:16:09.256616+0000","last_peered":"2024-08-28T20:16:09.256616+0000","last_clean":"2024-08-28T20:16:09.256616+0000","last_became_active":"2024-08-28T20:15:53.080575+0000","last_became_peered":"2024-08-28T20:15:53.080575+0000","last_unstale":"2024-08-28T20:16:09.256616+0000","last_undegraded":"2024-08-28T20:16:09.256616+0000","last_fullsized":"2024-08-28T20:16:09.256616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:27:22.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255568+0000","last_change":"2024-08-28T20:15:50.195346+0000","last_active":"2024-08-28T20:16:09.255568+0000","last_peered":"2024-08-28T20:16:09.255568+0000","last_clean":"2024-08-28T20:16:09.255568+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255568+0000","last_undegraded":"2024-08-28T20:16:09.255568+0000","last_fullsized":"2024-08-28T20:16:09.255568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:57.094246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256860+0000","last_change":"2024-08-28T20:15:53.081887+0000","last_active":"2024-08-28T20:16:09.256860+0000","last_peered":"2024-08-28T20:16:09.256860+0000","last_clean":"2024-08-28T20:16:09.256860+0000","last_became_active":"2024-08-28T20:15:53.081468+0000","last_became_peered":"2024-08-28T20:15:53.081468+0000","last_unstale":"2024-08-28T20:16:09.256860+0000","last_undegraded":"2024-08-28T20:16:09.256860+0000","last_fullsized":"2024-08-28T20:16:09.256860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:36:56.711342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256111+0000","last_change":"2024-08-28T20:14:34.441400+0000","last_active":"2024-08-28T20:16:09.256111+0000","last_peered":"2024-08-28T20:16:09.256111+0000","last_clean":"2024-08-28T20:16:09.256111+0000","last_became_active":"2024-08-28T20:14:34.435613+0000","last_became_peered":"2024-08-28T20:14:34.435613+0000","last_unstale":"2024-08-28T20:16:09.256111+0000","last_undegraded":"2024-08-28T20:16:09.256111+0000","last_fullsized":"2024-08-28T20:16:09.256111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_clean_scrub_stamp":"2024-08-28T20:11:05.289764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:44:58.327028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256253+0000","last_change":"2024-08-28T20:15:50.034574+0000","last_active":"2024-08-28T20:16:09.256253+0000","last_peered":"2024-08-28T20:16:09.256253+0000","last_clean":"2024-08-28T20:16:09.256253+0000","last_became_active":"2024-08-28T20:15:50.034191+0000","last_became_peered":"2024-08-28T20:15:50.034191+0000","last_unstale":"2024-08-28T20:16:09.256253+0000","last_undegraded":"2024-08-28T20:16:09.256253+0000","last_fullsized":"2024-08-28T20:16:09.256253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:02:17.165360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250475+0000","last_change":"2024-08-28T20:15:53.079974+0000","last_active":"2024-08-28T20:16:09.250475+0000","last_peered":"2024-08-28T20:16:09.250475+0000","last_clean":"2024-08-28T20:16:09.250475+0000","last_became_active":"2024-08-28T20:15:53.079263+0000","last_became_peered":"2024-08-28T20:15:53.079263+0000","last_unstale":"2024-08-28T20:16:09.250475+0000","last_undegraded":"2024-08-28T20:16:09.250475+0000","last_fullsized":"2024-08-28T20:16:09.250475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:06:09.158005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255980+0000","last_change":"2024-08-28T20:15:50.032856+0000","last_active":"2024-08-28T20:16:09.255980+0000","last_peered":"2024-08-28T20:16:09.255980+0000","last_clean":"2024-08-28T20:16:09.255980+0000","last_became_active":"2024-08-28T20:15:50.032378+0000","last_became_peered":"2024-08-28T20:15:50.032378+0000","last_unstale":"2024-08-28T20:16:09.255980+0000","last_undegraded":"2024-08-28T20:16:09.255980+0000","last_fullsized":"2024-08-28T20:16:09.255980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:10:43.559574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252851+0000","last_change":"2024-08-28T20:15:53.082998+0000","last_active":"2024-08-28T20:16:09.252851+0000","last_peered":"2024-08-28T20:16:09.252851+0000","last_clean":"2024-08-28T20:16:09.252851+0000","last_became_active":"2024-08-28T20:15:53.082579+0000","last_became_peered":"2024-08-28T20:15:53.082579+0000","last_unstale":"2024-08-28T20:16:09.252851+0000","last_undegraded":"2024-08-28T20:16:09.252851+0000","last_fullsized":"2024-08-28T20:16:09.252851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:56:31.892013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:26.296040+0000","last_change":"2024-08-28T20:15:50.195181+0000","last_active":"2024-08-28T20:16:26.296040+0000","last_peered":"2024-08-28T20:16:26.296040+0000","last_clean":"2024-08-28T20:16:26.296040+0000","last_became_active":"2024-08-28T20:15:50.194233+0000","last_became_peered":"2024-08-28T20:15:50.194233+0000","last_unstale":"2024-08-28T20:16:26.296040+0000","last_undegraded":"2024-08-28T20:16:26.296040+0000","last_fullsized":"2024-08-28T20:16:26.296040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:10:18.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251255+0000","last_change":"2024-08-28T20:15:53.065425+0000","last_active":"2024-08-28T20:16:09.251255+0000","last_peered":"2024-08-28T20:16:09.251255+0000","last_clean":"2024-08-28T20:16:09.251255+0000","last_became_active":"2024-08-28T20:15:53.065021+0000","last_became_peered":"2024-08-28T20:15:53.065021+0000","last_unstale":"2024-08-28T20:16:09.251255+0000","last_undegraded":"2024-08-28T20:16:09.251255+0000","last_fullsized":"2024-08-28T20:16:09.251255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:40.792120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256421+0000","last_change":"2024-08-28T20:15:50.038730+0000","last_active":"2024-08-28T20:16:09.256421+0000","last_peered":"2024-08-28T20:16:09.256421+0000","last_clean":"2024-08-28T20:16:09.256421+0000","last_became_active":"2024-08-28T20:15:50.036791+0000","last_became_peered":"2024-08-28T20:15:50.036791+0000","last_unstale":"2024-08-28T20:16:09.256421+0000","last_undegraded":"2024-08-28T20:16:09.256421+0000","last_fullsized":"2024-08-28T20:16:09.256421+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:18:51.484781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250942+0000","last_change":"2024-08-28T20:15:53.087092+0000","last_active":"2024-08-28T20:16:09.250942+0000","last_peered":"2024-08-28T20:16:09.250942+0000","last_clean":"2024-08-28T20:16:09.250942+0000","last_became_active":"2024-08-28T20:15:53.086614+0000","last_became_peered":"2024-08-28T20:15:53.086614+0000","last_unstale":"2024-08-28T20:16:09.250942+0000","last_undegraded":"2024-08-28T20:16:09.250942+0000","last_fullsized":"2024-08-28T20:16:09.250942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:47:00.962576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254705+0000","last_change":"2024-08-28T20:15:50.194838+0000","last_active":"2024-08-28T20:16:09.254705+0000","last_peered":"2024-08-28T20:16:09.254705+0000","last_clean":"2024-08-28T20:16:09.254705+0000","last_became_active":"2024-08-28T20:15:50.194378+0000","last_became_peered":"2024-08-28T20:15:50.194378+0000","last_unstale":"2024-08-28T20:16:09.254705+0000","last_undegraded":"2024-08-28T20:16:09.254705+0000","last_fullsized":"2024-08-28T20:16:09.254705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:53:56.395001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250871+0000","last_change":"2024-08-28T20:15:53.089721+0000","last_active":"2024-08-28T20:16:09.250871+0000","last_peered":"2024-08-28T20:16:09.250871+0000","last_clean":"2024-08-28T20:16:09.250871+0000","last_became_active":"2024-08-28T20:15:53.089240+0000","last_became_peered":"2024-08-28T20:15:53.089240+0000","last_unstale":"2024-08-28T20:16:09.250871+0000","last_undegraded":"2024-08-28T20:16:09.250871+0000","last_fullsized":"2024-08-28T20:16:09.250871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:55.859753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255661+0000","last_change":"2024-08-28T20:15:50.195290+0000","last_active":"2024-08-28T20:16:09.255661+0000","last_peered":"2024-08-28T20:16:09.255661+0000","last_clean":"2024-08-28T20:16:09.255661+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255661+0000","last_undegraded":"2024-08-28T20:16:09.255661+0000","last_fullsized":"2024-08-28T20:16:09.255661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:44.915047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253801+0000","last_change":"2024-08-28T20:15:53.079572+0000","last_active":"2024-08-28T20:16:09.253801+0000","last_peered":"2024-08-28T20:16:09.253801+0000","last_clean":"2024-08-28T20:16:09.253801+0000","last_became_active":"2024-08-28T20:15:53.074745+0000","last_became_peered":"2024-08-28T20:15:53.074745+0000","last_unstale":"2024-08-28T20:16:09.253801+0000","last_undegraded":"2024-08-28T20:16:09.253801+0000","last_fullsized":"2024-08-28T20:16:09.253801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:44.989383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'11","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:26.081068+0000","last_change":"2024-08-28T20:15:50.040420+0000","last_active":"2024-08-28T20:16:26.081068+0000","last_peered":"2024-08-28T20:16:26.081068+0000","last_clean":"2024-08-28T20:16:26.081068+0000","last_became_active":"2024-08-28T20:15:50.039932+0000","last_became_peered":"2024-08-28T20:15:50.039932+0000","last_unstale":"2024-08-28T20:16:26.081068+0000","last_undegraded":"2024-08-28T20:16:26.081068+0000","last_fullsized":"2024-08-28T20:16:26.081068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:13.062974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250922+0000","last_change":"2024-08-28T20:15:53.073177+0000","last_active":"2024-08-28T20:16:09.250922+0000","last_peered":"2024-08-28T20:16:09.250922+0000","last_clean":"2024-08-28T20:16:09.250922+0000","last_became_active":"2024-08-28T20:15:53.072323+0000","last_became_peered":"2024-08-28T20:15:53.072323+0000","last_unstale":"2024-08-28T20:16:09.250922+0000","last_undegraded":"2024-08-28T20:16:09.250922+0000","last_fullsized":"2024-08-28T20:16:09.250922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:18:43.672990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253954+0000","last_change":"2024-08-28T20:15:50.114223+0000","last_active":"2024-08-28T20:16:09.253954+0000","last_peered":"2024-08-28T20:16:09.253954+0000","last_clean":"2024-08-28T20:16:09.253954+0000","last_became_active":"2024-08-28T20:15:50.113798+0000","last_became_peered":"2024-08-28T20:15:50.113798+0000","last_unstale":"2024-08-28T20:16:09.253954+0000","last_undegraded":"2024-08-28T20:16:09.253954+0000","last_fullsized":"2024-08-28T20:16:09.253954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:24:56.354493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261002+0000","last_change":"2024-08-28T20:15:53.097744+0000","last_active":"2024-08-28T20:16:09.261002+0000","last_peered":"2024-08-28T20:16:09.261002+0000","last_clean":"2024-08-28T20:16:09.261002+0000","last_became_active":"2024-08-28T20:15:53.096093+0000","last_became_peered":"2024-08-28T20:15:53.096093+0000","last_unstale":"2024-08-28T20:16:09.261002+0000","last_undegraded":"2024-08-28T20:16:09.261002+0000","last_fullsized":"2024-08-28T20:16:09.261002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:40:36.650309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254952+0000","last_change":"2024-08-28T20:15:50.194574+0000","last_active":"2024-08-28T20:16:09.254952+0000","last_peered":"2024-08-28T20:16:09.254952+0000","last_clean":"2024-08-28T20:16:09.254952+0000","last_became_active":"2024-08-28T20:15:50.194174+0000","last_became_peered":"2024-08-28T20:15:50.194174+0000","last_unstale":"2024-08-28T20:16:09.254952+0000","last_undegraded":"2024-08-28T20:16:09.254952+0000","last_fullsized":"2024-08-28T20:16:09.254952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:07:30.795200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253928+0000","last_change":"2024-08-28T20:15:53.074015+0000","last_active":"2024-08-28T20:16:09.253928+0000","last_peered":"2024-08-28T20:16:09.253928+0000","last_clean":"2024-08-28T20:16:09.253928+0000","last_became_active":"2024-08-28T20:15:53.073641+0000","last_became_peered":"2024-08-28T20:15:53.073641+0000","last_unstale":"2024-08-28T20:16:09.253928+0000","last_undegraded":"2024-08-28T20:16:09.253928+0000","last_fullsized":"2024-08-28T20:16:09.253928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:55.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250392+0000","last_change":"2024-08-28T20:15:50.038105+0000","last_active":"2024-08-28T20:16:09.250392+0000","last_peered":"2024-08-28T20:16:09.250392+0000","last_clean":"2024-08-28T20:16:09.250392+0000","last_became_active":"2024-08-28T20:15:50.037721+0000","last_became_peered":"2024-08-28T20:15:50.037721+0000","last_unstale":"2024-08-28T20:16:09.250392+0000","last_undegraded":"2024-08-28T20:16:09.250392+0000","last_fullsized":"2024-08-28T20:16:09.250392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:24:58.941095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258053+0000","last_change":"2024-08-28T20:15:53.090160+0000","last_active":"2024-08-28T20:16:09.258053+0000","last_peered":"2024-08-28T20:16:09.258053+0000","last_clean":"2024-08-28T20:16:09.258053+0000","last_became_active":"2024-08-28T20:15:53.089739+0000","last_became_peered":"2024-08-28T20:15:53.089739+0000","last_unstale":"2024-08-28T20:16:09.258053+0000","last_undegraded":"2024-08-28T20:16:09.258053+0000","last_fullsized":"2024-08-28T20:16:09.258053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:51:32.384124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253620+0000","last_change":"2024-08-28T20:15:50.036817+0000","last_active":"2024-08-28T20:16:09.253620+0000","last_peered":"2024-08-28T20:16:09.253620+0000","last_clean":"2024-08-28T20:16:09.253620+0000","last_became_active":"2024-08-28T20:15:50.036425+0000","last_became_peered":"2024-08-28T20:15:50.036425+0000","last_unstale":"2024-08-28T20:16:09.253620+0000","last_undegraded":"2024-08-28T20:16:09.253620+0000","last_fullsized":"2024-08-28T20:16:09.253620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:16:59.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250559+0000","last_change":"2024-08-28T20:15:53.090616+0000","last_active":"2024-08-28T20:16:09.250559+0000","last_peered":"2024-08-28T20:16:09.250559+0000","last_clean":"2024-08-28T20:16:09.250559+0000","last_became_active":"2024-08-28T20:15:53.089204+0000","last_became_peered":"2024-08-28T20:15:53.089204+0000","last_unstale":"2024-08-28T20:16:09.250559+0000","last_undegraded":"2024-08-28T20:16:09.250559+0000","last_fullsized":"2024-08-28T20:16:09.250559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:24:39.423756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":45,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.269132+0000","last_change":"2024-08-28T20:16:09.268949+0000","last_active":"2024-08-28T20:16:09.269132+0000","last_peered":"2024-08-28T20:16:09.269132+0000","last_clean":"2024-08-28T20:16:09.269132+0000","last_became_active":"2024-08-28T20:16:09.258665+0000","last_became_peered":"2024-08-28T20:16:09.258665+0000","last_unstale":"2024-08-28T20:16:09.269132+0000","last_undegraded":"2024-08-28T20:16:09.269132+0000","last_fullsized":"2024-08-28T20:16:09.269132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:43:11.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256137+0000","last_change":"2024-08-28T20:15:53.075853+0000","last_active":"2024-08-28T20:16:09.256137+0000","last_peered":"2024-08-28T20:16:09.256137+0000","last_clean":"2024-08-28T20:16:09.256137+0000","last_became_active":"2024-08-28T20:15:53.075429+0000","last_became_peered":"2024-08-28T20:15:53.075429+0000","last_unstale":"2024-08-28T20:16:09.256137+0000","last_undegraded":"2024-08-28T20:16:09.256137+0000","last_fullsized":"2024-08-28T20:16:09.256137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:09.301878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257135+0000","last_change":"2024-08-28T20:16:09.256999+0000","last_active":"2024-08-28T20:16:09.257135+0000","last_peered":"2024-08-28T20:16:09.257135+0000","last_clean":"2024-08-28T20:16:09.257135+0000","last_became_active":"2024-08-28T20:16:09.256508+0000","last_became_peered":"2024-08-28T20:16:09.256508+0000","last_unstale":"2024-08-28T20:16:09.257135+0000","last_undegraded":"2024-08-28T20:16:09.257135+0000","last_fullsized":"2024-08-28T20:16:09.257135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T08:08:23.494703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254657+0000","last_change":"2024-08-28T20:15:50.040047+0000","last_active":"2024-08-28T20:16:09.254657+0000","last_peered":"2024-08-28T20:16:09.254657+0000","last_clean":"2024-08-28T20:16:09.254657+0000","last_became_active":"2024-08-28T20:15:50.039656+0000","last_became_peered":"2024-08-28T20:15:50.039656+0000","last_unstale":"2024-08-28T20:16:09.254657+0000","last_undegraded":"2024-08-28T20:16:09.254657+0000","last_fullsized":"2024-08-28T20:16:09.254657+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:13:30.986352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255216+0000","last_change":"2024-08-28T20:15:53.076441+0000","last_active":"2024-08-28T20:16:09.255216+0000","last_peered":"2024-08-28T20:16:09.255216+0000","last_clean":"2024-08-28T20:16:09.255216+0000","last_became_active":"2024-08-28T20:15:53.076091+0000","last_became_peered":"2024-08-28T20:15:53.076091+0000","last_unstale":"2024-08-28T20:16:09.255216+0000","last_undegraded":"2024-08-28T20:16:09.255216+0000","last_fullsized":"2024-08-28T20:16:09.255216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:45:13.500267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255533+0000","last_change":"2024-08-28T20:15:50.034114+0000","last_active":"2024-08-28T20:16:09.255533+0000","last_peered":"2024-08-28T20:16:09.255533+0000","last_clean":"2024-08-28T20:16:09.255533+0000","last_became_active":"2024-08-28T20:15:50.033681+0000","last_became_peered":"2024-08-28T20:15:50.033681+0000","last_unstale":"2024-08-28T20:16:09.255533+0000","last_undegraded":"2024-08-28T20:16:09.255533+0000","last_fullsized":"2024-08-28T20:16:09.255533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:06:09.372632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260281+0000","last_change":"2024-08-28T20:15:53.088870+0000","last_active":"2024-08-28T20:16:09.260281+0000","last_peered":"2024-08-28T20:16:09.260281+0000","last_clean":"2024-08-28T20:16:09.260281+0000","last_became_active":"2024-08-28T20:15:53.088536+0000","last_became_peered":"2024-08-28T20:15:53.088536+0000","last_unstale":"2024-08-28T20:16:09.260281+0000","last_undegraded":"2024-08-28T20:16:09.260281+0000","last_fullsized":"2024-08-28T20:16:09.260281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:20:28.927016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250862+0000","last_change":"2024-08-28T20:15:50.194803+0000","last_active":"2024-08-28T20:16:09.250862+0000","last_peered":"2024-08-28T20:16:09.250862+0000","last_clean":"2024-08-28T20:16:09.250862+0000","last_became_active":"2024-08-28T20:15:50.194351+0000","last_became_peered":"2024-08-28T20:15:50.194351+0000","last_unstale":"2024-08-28T20:16:09.250862+0000","last_undegraded":"2024-08-28T20:16:09.250862+0000","last_fullsized":"2024-08-28T20:16:09.250862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:44:14.751785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250705+0000","last_change":"2024-08-28T20:15:53.083914+0000","last_active":"2024-08-28T20:16:09.250705+0000","last_peered":"2024-08-28T20:16:09.250705+0000","last_clean":"2024-08-28T20:16:09.250705+0000","last_became_active":"2024-08-28T20:15:53.081282+0000","last_became_peered":"2024-08-28T20:15:53.081282+0000","last_unstale":"2024-08-28T20:16:09.250705+0000","last_undegraded":"2024-08-28T20:16:09.250705+0000","last_fullsized":"2024-08-28T20:16:09.250705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:21.373284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255271+0000","last_change":"2024-08-28T20:15:50.034299+0000","last_active":"2024-08-28T20:16:09.255271+0000","last_peered":"2024-08-28T20:16:09.255271+0000","last_clean":"2024-08-28T20:16:09.255271+0000","last_became_active":"2024-08-28T20:15:50.033858+0000","last_became_peered":"2024-08-28T20:15:50.033858+0000","last_unstale":"2024-08-28T20:16:09.255271+0000","last_undegraded":"2024-08-28T20:16:09.255271+0000","last_fullsized":"2024-08-28T20:16:09.255271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:38:41.264067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59344,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":146,"num_read_kb":136,"num_write":160,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2312,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":169880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841556,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":405362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005082,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1051095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168607,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":404507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364835,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":404315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528360,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36748,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708404,"statfs":{"total":95995035648,"available":95957405696,"internally_reserved":0,"allocated":1437696,"data_stored":995769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":403896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855410,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":996041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":459788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":404207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":843776,"data_stored":405318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":450489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":405167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T20:16:31.223 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-28T20:16:31.223 INFO:tasks.cephadm:Setting up client nodes... 2024-08-28T20:16:31.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-28T20:16:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:31 smithi001 ceph-mon[20984]: pgmap v317: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-08-28T20:16:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:31 smithi001 ceph-mon[20984]: from='client.24827 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:16:31.601 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:31 smithi121 ceph-mon[25248]: pgmap v317: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-08-28T20:16:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:31 smithi121 ceph-mon[25248]: from='client.24827 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:16:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:31 smithi007 ceph-mon[25357]: pgmap v317: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-08-28T20:16:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:31 smithi007 ceph-mon[25357]: from='client.24827 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 -- 172.21.15.1:0/1535840749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 msgr2=0x7f1c2810dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/1535840749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 0x7f1c2810dac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009ca0 tx=0x7f1c2002a950 comp rx=0 tx=0).stop 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 -- 172.21.15.1:0/1535840749 shutdown_connections 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/1535840749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 0x7f1c2810dac0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/1535840749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c28106780 0x7f1c28106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/1535840749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c281056f0 0x7f1c28105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 -- 172.21.15.1:0/1535840749 >> 172.21.15.1:0/1535840749 conn(0x7f1c28101060 msgr2=0x7f1c28103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 -- 172.21.15.1:0/1535840749 shutdown_connections 2024-08-28T20:16:32.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.250+0000 7f1c2fc00640 1 -- 172.21.15.1:0/1535840749 wait complete. 2024-08-28T20:16:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.251+0000 7f1c2fc00640 1 Processor -- start 2024-08-28T20:16:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.251+0000 7f1c2fc00640 1 -- start start 2024-08-28T20:16:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2fc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 0x7f1c2819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:32.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2fc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c28106780 0x7f1c2819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2fc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 0x7f1c2819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2fc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111390 con 0x7f1c28107120 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2fc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111210 con 0x7f1c281056f0 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2fc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111510 con 0x7f1c28106780 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 0x7f1c2819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2dc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 0x7f1c2819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c27e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c28106780 0x7f1c2819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 0x7f1c2819bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55674/0 (socket says 172.21.15.1:55674) 2024-08-28T20:16:32.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c2d200640 1 -- 172.21.15.1:0/3075954513 learned_addr learned my addr 172.21.15.1:0/3075954513 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c27e00640 1 -- 172.21.15.1:0/3075954513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 msgr2=0x7f1c2819bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.252+0000 7f1c27e00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 0x7f1c2819bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c27e00640 1 -- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 msgr2=0x7f1c2819d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c27e00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 0x7f1c2819d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c27e00640 1 -- 172.21.15.1:0/3075954513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2819d950 con 0x7f1c28106780 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c2d200640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 0x7f1c2819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c27e00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c28106780 0x7f1c2819c590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e9f0 tx=0x7f1c1400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400cd80 con 0x7f1c28106780 2024-08-28T20:16:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2819dc40 con 0x7f1c28106780 2024-08-28T20:16:32.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c140035f0 con 0x7f1c28106780 2024-08-28T20:16:32.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14010690 con 0x7f1c28106780 2024-08-28T20:16:32.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.253+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281a4340 con 0x7f1c28106780 2024-08-28T20:16:32.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.254+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2810c8d0 con 0x7f1c28106780 2024-08-28T20:16:32.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.257+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f1c140037a0 con 0x7f1c28106780 2024-08-28T20:16:32.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.258+0000 7f1c25600640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1c100b4bc0 0x7f1c100b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:32.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.259+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f1c140e5690 con 0x7f1c28106780 2024-08-28T20:16:32.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.259+0000 7f1c2d200640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1c100b4bc0 0x7f1c100b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:32.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.259+0000 7f1c2d200640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1c100b4bc0 0x7f1c100b70d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c011500 tx=0x7f1c1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.260+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1c140ac5f0 con 0x7f1c28106780 2024-08-28T20:16:32.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.528+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1c2802e430 con 0x7f1c28106780 2024-08-28T20:16:32.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.535+0000 7f1c25600640 1 -- 172.21.15.1:0/3075954513 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f1c140abef0 con 0x7f1c28106780 2024-08-28T20:16:32.537 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-08-28T20:16:32.537 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCghc9mifWsHxAADIrdzzmSjt30GT/kBwN++A== 2024-08-28T20:16:32.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1c100b4bc0 msgr2=0x7f1c100b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:32.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1c100b4bc0 0x7f1c100b70d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c011500 tx=0x7f1c1c005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c28106780 msgr2=0x7f1c2819c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c28106780 0x7f1c2819c590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e9f0 tx=0x7f1c1400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 shutdown_connections 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1c100b4bc0 0x7f1c100b70d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c28107120 0x7f1c2819d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c28106780 0x7f1c2819c590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 --2- 172.21.15.1:0/3075954513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c281056f0 0x7f1c2819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 >> 172.21.15.1:0/3075954513 conn(0x7f1c28101060 msgr2=0x7f1c28109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 shutdown_connections 2024-08-28T20:16:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:32.537+0000 7f1c2fc00640 1 -- 172.21.15.1:0/3075954513 wait complete. 2024-08-28T20:16:33.331 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:16:33.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-28T20:16:33.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-28T20:16:33.412 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-28T20:16:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:33 smithi001 ceph-mon[20984]: pgmap v318: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-28T20:16:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:33 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3075954513' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T20:16:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:33 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T20:16:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:33 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-28T20:16:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:33 smithi121 ceph-mon[25248]: pgmap v318: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-28T20:16:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:33 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3075954513' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T20:16:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:33 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T20:16:33.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:33 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-28T20:16:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:33 smithi007 ceph-mon[25357]: pgmap v318: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-28T20:16:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:33 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3075954513' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T20:16:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:33 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T20:16:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:33 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-28T20:16:33.829 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 -- 172.21.15.1:0/85035051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10b460 msgr2=0x7f6b2c10b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 --2- 172.21.15.1:0/85035051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10b460 0x7f6b2c10b870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009900 tx=0x7f6b1802a410 comp rx=0 tx=0).stop 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 -- 172.21.15.1:0/85035051 shutdown_connections 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 --2- 172.21.15.1:0/85035051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10b460 0x7f6b2c10b870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 --2- 172.21.15.1:0/85035051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10bdb0 0x7f6b2c1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 --2- 172.21.15.1:0/85035051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 -- 172.21.15.1:0/85035051 >> 172.21.15.1:0/85035051 conn(0x7f6b2c1015b0 msgr2=0x7f6b2c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 -- 172.21.15.1:0/85035051 shutdown_connections 2024-08-28T20:16:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.440+0000 7f6b33600640 1 -- 172.21.15.1:0/85035051 wait complete. 2024-08-28T20:16:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.441+0000 7f6b33600640 1 Processor -- start 2024-08-28T20:16:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.441+0000 7f6b33600640 1 -- start start 2024-08-28T20:16:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b33600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b33600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10b460 0x7f6b2c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b33600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10bdb0 0x7f6b2c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b33600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c115a70 con 0x7f6b2c10bdb0 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b33600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1158f0 con 0x7f6b2c105b20 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b33600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c115bf0 con 0x7f6b2c10b460 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b2be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10b460 0x7f6b2c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b30c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b2be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10b460 0x7f6b2c19ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45896/0 (socket says 172.21.15.1:45896) 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b2be00640 1 -- 172.21.15.1:0/710171713 learned_addr learned my addr 172.21.15.1:0/710171713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b30c00640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c19c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55692/0 (socket says 172.21.15.1:55692) 2024-08-28T20:16:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.442+0000 7f6b31600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10bdb0 0x7f6b2c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b30c00640 1 -- 172.21.15.1:0/710171713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10b460 msgr2=0x7f6b2c19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b30c00640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10b460 0x7f6b2c19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b30c00640 1 -- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10bdb0 msgr2=0x7f6b2c1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b30c00640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10bdb0 0x7f6b2c1a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b30c00640 1 -- 172.21.15.1:0/710171713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c1a23d0 con 0x7f6b2c105b20 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b30c00640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c19c460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000eb00 tx=0x7f6b2000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20010430 con 0x7f6b2c105b20 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b20010a80 con 0x7f6b2c105b20 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20017a90 con 0x7f6b2c105b20 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2c1a26c0 con 0x7f6b2c105b20 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.443+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2c1a8e20 con 0x7f6b2c105b20 2024-08-28T20:16:34.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.444+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b2c105f30 con 0x7f6b2c105b20 2024-08-28T20:16:34.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.447+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f6b20017c70 con 0x7f6b2c105b20 2024-08-28T20:16:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.448+0000 7f6b29600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b140b4bc0 0x7f6b140b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.448+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f6b200e5cf0 con 0x7f6b2c105b20 2024-08-28T20:16:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.448+0000 7f6b2be00640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b140b4bc0 0x7f6b140b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.449+0000 7f6b2be00640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b140b4bc0 0x7f6b140b70d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c06af80 tx=0x7f6b18009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.450+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b200acc50 con 0x7f6b2c105b20 2024-08-28T20:16:34.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.646+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6b2c19d590 con 0x7f6b2c105b20 2024-08-28T20:16:34.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.646+0000 7f6b29600640 1 -- 172.21.15.1:0/710171713 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7f6b200b5190 con 0x7f6b2c105b20 2024-08-28T20:16:34.649 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:34.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b140b4bc0 msgr2=0x7f6b140b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b140b4bc0 0x7f6b140b70d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c06af80 tx=0x7f6b18009560 comp rx=0 tx=0).stop 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 msgr2=0x7f6b2c19c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c19c460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000eb00 tx=0x7f6b2000c2d0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 shutdown_connections 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b140b4bc0 0x7f6b140b70d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b2c10bdb0 0x7f6b2c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b2c10b460 0x7f6b2c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 --2- 172.21.15.1:0/710171713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b2c105b20 0x7f6b2c19c460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 >> 172.21.15.1:0/710171713 conn(0x7f6b2c1015b0 msgr2=0x7f6b2c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 shutdown_connections 2024-08-28T20:16:34.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:34.649+0000 7f6b33600640 1 -- 172.21.15.1:0/710171713 wait complete. 2024-08-28T20:16:35.448 INFO:teuthology.orchestra.run.smithi001.stdout:[{"version":49,"timestamp":"2024-08-28T20:15:40.456199+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-28T20:16:35.448 INFO:tasks.ceph_manager:config epoch is 49 2024-08-28T20:16:35.449 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-28T20:16:35.449 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-28T20:16:35.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-28T20:16:35.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:35 smithi001 ceph-mon[20984]: pgmap v319: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-08-28T20:16:35.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:35 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/710171713' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-28T20:16:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:35 smithi121 ceph-mon[25248]: pgmap v319: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-08-28T20:16:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:35 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/710171713' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-28T20:16:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:35 smithi007 ceph-mon[25357]: pgmap v319: 97 pgs: 97 active+clean; 635 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-08-28T20:16:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:35 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/710171713' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-28T20:16:35.827 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 -- 172.21.15.1:0/3249616513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac10b290 msgr2=0x7f71ac10b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 --2- 172.21.15.1:0/3249616513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac10b290 0x7f71ac10b6a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7198009900 tx=0x7f719802a410 comp rx=0 tx=0).stop 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 -- 172.21.15.1:0/3249616513 shutdown_connections 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 --2- 172.21.15.1:0/3249616513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac10b290 0x7f71ac10b6a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 --2- 172.21.15.1:0/3249616513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ac10bbe0 0x7f71ac112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 --2- 172.21.15.1:0/3249616513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac105950 0x7f71ac105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 -- 172.21.15.1:0/3249616513 >> 172.21.15.1:0/3249616513 conn(0x7f71ac101420 msgr2=0x7f71ac103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:36.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 -- 172.21.15.1:0/3249616513 shutdown_connections 2024-08-28T20:16:36.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.455+0000 7f71b2000640 1 -- 172.21.15.1:0/3249616513 wait complete. 2024-08-28T20:16:36.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.456+0000 7f71b2000640 1 Processor -- start 2024-08-28T20:16:36.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.456+0000 7f71b2000640 1 -- start start 2024-08-28T20:16:36.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b2000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac105950 0x7f71ac19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:36.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 0x7f71ac19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:36.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b2000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ac10bbe0 0x7f71ac1a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:36.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b2000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac1158a0 con 0x7f71ac105950 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b2000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac115720 con 0x7f71ac10b290 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b2000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac115a20 con 0x7f71ac10bbe0 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 0x7f71ac19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac105950 0x7f71ac19c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 0x7f71ac19c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55716/0 (socket says 172.21.15.1:55716) 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71abe00640 1 -- 172.21.15.1:0/2535857978 learned_addr learned my addr 172.21.15.1:0/2535857978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.457+0000 7f71b1600640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ac10bbe0 0x7f71ac1a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71abe00640 1 -- 172.21.15.1:0/2535857978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ac10bbe0 msgr2=0x7f71ac1a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71abe00640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ac10bbe0 0x7f71ac1a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71abe00640 1 -- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac105950 msgr2=0x7f71ac19c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71abe00640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac105950 0x7f71ac19c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71abe00640 1 -- 172.21.15.1:0/2535857978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1a2280 con 0x7f71ac10b290 2024-08-28T20:16:36.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71b0c00640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac105950 0x7f71ac19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:36.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71abe00640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 0x7f71ac19c8b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f719802a930 tx=0x7f7198031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:36.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719803f030 con 0x7f71ac10b290 2024-08-28T20:16:36.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1a2510 con 0x7f71ac10b290 2024-08-28T20:16:36.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7198004490 con 0x7f71ac10b290 2024-08-28T20:16:36.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198035070 con 0x7f71ac10b290 2024-08-28T20:16:36.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.458+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1a8cd0 con 0x7f71ac10b290 2024-08-28T20:16:36.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.459+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac106bd0 con 0x7f71ac10b290 2024-08-28T20:16:36.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.462+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f7198042030 con 0x7f71ac10b290 2024-08-28T20:16:36.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.463+0000 7f71a9600640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f71940b4bc0 0x7f71940b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:36.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.463+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f71981055b0 con 0x7f71ac10b290 2024-08-28T20:16:36.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.463+0000 7f71b0c00640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f71940b4bc0 0x7f71940b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:36.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.464+0000 7f71b0c00640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f71940b4bc0 0x7f71940b70d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009fc0 tx=0x7f71a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:36.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.468+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f71980cbf20 con 0x7f71ac10b290 2024-08-28T20:16:36.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.708+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f71ac10d9d0 con 0x7f71ac10b290 2024-08-28T20:16:36.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.714+0000 7f71a9600640 1 -- 172.21.15.1:0/2535857978 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+293176 (secure 0 0 0) 0x7f71980d06e0 con 0x7f71ac10b290 2024-08-28T20:16:36.721 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:36.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f71940b4bc0 msgr2=0x7f71940b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:36.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f71940b4bc0 0x7f71940b70d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009fc0 tx=0x7f71a0005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:36.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 msgr2=0x7f71ac19c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:36.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 0x7f71ac19c8b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f719802a930 tx=0x7f7198031a20 comp rx=0 tx=0).stop 2024-08-28T20:16:36.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 shutdown_connections 2024-08-28T20:16:36.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f71940b4bc0 0x7f71940b70d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ac10bbe0 0x7f71ac1a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac10b290 0x7f71ac19c8b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 --2- 172.21.15.1:0/2535857978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71ac105950 0x7f71ac19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:36.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 >> 172.21.15.1:0/2535857978 conn(0x7f71ac101420 msgr2=0x7f71ac103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:36.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.718+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 shutdown_connections 2024-08-28T20:16:36.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:36.719+0000 7f71b2000640 1 -- 172.21.15.1:0/2535857978 wait complete. 2024-08-28T20:16:37.446 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":25450820},{"type":"v1","addr":"172.21.15.1:6801","nonce":25450820}]},"active_addr":"172.21.15.1:6801/25450820","active_change":"2024-08-28T20:08:08.058088+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24143,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1240637972}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3007903725}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3206000469}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":664975483}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2698214043}]}]} 2024-08-28T20:16:37.453 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-28T20:16:37.453 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-28T20:16:37.454 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:16:37.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:37 smithi001 ceph-mon[20984]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-08-28T20:16:37.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:37 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2535857978' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-28T20:16:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:37 smithi121 ceph-mon[25248]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-08-28T20:16:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:37 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2535857978' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-28T20:16:37.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:37 smithi007 ceph-mon[25357]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-08-28T20:16:37.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:37 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2535857978' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-28T20:16:37.829 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 -- 172.21.15.1:0/2774096308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 msgr2=0x7f34f81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 --2- 172.21.15.1:0/2774096308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f81103c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009ca0 tx=0x7f34f002a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 -- 172.21.15.1:0/2774096308 shutdown_connections 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 --2- 172.21.15.1:0/2774096308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f81103c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 --2- 172.21.15.1:0/2774096308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8109240 0x7f34f8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 --2- 172.21.15.1:0/2774096308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8103900 0x7f34f8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 -- 172.21.15.1:0/2774096308 >> 172.21.15.1:0/2774096308 conn(0x7f34f807b5f0 msgr2=0x7f34f807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 -- 172.21.15.1:0/2774096308 shutdown_connections 2024-08-28T20:16:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.540+0000 7f34ff200640 1 -- 172.21.15.1:0/2774096308 wait complete. 2024-08-28T20:16:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.542+0000 7f34ff200640 1 Processor -- start 2024-08-28T20:16:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.542+0000 7f34ff200640 1 -- start start 2024-08-28T20:16:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ff200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8103900 0x7f34f80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8109240 0x7f34f80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ff200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ff200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f34f8113850 con 0x7f34f8109b90 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ff200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f34f81136d0 con 0x7f34f8109240 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ff200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34f81139d0 con 0x7f34f8103900 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34fd200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34fd200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50774/0 (socket says 172.21.15.1:50774) 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34fd200640 1 -- 172.21.15.1:0/59952639 learned_addr learned my addr 172.21.15.1:0/59952639 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34ef400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8109240 0x7f34f80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.543+0000 7f34f7e00640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8103900 0x7f34f80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34fd200640 1 -- 172.21.15.1:0/59952639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8103900 msgr2=0x7f34f80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34fd200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8103900 0x7f34f80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34fd200640 1 -- 172.21.15.1:0/59952639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8109240 msgr2=0x7f34f80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34fd200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8109240 0x7f34f80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34fd200640 1 -- 172.21.15.1:0/59952639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f81a8460 con 0x7f34f8109b90 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34f7e00640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8103900 0x7f34f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34fd200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f8075f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f34f0005cc0 tx=0x7f34f0031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0003b70 con 0x7f34f8109b90 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f00318f0 con 0x7f34f8109b90 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f81a86f0 con 0x7f34f8109b90 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f002f950 con 0x7f34f8109b90 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.544+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f81a8c30 con 0x7f34f8109b90 2024-08-28T20:16:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.546+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f8103d10 con 0x7f34f8109b90 2024-08-28T20:16:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.548+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f34f002fb10 con 0x7f34f8109b90 2024-08-28T20:16:38.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.549+0000 7f34f5600640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34dc0b4bc0 0x7f34dc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.549+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f34f0106620 con 0x7f34f8109b90 2024-08-28T20:16:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.550+0000 7f34f7e00640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34dc0b4bc0 0x7f34dc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.550+0000 7f34f7e00640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34dc0b4bc0 0x7f34dc0b70d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f34f8076f00 tx=0x7f34e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:38.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.552+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34f00cd580 con 0x7f34f8109b90 2024-08-28T20:16:38.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.748+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34f80767b0 con 0x7f34f8109b90 2024-08-28T20:16:38.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.750+0000 7f34f5600640 1 -- 172.21.15.1:0/59952639 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7f34f00cce80 con 0x7f34f8109b90 2024-08-28T20:16:38.752 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:38.752 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34dc0b4bc0 msgr2=0x7f34dc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34dc0b4bc0 0x7f34dc0b70d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f34f8076f00 tx=0x7f34e8005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 msgr2=0x7f34f8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f8075f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f34f0005cc0 tx=0x7f34f0031700 comp rx=0 tx=0).stop 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 shutdown_connections 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34dc0b4bc0 0x7f34dc0b70d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34f8109b90 0x7f34f8075f30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8109240 0x7f34f80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 --2- 172.21.15.1:0/59952639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34f8103900 0x7f34f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:38.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 >> 172.21.15.1:0/59952639 conn(0x7f34f807b5f0 msgr2=0x7f34f8107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:38.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 shutdown_connections 2024-08-28T20:16:38.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:38.752+0000 7f34ff200640 1 -- 172.21.15.1:0/59952639 wait complete. 2024-08-28T20:16:39.495 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-28T20:16:39.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:16:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:39 smithi001 ceph-mon[20984]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-08-28T20:16:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:39 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/59952639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:39 smithi121 ceph-mon[25248]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-08-28T20:16:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:39 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/59952639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:39 smithi007 ceph-mon[25357]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-08-28T20:16:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:39 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/59952639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:39.874 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 -- 172.21.15.1:0/2898191647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 msgr2=0x7fe9a0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 --2- 172.21.15.1:0/2898191647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a0109660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009900 tx=0x7fe98c02a410 comp rx=0 tx=0).stop 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 -- 172.21.15.1:0/2898191647 shutdown_connections 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 --2- 172.21.15.1:0/2898191647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a0109660 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 --2- 172.21.15.1:0/2898191647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9a0109ba0 0x7fe9a01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 --2- 172.21.15.1:0/2898191647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a0103910 0x7fe9a0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 -- 172.21.15.1:0/2898191647 >> 172.21.15.1:0/2898191647 conn(0x7fe9a00ff380 msgr2=0x7fe9a01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:40.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 -- 172.21.15.1:0/2898191647 shutdown_connections 2024-08-28T20:16:40.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.526+0000 7fe9a6600640 1 -- 172.21.15.1:0/2898191647 wait complete. 2024-08-28T20:16:40.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.528+0000 7fe9a6600640 1 Processor -- start 2024-08-28T20:16:40.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 -- start start 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9a0103910 0x7fe9a00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a0109ba0 0x7fe9a0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0113860 con 0x7fe9a0109250 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01136e0 con 0x7fe9a0109ba0 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.529+0000 7fe9a6600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01139e0 con 0x7fe9a0103910 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50798/0 (socket says 172.21.15.1:50798) 2024-08-28T20:16:40.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 -- 172.21.15.1:0/315948836 learned_addr learned my addr 172.21.15.1:0/315948836 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:40.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99f400640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9a0103910 0x7fe9a00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:40.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99fe00640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a0109ba0 0x7fe9a0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 -- 172.21.15.1:0/315948836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9a0103910 msgr2=0x7fe9a00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9a0103910 0x7fe9a00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 -- 172.21.15.1:0/315948836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a0109ba0 msgr2=0x7fe9a0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a0109ba0 0x7fe9a0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.530+0000 7fe99ea00640 1 -- 172.21.15.1:0/315948836 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a01a84f0 con 0x7fe9a0109250 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.531+0000 7fe99ea00640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a00759f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02a930 tx=0x7fe98c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.531+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c03f030 con 0x7fe9a0109250 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.531+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98c004490 con 0x7fe9a0109250 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.531+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a01a8780 con 0x7fe9a0109250 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.531+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c035070 con 0x7fe9a0109250 2024-08-28T20:16:40.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.531+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01a8cb0 con 0x7fe9a0109250 2024-08-28T20:16:40.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.533+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a0103d20 con 0x7fe9a0109250 2024-08-28T20:16:40.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.537+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fe98c042030 con 0x7fe9a0109250 2024-08-28T20:16:40.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.538+0000 7fe997e00640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe9840b4c40 0x7fe9840b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:40.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.538+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe98c1055b0 con 0x7fe9a0109250 2024-08-28T20:16:40.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.539+0000 7fe99f400640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe9840b4c40 0x7fe9840b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:40.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.539+0000 7fe99f400640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe9840b4c40 0x7fe9840b7150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0076f00 tx=0x7fe990005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:40.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.543+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe98c0cbec0 con 0x7fe9a0109250 2024-08-28T20:16:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.741+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9a002e430 con 0x7fe9a0109250 2024-08-28T20:16:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.743+0000 7fe997e00640 1 -- 172.21.15.1:0/315948836 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7fe98c0d0680 con 0x7fe9a0109250 2024-08-28T20:16:40.744 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:16:40.744 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:16:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe9840b4c40 msgr2=0x7fe9840b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe9840b4c40 0x7fe9840b7150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0076f00 tx=0x7fe990005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 msgr2=0x7fe9a00759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a00759f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02a930 tx=0x7fe98c031a20 comp rx=0 tx=0).stop 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 shutdown_connections 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe9840b4c40 0x7fe9840b7150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9a0109250 0x7fe9a00759f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a0109ba0 0x7fe9a0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 --2- 172.21.15.1:0/315948836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9a0103910 0x7fe9a00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 >> 172.21.15.1:0/315948836 conn(0x7fe9a00ff380 msgr2=0x7fe9a01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 shutdown_connections 2024-08-28T20:16:40.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:40.745+0000 7fe9a6600640 1 -- 172.21.15.1:0/315948836 wait complete. 2024-08-28T20:16:41.406 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-28T20:16:41.406 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-28T20:16:41.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-28T20:16:41.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-28T20:16:41.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-28T20:16:41.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-28T20:16:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-28T20:16:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-28T20:16:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-28T20:16:41.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-28T20:16:41.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-28T20:16:41.411 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-28T20:16:41.612 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:41 smithi001 ceph-mon[20984]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-08-28T20:16:41.612 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:41 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/315948836' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:41 smithi121 ceph-mon[25248]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-08-28T20:16:41.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:41 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/315948836' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:41.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:41 smithi007 ceph-mon[25357]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-08-28T20:16:41.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:41 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/315948836' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:16:42.415 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.550 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.580 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.825 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.831 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.836 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.837 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:42.842 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:43.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:43 smithi001 ceph-mon[20984]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-28T20:16:43.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 -- 172.21.15.1:0/2089703435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc0105b50 msgr2=0x7f0bc0105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/2089703435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc0105b50 0x7f0bc0105f60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009900 tx=0x7f0bb402a410 comp rx=0 tx=0).stop 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 -- 172.21.15.1:0/2089703435 shutdown_connections 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/2089703435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 0x7f0bc0112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/2089703435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bc010b490 0x7f0bc010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/2089703435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc0105b50 0x7f0bc0105f60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 -- 172.21.15.1:0/2089703435 >> 172.21.15.1:0/2089703435 conn(0x7f0bc0101580 msgr2=0x7f0bc01039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 -- 172.21.15.1:0/2089703435 shutdown_connections 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.542+0000 7f0bc7e00640 1 -- 172.21.15.1:0/2089703435 wait complete. 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.543+0000 7f0bc7e00640 1 Processor -- start 2024-08-28T20:16:43.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.543+0000 7f0bc7e00640 1 -- start start 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.543+0000 7f0bc7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bc0105b50 0x7f0bc019c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.543+0000 7f0bc7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc010b490 0x7f0bc019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 0x7f0bc01a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc7e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0115af0 con 0x7f0bc010b490 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0115970 con 0x7f0bc010bde0 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc7e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0115c70 con 0x7f0bc0105b50 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc4a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc010b490 0x7f0bc019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 0x7f0bc01a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 0x7f0bc01a1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:60852/0 (socket says 172.21.15.1:60852) 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc5e00640 1 -- 172.21.15.1:0/3172625386 learned_addr learned my addr 172.21.15.1:0/3172625386 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc5400640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bc0105b50 0x7f0bc019c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc4a00640 1 -- 172.21.15.1:0/3172625386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bc0105b50 msgr2=0x7f0bc019c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:43.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc4a00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bc0105b50 0x7f0bc019c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc4a00640 1 -- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 msgr2=0x7f0bc01a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc4a00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 0x7f0bc01a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc4a00640 1 -- 172.21.15.1:0/3172625386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc01a2430 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.544+0000 7f0bc5e00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bc010bde0 0x7f0bc01a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.545+0000 7f0bc4a00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc010b490 0x7f0bc019ca60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006c7c0 tx=0x7f0bac00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.545+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00cc40 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.545+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac00cde0 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.545+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc01a2720 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.545+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac018780 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.545+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc01a8e80 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.546+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bc00638f0 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.549+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f0bac010a90 con 0x7f0bc010b490 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.550+0000 7f0bbe000640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0ba80b4c40 0x7f0ba80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:43.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.550+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f0bac0e5d90 con 0x7f0bc010b490 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.550+0000 7f0bc5400640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0ba80b4c40 0x7f0ba80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.550+0000 7f0bbe000640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] conn(0x7f0ba80be7b0 0x7f0ba80c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.550+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 --> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bac027e50 con 0x7f0ba80be7b0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.550+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f0bac0e6140 con 0x7f0bc010b490 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.551+0000 7f0bc5e00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] conn(0x7f0ba80be7b0 0x7f0ba80c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.551+0000 7f0bc5400640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0ba80b4c40 0x7f0ba80b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4005ab0 tx=0x7f0bb4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.552+0000 7f0bc5e00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] conn(0x7f0ba80be7b0 0x7f0ba80c0ca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.553+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== osd.10 v2:172.21.15.7:6824/407515474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bac027e50 con 0x7f0ba80be7b0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.567+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 --> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bc0063cf0 con 0x7f0ba80be7b0 2024-08-28T20:16:43.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bbe000640 1 -- 172.21.15.1:0/3172625386 <== osd.10 v2:172.21.15.7:6824/407515474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0bc0063cf0 con 0x7f0ba80be7b0 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] conn(0x7f0ba80be7b0 msgr2=0x7f0ba80c0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] conn(0x7f0ba80be7b0 0x7f0ba80c0ca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0ba80b4c40 msgr2=0x7f0ba80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0ba80b4c40 0x7f0ba80b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4005ab0 tx=0x7f0bb4005a20 comp rx=0 tx=0).stop 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc010b490 msgr2=0x7f0bc019ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 --2- 172.21.15.1:0/3172625386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bc010b490 0x7f0bc019ca60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006c7c0 tx=0x7f0bac00ee50 comp rx=0 tx=0).stop 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc5e00640 1 -- 172.21.15.1:0/3172625386 reap_dead start 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 shutdown_connections 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.568+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 >> 172.21.15.1:0/3172625386 conn(0x7f0bc0101580 msgr2=0x7f0bc010ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.569+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 shutdown_connections 2024-08-28T20:16:43.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.569+0000 7f0bc7e00640 1 -- 172.21.15.1:0/3172625386 wait complete. 2024-08-28T20:16:43.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:43 smithi121 ceph-mon[25248]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-28T20:16:43.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:43 smithi007 ceph-mon[25357]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-28T20:16:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.787+0000 7fbfff200640 1 -- 172.21.15.1:0/3284523702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001099e0 msgr2=0x7fc000110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.787+0000 7fbfff200640 1 --2- 172.21.15.1:0/3284523702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001099e0 0x7fc000110210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009ca0 tx=0x7fbff802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.787+0000 7fbfff200640 1 -- 172.21.15.1:0/3284523702 shutdown_connections 2024-08-28T20:16:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.787+0000 7fbfff200640 1 --2- 172.21.15.1:0/3284523702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001099e0 0x7fc000110210 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.787+0000 7fbfff200640 1 --2- 172.21.15.1:0/3284523702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc000109090 0x7fc0001094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.787+0000 7fbfff200640 1 --2- 172.21.15.1:0/3284523702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc000103750 0x7fc000103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.788+0000 7fbfff200640 1 -- 172.21.15.1:0/3284523702 >> 172.21.15.1:0/3284523702 conn(0x7fc0000ff1a0 msgr2=0x7fc0001015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.788+0000 7fbfff200640 1 -- 172.21.15.1:0/3284523702 shutdown_connections 2024-08-28T20:16:44.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.788+0000 7fbfff200640 1 -- 172.21.15.1:0/3284523702 wait complete. 2024-08-28T20:16:44.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 Processor -- start 2024-08-28T20:16:44.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 -- start start 2024-08-28T20:16:44.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc000103750 0x7fc00019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc000109090 0x7fc00019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0001099e0 0x7fc00019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc000113690 con 0x7fc000109090 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc000113510 con 0x7fc000103750 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.789+0000 7fbfff200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc000113810 con 0x7fc0001099e0 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbff7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc000109090 0x7fc00019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbff7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc000109090 0x7fc00019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50890/0 (socket says 172.21.15.1:50890) 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbff7e00640 1 -- 172.21.15.1:0/3807173844 learned_addr learned my addr 172.21.15.1:0/3807173844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffde00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc000103750 0x7fc00019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffe800640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0001099e0 0x7fc00019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffde00640 1 -- 172.21.15.1:0/3807173844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0001099e0 msgr2=0x7fc00019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:44.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffde00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0001099e0 0x7fc00019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffde00640 1 -- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc000109090 msgr2=0x7fc00019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffde00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc000109090 0x7fc00019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbffde00640 1 -- 172.21.15.1:0/3807173844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00019ff90 con 0x7fc000103750 2024-08-28T20:16:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.790+0000 7fbff7e00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc000109090 0x7fc00019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.791+0000 7fbffde00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc000103750 0x7fc00019a020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbff000e9f0 tx=0x7fbff000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.791+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff000ccc0 con 0x7fc000103750 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.791+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbff00108e0 con 0x7fc000103750 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.791+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0001a0280 con 0x7fc000103750 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.791+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0018880 con 0x7fc000103750 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.791+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0001a69e0 con 0x7fc000103750 2024-08-28T20:16:44.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.792+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0000638b0 con 0x7fc000103750 2024-08-28T20:16:44.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.795+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fbff0010430 con 0x7fc000103750 2024-08-28T20:16:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.796+0000 7fbff6a00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbfe40b4bc0 0x7fbfe40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.796+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbff00e5e70 con 0x7fc000103750 2024-08-28T20:16:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.796+0000 7fbff7e00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbfe40b4bc0 0x7fbfe40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.796+0000 7fbff6a00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] conn(0x7fbfe40be730 0x7fbfe40c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.796+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 --> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbff0028ea0 con 0x7fbfe40be730 2024-08-28T20:16:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.797+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fbff00e6220 con 0x7fc000103750 2024-08-28T20:16:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.797+0000 7fbffe800640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] conn(0x7fbfe40be730 0x7fbfe40c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.797+0000 7fbff7e00640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbfe40b4bc0 0x7fbfe40b70d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc000108b90 tx=0x7fbfe8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.797+0000 7fbffe800640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] conn(0x7fbfe40be730 0x7fbfe40c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.798+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== osd.6 v2:172.21.15.1:6818/4096512062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbff0028ea0 con 0x7fbfe40be730 2024-08-28T20:16:44.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.813+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 --> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc000063d60 con 0x7fbfe40be730 2024-08-28T20:16:44.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.813+0000 7fbff6a00640 1 -- 172.21.15.1:0/3807173844 <== osd.6 v2:172.21.15.1:6818/4096512062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc000063d60 con 0x7fbfe40be730 2024-08-28T20:16:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] conn(0x7fbfe40be730 msgr2=0x7fbfe40c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] conn(0x7fbfe40be730 0x7fbfe40c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbfe40b4bc0 msgr2=0x7fbfe40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbfe40b4bc0 0x7fbfe40b70d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc000108b90 tx=0x7fbfe8005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc000103750 msgr2=0x7fc00019a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 --2- 172.21.15.1:0/3807173844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc000103750 0x7fc00019a020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbff000e9f0 tx=0x7fbff000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbffe800640 1 -- 172.21.15.1:0/3807173844 reap_dead start 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 shutdown_connections 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 >> 172.21.15.1:0/3807173844 conn(0x7fc0000ff1a0 msgr2=0x7fc0001015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 shutdown_connections 2024-08-28T20:16:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.814+0000 7fbfff200640 1 -- 172.21.15.1:0/3807173844 wait complete. 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 -- 172.21.15.1:0/1782732126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 msgr2=0x7ff864110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 --2- 172.21.15.1:0/1782732126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 0x7ff864110210 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009ca0 tx=0x7ff85c02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 -- 172.21.15.1:0/1782732126 shutdown_connections 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 --2- 172.21.15.1:0/1782732126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 0x7ff864110210 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 --2- 172.21.15.1:0/1782732126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff864109090 0x7ff8641094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 --2- 172.21.15.1:0/1782732126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 0x7ff864103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.676+0000 7ff863e00640 1 -- 172.21.15.1:0/1782732126 >> 172.21.15.1:0/1782732126 conn(0x7ff8640ff1e0 msgr2=0x7ff864101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.677+0000 7ff863e00640 1 -- 172.21.15.1:0/1782732126 shutdown_connections 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.677+0000 7ff863e00640 1 -- 172.21.15.1:0/1782732126 wait complete. 2024-08-28T20:16:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.678+0000 7ff863e00640 1 Processor -- start 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.678+0000 7ff863e00640 1 -- start start 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 0x7ff864074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff864109090 0x7ff86406deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 0x7ff86406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff864113690 con 0x7ff8641099e0 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff864113510 con 0x7ff864103750 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff864113810 con 0x7ff864109090 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff862a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 0x7ff864074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff863400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 0x7ff86406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff862a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 0x7ff864074be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:60878/0 (socket says 172.21.15.1:60878) 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff862a00640 1 -- 172.21.15.1:0/2404294215 learned_addr learned my addr 172.21.15.1:0/2404294215 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.679+0000 7ff862000640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff864109090 0x7ff86406deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff862a00640 1 -- 172.21.15.1:0/2404294215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff864109090 msgr2=0x7ff86406deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff862a00640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff864109090 0x7ff86406deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff862a00640 1 -- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 msgr2=0x7ff86406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff862a00640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8641099e0 0x7ff86406e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff862a00640 1 -- 172.21.15.1:0/2404294215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86406ec30 con 0x7ff864103750 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff862a00640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 0x7ff864074be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff85400ea60 tx=0x7ff85400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85400cde0 con 0x7ff864103750 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8540035f0 con 0x7ff864103750 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8640738b0 con 0x7ff864103750 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854010690 con 0x7ff864103750 2024-08-28T20:16:45.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.680+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff864073df0 con 0x7ff864103750 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.681+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff864074400 con 0x7ff864103750 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.684+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7ff8540037a0 con 0x7ff864103750 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.685+0000 7ff85b400640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff8480b4bc0 0x7ff8480b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff8540e5a30 con 0x7ff864103750 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff862000640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff8480b4bc0 0x7ff8480b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff85b400640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] conn(0x7ff8480be730 0x7ff8480c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 --> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff854022e50 con 0x7ff8480be730 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff8540e5de0 con 0x7ff864103750 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff863400640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] conn(0x7ff8480be730 0x7ff8480c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.686+0000 7ff862000640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff8480b4bc0 0x7ff8480b70d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8500095f0 tx=0x7ff850005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.687+0000 7ff863400640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] conn(0x7ff8480be730 0x7ff8480c0c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.688+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== osd.0 v2:172.21.15.1:6802/62453617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff854022e50 con 0x7ff8480be730 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.706+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 --> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8641049d0 con 0x7ff8480be730 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.706+0000 7ff85b400640 1 -- 172.21.15.1:0/2404294215 <== osd.0 v2:172.21.15.1:6802/62453617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff8641049d0 con 0x7ff8480be730 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] conn(0x7ff8480be730 msgr2=0x7ff8480c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] conn(0x7ff8480be730 0x7ff8480c0c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff8480b4bc0 msgr2=0x7ff8480b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff8480b4bc0 0x7ff8480b70d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8500095f0 tx=0x7ff850005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 msgr2=0x7ff864074be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 --2- 172.21.15.1:0/2404294215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff864103750 0x7ff864074be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff85400ea60 tx=0x7ff85400ef20 comp rx=0 tx=0).stop 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863400640 1 -- 172.21.15.1:0/2404294215 reap_dead start 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 shutdown_connections 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 >> 172.21.15.1:0/2404294215 conn(0x7ff8640ff1e0 msgr2=0x7ff864108730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 shutdown_connections 2024-08-28T20:16:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:44.707+0000 7ff863e00640 1 -- 172.21.15.1:0/2404294215 wait complete. 2024-08-28T20:16:45.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:45 smithi001 ceph-mon[20984]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-28T20:16:45.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:45 smithi121 ceph-mon[25248]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-28T20:16:45.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:45 smithi007 ceph-mon[25357]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-28T20:16:46.282 INFO:teuthology.orchestra.run.smithi001.stdout:34359738448 2024-08-28T20:16:46.283 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-28T20:16:46.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.520+0000 7f831cc00640 1 -- 172.21.15.1:0/3942184967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318103750 msgr2=0x7f8318103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:46.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.520+0000 7f831cc00640 1 --2- 172.21.15.1:0/3942184967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318103750 0x7f8318103b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8308009900 tx=0x7f830802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.520+0000 7f831cc00640 1 -- 172.21.15.1:0/3942184967 shutdown_connections 2024-08-28T20:16:46.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.520+0000 7f831cc00640 1 --2- 172.21.15.1:0/3942184967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83181099e0 0x7f8318110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.520+0000 7f831cc00640 1 --2- 172.21.15.1:0/3942184967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8318109090 0x7f83181094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.521+0000 7f831cc00640 1 --2- 172.21.15.1:0/3942184967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318103750 0x7f8318103b60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.521+0000 7f831cc00640 1 -- 172.21.15.1:0/3942184967 >> 172.21.15.1:0/3942184967 conn(0x7f83180ff1e0 msgr2=0x7f8318101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:46.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.521+0000 7f831cc00640 1 -- 172.21.15.1:0/3942184967 shutdown_connections 2024-08-28T20:16:46.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.521+0000 7f831cc00640 1 -- 172.21.15.1:0/3942184967 wait complete. 2024-08-28T20:16:46.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.522+0000 7f831cc00640 1 Processor -- start 2024-08-28T20:16:46.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.522+0000 7f831cc00640 1 -- start start 2024-08-28T20:16:46.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.522+0000 7f831cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8318103750 0x7f831819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:46.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f831cc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318109090 0x7f831819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f831cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83181099e0 0x7f83181a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f831cc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8318113690 con 0x7f8318109090 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f831cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8318113510 con 0x7f8318103750 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f831cc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8318113810 con 0x7f83181099e0 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f8317400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8318103750 0x7f831819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f8317e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83181099e0 0x7f83181a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f8317400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8318103750 0x7f831819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:60914/0 (socket says 172.21.15.1:60914) 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f8317400640 1 -- 172.21.15.1:0/3503062927 learned_addr learned my addr 172.21.15.1:0/3503062927 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:46.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.523+0000 7f830fe00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318109090 0x7f831819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317400640 1 -- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83181099e0 msgr2=0x7f83181a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317400640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83181099e0 0x7f83181a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317400640 1 -- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318109090 msgr2=0x7f831819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317400640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8318109090 0x7f831819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317400640 1 -- 172.21.15.1:0/3503062927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83181a2230 con 0x7f8318103750 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317e00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83181099e0 0x7f83181a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:16:46.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8317400640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8318103750 0x7f831819c2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8308005940 tx=0x7f83080040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:46.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.524+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830803f030 con 0x7f8318103750 2024-08-28T20:16:46.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.525+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83181a24c0 con 0x7f8318103750 2024-08-28T20:16:46.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.525+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83080044c0 con 0x7f8318103750 2024-08-28T20:16:46.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.525+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308035070 con 0x7f8318103750 2024-08-28T20:16:46.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.525+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181a8c80 con 0x7f8318103750 2024-08-28T20:16:46.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.526+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8318076dc0 con 0x7f8318103750 2024-08-28T20:16:46.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.528+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f8308042030 con 0x7f8318103750 2024-08-28T20:16:46.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.531+0000 7f8314c00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82fc0b4bc0 0x7f82fc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:46.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.531+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8308105700 con 0x7f8318103750 2024-08-28T20:16:46.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.531+0000 7f830fe00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82fc0b4bc0 0x7f82fc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:46.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.531+0000 7f8314c00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] conn(0x7f82fc0be730 0x7f82fc0c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:46.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.531+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 --> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f830800b0b0 con 0x7f82fc0be730 2024-08-28T20:16:46.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.531+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f830810c050 con 0x7f8318103750 2024-08-28T20:16:46.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.532+0000 7f8317e00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] conn(0x7f82fc0be730 0x7f82fc0c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:46.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.532+0000 7f830fe00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82fc0b4bc0 0x7f82fc0b70d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8318110640 tx=0x7f8300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:46.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.532+0000 7f8317e00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] conn(0x7f82fc0be730 0x7f82fc0c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:46.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.533+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== osd.8 v2:172.21.15.121:6816/989579690 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f830800b0b0 con 0x7f82fc0be730 2024-08-28T20:16:46.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.548+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 --> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83181049d0 con 0x7f82fc0be730 2024-08-28T20:16:46.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.548+0000 7f8314c00640 1 -- 172.21.15.1:0/3503062927 <== osd.8 v2:172.21.15.121:6816/989579690 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f83181049d0 con 0x7f82fc0be730 2024-08-28T20:16:46.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] conn(0x7f82fc0be730 msgr2=0x7f82fc0c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:46.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] conn(0x7f82fc0be730 0x7f82fc0c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82fc0b4bc0 msgr2=0x7f82fc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82fc0b4bc0 0x7f82fc0b70d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8318110640 tx=0x7f8300005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8318103750 msgr2=0x7f831819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 --2- 172.21.15.1:0/3503062927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8318103750 0x7f831819c2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8308005940 tx=0x7f83080040c0 comp rx=0 tx=0).stop 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f8317e00640 1 -- 172.21.15.1:0/3503062927 reap_dead start 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 shutdown_connections 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 >> 172.21.15.1:0/3503062927 conn(0x7f83180ff1e0 msgr2=0x7f8318075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.549+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 shutdown_connections 2024-08-28T20:16:46.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:46.550+0000 7f831cc00640 1 -- 172.21.15.1:0/3503062927 wait complete. 2024-08-28T20:16:47.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 -- 172.21.15.1:0/3519474226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102b50 msgr2=0x7f31b810f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 --2- 172.21.15.1:0/3519474226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102b50 0x7f31b810f870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009900 tx=0x7f31a802a480 comp rx=0 tx=0).stop 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 -- 172.21.15.1:0/3519474226 shutdown_connections 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 --2- 172.21.15.1:0/3519474226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b810fdb0 0x7f31b81121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 --2- 172.21.15.1:0/3519474226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102b50 0x7f31b810f870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 --2- 172.21.15.1:0/3519474226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102200 0x7f31b8102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 -- 172.21.15.1:0/3519474226 >> 172.21.15.1:0/3519474226 conn(0x7f31b80fe060 msgr2=0x7f31b81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 -- 172.21.15.1:0/3519474226 shutdown_connections 2024-08-28T20:16:47.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.331+0000 7f31bf200640 1 -- 172.21.15.1:0/3519474226 wait complete. 2024-08-28T20:16:47.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.333+0000 7f31bf200640 1 Processor -- start 2024-08-28T20:16:47.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.333+0000 7f31bf200640 1 -- start start 2024-08-28T20:16:47.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.333+0000 7f31bf200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102200 0x7f31b819c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.333+0000 7f31bf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102b50 0x7f31b819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.333+0000 7f31bf200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b810fdb0 0x7f31b81a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.333+0000 7f31bf200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81157e0 con 0x7f31b810fdb0 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bf200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8115660 con 0x7f31b8102b50 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bf200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8115960 con 0x7f31b8102200 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102b50 0x7f31b819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31be800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b810fdb0 0x7f31b81a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102b50 0x7f31b819c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56606/0 (socket says 172.21.15.1:56606) 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 -- 172.21.15.1:0/2062042278 learned_addr learned my addr 172.21.15.1:0/2062042278 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:47.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bde00640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102200 0x7f31b819c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 -- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102200 msgr2=0x7f31b819c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8102200 0x7f31b819c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 -- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b810fdb0 msgr2=0x7f31b81a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31b810fdb0 0x7f31b81a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.334+0000 7f31bd400640 1 -- 172.21.15.1:0/2062042278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b81a2140 con 0x7f31b8102b50 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.335+0000 7f31bd400640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102b50 0x7f31b819c770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005940 tx=0x7f31a8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:47.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.335+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a803f030 con 0x7f31b8102b50 2024-08-28T20:16:47.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.335+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b81a23d0 con 0x7f31b8102b50 2024-08-28T20:16:47.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.335+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31a8003aa0 con 0x7f31b8102b50 2024-08-28T20:16:47.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.335+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b81a8b90 con 0x7f31b8102b50 2024-08-28T20:16:47.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.335+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8035070 con 0x7f31b8102b50 2024-08-28T20:16:47.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.336+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f319c001060 con 0x7f31b8102b50 2024-08-28T20:16:47.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.339+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f31a8042030 con 0x7f31b8102b50 2024-08-28T20:16:47.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.340+0000 7f31b2a00640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31a00b4bc0 0x7f31a00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.340+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f31a8105d30 con 0x7f31b8102b50 2024-08-28T20:16:47.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.341+0000 7f31bde00640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31a00b4bc0 0x7f31a00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.341+0000 7f31b2a00640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] conn(0x7f31a00be730 0x7f31a00c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.341+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 --> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31a8040e70 con 0x7f31a00be730 2024-08-28T20:16:47.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.341+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f31a81060e0 con 0x7f31b8102b50 2024-08-28T20:16:47.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.341+0000 7f31be800640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] conn(0x7f31a00be730 0x7f31a00c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.341+0000 7f31bde00640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31a00b4bc0 0x7f31a00b70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009bd0 tx=0x7f31ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:47.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.342+0000 7f31be800640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] conn(0x7f31a00be730 0x7f31a00c0c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:47.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.343+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== osd.5 v2:172.21.15.121:6808/506146623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31a8040e70 con 0x7f31a00be730 2024-08-28T20:16:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.357+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 --> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f319c002e00 con 0x7f31a00be730 2024-08-28T20:16:47.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.358+0000 7f31b2a00640 1 -- 172.21.15.1:0/2062042278 <== osd.5 v2:172.21.15.121:6808/506146623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f319c002e00 con 0x7f31a00be730 2024-08-28T20:16:47.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.358+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] conn(0x7f31a00be730 msgr2=0x7f31a00c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.358+0000 7f31bf200640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] conn(0x7f31a00be730 0x7f31a00c0c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31a00b4bc0 msgr2=0x7f31a00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31a00b4bc0 0x7f31a00b70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009bd0 tx=0x7f31ac005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102b50 msgr2=0x7f31b819c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 --2- 172.21.15.1:0/2062042278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31b8102b50 0x7f31b819c770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005940 tx=0x7f31a8004270 comp rx=0 tx=0).stop 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31be800640 1 -- 172.21.15.1:0/2062042278 reap_dead start 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 shutdown_connections 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 >> 172.21.15.1:0/2062042278 conn(0x7f31b80fe060 msgr2=0x7f31b8111f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 shutdown_connections 2024-08-28T20:16:47.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.359+0000 7f31bf200640 1 -- 172.21.15.1:0/2062042278 wait complete. 2024-08-28T20:16:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 -- 172.21.15.1:0/813590763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54103730 msgr2=0x7f6b54103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 --2- 172.21.15.1:0/813590763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54103730 0x7f6b54103b40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009900 tx=0x7f6b4802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.580 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:47 smithi001 ceph-mon[20984]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 -- 172.21.15.1:0/813590763 shutdown_connections 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 --2- 172.21.15.1:0/813590763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b541099c0 0x7f6b541101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 --2- 172.21.15.1:0/813590763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b54109070 0x7f6b54109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 --2- 172.21.15.1:0/813590763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54103730 0x7f6b54103b40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 -- 172.21.15.1:0/813590763 >> 172.21.15.1:0/813590763 conn(0x7f6b540ff180 msgr2=0x7f6b541015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 -- 172.21.15.1:0/813590763 shutdown_connections 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.577+0000 7f6b5b000640 1 -- 172.21.15.1:0/813590763 wait complete. 2024-08-28T20:16:47.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.578+0000 7f6b5b000640 1 Processor -- start 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.578+0000 7f6b5b000640 1 -- start start 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b54103730 0x7f6b5419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5b000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54109070 0x7f6b5419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b541099c0 0x7f6b5419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5b000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54113690 con 0x7f6b54109070 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54113510 con 0x7f6b541099c0 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54113810 con 0x7f6b54103730 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b59200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54109070 0x7f6b5419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b59c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b54103730 0x7f6b5419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b59c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b54103730 0x7f6b5419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49890/0 (socket says 172.21.15.1:49890) 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b59c00640 1 -- 172.21.15.1:0/3937392606 learned_addr learned my addr 172.21.15.1:0/3937392606 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.579+0000 7f6b5a600640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b541099c0 0x7f6b5419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59200640 1 -- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b54103730 msgr2=0x7f6b5419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59200640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b54103730 0x7f6b5419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59200640 1 -- 172.21.15.1:0/3937392606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b541099c0 msgr2=0x7f6b5419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59200640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b541099c0 0x7f6b5419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59200640 1 -- 172.21.15.1:0/3937392606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5419fff0 con 0x7f6b54109070 2024-08-28T20:16:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59c00640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b54103730 0x7f6b5419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:47.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b59200640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54109070 0x7f6b5419a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b5406c5d0 tx=0x7f6b4000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000cd00 con 0x7f6b54109070 2024-08-28T20:16:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b400035f0 con 0x7f6b54109070 2024-08-28T20:16:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b541a02e0 con 0x7f6b54109070 2024-08-28T20:16:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40010690 con 0x7f6b54109070 2024-08-28T20:16:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.580+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b541a6a40 con 0x7f6b54109070 2024-08-28T20:16:47.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.581+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b540638b0 con 0x7f6b54109070 2024-08-28T20:16:47.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.585+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f6b400037a0 con 0x7f6b54109070 2024-08-28T20:16:47.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.586+0000 7f6b52000640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b3c0b4bc0 0x7f6b3c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.587+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f6b400e5b60 con 0x7f6b54109070 2024-08-28T20:16:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.587+0000 7f6b59c00640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b3c0b4bc0 0x7f6b3c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.587+0000 7f6b52000640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] conn(0x7f6b3c0be730 0x7f6b3c0c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:47.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.587+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 --> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b40018e50 con 0x7f6b3c0be730 2024-08-28T20:16:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.587+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f6b400e5f10 con 0x7f6b54109070 2024-08-28T20:16:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.587+0000 7f6b5a600640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] conn(0x7f6b3c0be730 0x7f6b3c0c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.588+0000 7f6b59c00640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b3c0b4bc0 0x7f6b3c0b70d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b48031440 tx=0x7f6b480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:47.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.588+0000 7f6b5a600640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] conn(0x7f6b3c0be730 0x7f6b3c0c0c20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:47.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.589+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== osd.2 v2:172.21.15.121:6800/1023461840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b40018e50 con 0x7f6b3c0be730 2024-08-28T20:16:47.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.603+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 --> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b54063d30 con 0x7f6b3c0be730 2024-08-28T20:16:47.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b52000640 1 -- 172.21.15.1:0/3937392606 <== osd.2 v2:172.21.15.121:6800/1023461840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6b54063d30 con 0x7f6b3c0be730 2024-08-28T20:16:47.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] conn(0x7f6b3c0be730 msgr2=0x7f6b3c0c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] conn(0x7f6b3c0be730 0x7f6b3c0c0c20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b3c0b4bc0 msgr2=0x7f6b3c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f6b3c0b4bc0 0x7f6b3c0b70d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b48031440 tx=0x7f6b480058d0 comp rx=0 tx=0).stop 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54109070 msgr2=0x7f6b5419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 --2- 172.21.15.1:0/3937392606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b54109070 0x7f6b5419a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b5406c5d0 tx=0x7f6b4000ee50 comp rx=0 tx=0).stop 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5a600640 1 -- 172.21.15.1:0/3937392606 reap_dead start 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 shutdown_connections 2024-08-28T20:16:47.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.604+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 >> 172.21.15.1:0/3937392606 conn(0x7f6b540ff180 msgr2=0x7f6b541015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:47.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.605+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 shutdown_connections 2024-08-28T20:16:47.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.605+0000 7f6b5b000640 1 -- 172.21.15.1:0/3937392606 wait complete. 2024-08-28T20:16:47.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:47 smithi121 ceph-mon[25248]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-28T20:16:47.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:47 smithi007 ceph-mon[25357]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-28T20:16:48.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.404+0000 7faffa800640 1 -- 172.21.15.1:0/3897779666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff410ff90 msgr2=0x7faff41123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.404+0000 7faffa800640 1 --2- 172.21.15.1:0/3897779666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff410ff90 0x7faff41123b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafec009be0 tx=0x7fafec02a750 comp rx=0 tx=0).stop 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 -- 172.21.15.1:0/3897779666 shutdown_connections 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 --2- 172.21.15.1:0/3897779666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff410ff90 0x7faff41123b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 --2- 172.21.15.1:0/3897779666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faff4102d30 0x7faff410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 --2- 172.21.15.1:0/3897779666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faff41023e0 0x7faff41027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 -- 172.21.15.1:0/3897779666 >> 172.21.15.1:0/3897779666 conn(0x7faff40794d0 msgr2=0x7faff40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 -- 172.21.15.1:0/3897779666 shutdown_connections 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.405+0000 7faffa800640 1 -- 172.21.15.1:0/3897779666 wait complete. 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 Processor -- start 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 -- start start 2024-08-28T20:16:48.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff41023e0 0x7faff419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faff4102d30 0x7faff419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faff410ff90 0x7faff41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faff4115a00 con 0x7faff410ff90 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faff4115880 con 0x7faff4102d30 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.406+0000 7faffa800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faff4115b80 con 0x7faff41023e0 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff41023e0 0x7faff419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faff410ff90 0x7faff41a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff41023e0 0x7faff419c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:46708/0 (socket says 172.21.15.1:46708) 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 -- 172.21.15.1:0/2516575646 learned_addr learned my addr 172.21.15.1:0/2516575646 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7fafebe00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faff4102d30 0x7faff419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 -- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faff4102d30 msgr2=0x7faff419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faff4102d30 0x7faff419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 -- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faff410ff90 msgr2=0x7faff41a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faff410ff90 0x7faff41a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 -- 172.21.15.1:0/2516575646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff41a22a0 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.407+0000 7faff3400640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff41023e0 0x7faff419c330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafe400e9c0 tx=0x7fafe400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.408+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe400cde0 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.408+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff41a2590 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.408+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafe40035f0 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.408+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4010690 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.408+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff41a8cf0 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.409+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faff4111cf0 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.411+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fafe4004000 con 0x7faff41023e0 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.412+0000 7faff0c00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fafd80b4bc0 0x7fafd80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.413+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fafe40e5910 con 0x7faff41023e0 2024-08-28T20:16:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.413+0000 7fafebe00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fafd80b4bc0 0x7fafd80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.413+0000 7faff0c00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] conn(0x7fafd80be730 0x7fafd80c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.413+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 --> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafe4023e50 con 0x7fafd80be730 2024-08-28T20:16:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.413+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fafe40e5cc0 con 0x7faff41023e0 2024-08-28T20:16:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.413+0000 7faff3e00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] conn(0x7fafd80be730 0x7fafd80c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.414+0000 7fafebe00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fafd80b4bc0 0x7fafd80b70d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faff4103ec0 tx=0x7fafdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.414+0000 7faff3e00640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] conn(0x7fafd80be730 0x7fafd80c0c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.415+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== osd.1 v2:172.21.15.7:6800/512270550 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafe4023e50 con 0x7fafd80be730 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.430+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 --> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faff406b130 con 0x7fafd80be730 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.430+0000 7faff0c00640 1 -- 172.21.15.1:0/2516575646 <== osd.1 v2:172.21.15.7:6800/512270550 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faff406b130 con 0x7fafd80be730 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] conn(0x7fafd80be730 msgr2=0x7fafd80c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] conn(0x7fafd80be730 0x7fafd80c0c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fafd80b4bc0 msgr2=0x7fafd80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fafd80b4bc0 0x7fafd80b70d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faff4103ec0 tx=0x7fafdc005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff41023e0 msgr2=0x7faff419c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 --2- 172.21.15.1:0/2516575646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faff41023e0 0x7faff419c330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafe400e9c0 tx=0x7fafe400ee80 comp rx=0 tx=0).stop 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faff3e00640 1 -- 172.21.15.1:0/2516575646 reap_dead start 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 shutdown_connections 2024-08-28T20:16:48.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 >> 172.21.15.1:0/2516575646 conn(0x7faff40794d0 msgr2=0x7faff4111290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 shutdown_connections 2024-08-28T20:16:48.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:43.431+0000 7faffa800640 1 -- 172.21.15.1:0/2516575646 wait complete. 2024-08-28T20:16:48.622 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:48 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:16:48.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:48 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:16:48.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 -- 172.21.15.1:0/16350732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 msgr2=0x7fb828109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 --2- 172.21.15.1:0/16350732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 0x7fb828109650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb814009900 tx=0x7fb81402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 -- 172.21.15.1:0/16350732 shutdown_connections 2024-08-28T20:16:48.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 --2- 172.21.15.1:0/16350732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb828109b90 0x7fb8281103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 --2- 172.21.15.1:0/16350732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 0x7fb828109650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 --2- 172.21.15.1:0/16350732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 0x7fb828103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 -- 172.21.15.1:0/16350732 >> 172.21.15.1:0/16350732 conn(0x7fb82807b5f0 msgr2=0x7fb82807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:48.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 -- 172.21.15.1:0/16350732 shutdown_connections 2024-08-28T20:16:48.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.794+0000 7fb82e200640 1 -- 172.21.15.1:0/16350732 wait complete. 2024-08-28T20:16:48.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 Processor -- start 2024-08-28T20:16:48.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 -- start start 2024-08-28T20:16:48.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 0x7fb82819c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 0x7fb82819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb828109b90 0x7fb8281a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb8281138a0 con 0x7fb828109b90 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb828113720 con 0x7fb828103900 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.796+0000 7fb82e200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb828113a20 con 0x7fb828109240 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 0x7fb82819c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 0x7fb82819c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56636/0 (socket says 172.21.15.1:56636) 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 -- 172.21.15.1:0/3408813991 learned_addr learned my addr 172.21.15.1:0/3408813991 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb826a00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 0x7fb82819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827e00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb828109b90 0x7fb8281a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 -- 172.21.15.1:0/3408813991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 msgr2=0x7fb82819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb828109240 0x7fb82819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 -- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb828109b90 msgr2=0x7fb8281a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb828109b90 0x7fb8281a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 -- 172.21.15.1:0/3408813991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8281a2380 con 0x7fb828103900 2024-08-28T20:16:48.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.797+0000 7fb827400640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 0x7fb82819c410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb81800e9f0 tx=0x7fb81800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:48.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.798+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81800cd80 con 0x7fb828103900 2024-08-28T20:16:48.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.798+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8281a2670 con 0x7fb828103900 2024-08-28T20:16:48.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.798+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8180108e0 con 0x7fb828103900 2024-08-28T20:16:48.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.798+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818018980 con 0x7fb828103900 2024-08-28T20:16:48.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.798+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8281a8dd0 con 0x7fb828103900 2024-08-28T20:16:48.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.799+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb828105a30 con 0x7fb828103900 2024-08-28T20:16:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.801+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fb818010430 con 0x7fb828103900 2024-08-28T20:16:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.803+0000 7fb81fe00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb80c0b4bc0 0x7fb80c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.803+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb8180e6240 con 0x7fb828103900 2024-08-28T20:16:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.803+0000 7fb826a00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb80c0b4bc0 0x7fb80c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.803+0000 7fb81fe00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] conn(0x7fb80c0be730 0x7fb80c0c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.803+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 --> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb818015e80 con 0x7fb80c0be730 2024-08-28T20:16:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.803+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fb8180e65f0 con 0x7fb828103900 2024-08-28T20:16:48.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.804+0000 7fb827e00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] conn(0x7fb80c0be730 0x7fb80c0c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.804+0000 7fb826a00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb80c0b4bc0 0x7fb80c0b70d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb81402a9e0 tx=0x7fb814005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.804+0000 7fb827e00640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] conn(0x7fb80c0be730 0x7fb80c0c0c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:48.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.805+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== osd.3 v2:172.21.15.1:6810/3058293665 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb818015e80 con 0x7fb80c0be730 2024-08-28T20:16:48.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:48 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:16:48.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.821+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 --> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb828104b80 con 0x7fb80c0be730 2024-08-28T20:16:48.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.821+0000 7fb81fe00640 1 -- 172.21.15.1:0/3408813991 <== osd.3 v2:172.21.15.1:6810/3058293665 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb828104b80 con 0x7fb80c0be730 2024-08-28T20:16:48.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] conn(0x7fb80c0be730 msgr2=0x7fb80c0c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] conn(0x7fb80c0be730 0x7fb80c0c0c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb80c0b4bc0 msgr2=0x7fb80c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb80c0b4bc0 0x7fb80c0b70d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb81402a9e0 tx=0x7fb814005a20 comp rx=0 tx=0).stop 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 msgr2=0x7fb82819c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 --2- 172.21.15.1:0/3408813991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb828103900 0x7fb82819c410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb81800e9f0 tx=0x7fb81800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb827e00640 1 -- 172.21.15.1:0/3408813991 reap_dead start 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 shutdown_connections 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 >> 172.21.15.1:0/3408813991 conn(0x7fb82807b5f0 msgr2=0x7fb828104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 shutdown_connections 2024-08-28T20:16:48.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:48.822+0000 7fb82e200640 1 -- 172.21.15.1:0/3408813991 wait complete. 2024-08-28T20:16:49.140 INFO:teuthology.orchestra.run.smithi001.stdout:55834574922 2024-08-28T20:16:49.140 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-28T20:16:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 -- 172.21.15.1:0/1852614032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750109bb0 msgr2=0x7fa7501103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 --2- 172.21.15.1:0/1852614032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750109bb0 0x7fa7501103e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa748009ca0 tx=0x7fa74802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 -- 172.21.15.1:0/1852614032 shutdown_connections 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 --2- 172.21.15.1:0/1852614032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750109bb0 0x7fa7501103e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 --2- 172.21.15.1:0/1852614032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa750109260 0x7fa750109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 --2- 172.21.15.1:0/1852614032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa750103920 0x7fa750103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 -- 172.21.15.1:0/1852614032 >> 172.21.15.1:0/1852614032 conn(0x7fa7500ff330 msgr2=0x7fa750101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.252+0000 7fa758600640 1 -- 172.21.15.1:0/1852614032 shutdown_connections 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.253+0000 7fa758600640 1 -- 172.21.15.1:0/1852614032 wait complete. 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.253+0000 7fa758600640 1 Processor -- start 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 -- start start 2024-08-28T20:16:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750103920 0x7fa7500754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa750109260 0x7fa7500759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa750109bb0 0x7fa750075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501138c0 con 0x7fa750103920 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa750113740 con 0x7fa750109bb0 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa758600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa750113a40 con 0x7fa750109260 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa755c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750103920 0x7fa7500754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa755c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750103920 0x7fa7500754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40798/0 (socket says 172.21.15.1:40798) 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.254+0000 7fa755c00640 1 -- 172.21.15.1:0/4268935222 learned_addr learned my addr 172.21.15.1:0/4268935222 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755200640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa750109260 0x7fa7500759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa756600640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa750109bb0 0x7fa750075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755c00640 1 -- 172.21.15.1:0/4268935222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa750109260 msgr2=0x7fa7500759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755c00640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa750109260 0x7fa7500759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755c00640 1 -- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa750109bb0 msgr2=0x7fa750075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755c00640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa750109bb0 0x7fa750075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755c00640 1 -- 172.21.15.1:0/4268935222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7501a84d0 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755200640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa750109260 0x7fa7500759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.255+0000 7fa755c00640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750103920 0x7fa7500754b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e9f0 tx=0x7fa74400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.256+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400cd80 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.256+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7440054d0 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.256+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7501a87c0 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.256+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744010690 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.256+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7501a8cb0 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.257+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7500638f0 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.260+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fa744004e30 con 0x7fa750103920 2024-08-28T20:16:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.261+0000 7fa74e000640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa7380b4bc0 0x7fa7380b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.261+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa7440e5b40 con 0x7fa750103920 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.261+0000 7fa755200640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa7380b4bc0 0x7fa7380b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.262+0000 7fa74e000640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] conn(0x7fa7380be730 0x7fa7380c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.262+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 --> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa744025ea0 con 0x7fa7380be730 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.262+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa7440e5ef0 con 0x7fa750103920 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.262+0000 7fa756600640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] conn(0x7fa7380be730 0x7fa7380c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.262+0000 7fa755200640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa7380b4bc0 0x7fa7380b70d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa750101b70 tx=0x7fa73c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.263+0000 7fa756600640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] conn(0x7fa7380be730 0x7fa7380c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.264+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== osd.4 v2:172.21.15.7:6808/1548276367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa744025ea0 con 0x7fa7380be730 2024-08-28T20:16:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.278+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 --> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa750063d70 con 0x7fa7380be730 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa74e000640 1 -- 172.21.15.1:0/4268935222 <== osd.4 v2:172.21.15.7:6808/1548276367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa750063d70 con 0x7fa7380be730 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] conn(0x7fa7380be730 msgr2=0x7fa7380c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] conn(0x7fa7380be730 0x7fa7380c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa7380b4bc0 msgr2=0x7fa7380b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa7380b4bc0 0x7fa7380b70d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa750101b70 tx=0x7fa73c005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750103920 msgr2=0x7fa7500754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 --2- 172.21.15.1:0/4268935222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa750103920 0x7fa7500754b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e9f0 tx=0x7fa74400edf0 comp rx=0 tx=0).stop 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa756600640 1 -- 172.21.15.1:0/4268935222 reap_dead start 2024-08-28T20:16:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.279+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 shutdown_connections 2024-08-28T20:16:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.280+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 >> 172.21.15.1:0/4268935222 conn(0x7fa7500ff330 msgr2=0x7fa750106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.280+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 shutdown_connections 2024-08-28T20:16:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:47.280+0000 7fa758600640 1 -- 172.21.15.1:0/4268935222 wait complete. 2024-08-28T20:16:49.699 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:49 smithi001 ceph-mon[20984]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:16:49.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:49 smithi121 ceph-mon[25248]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:16:49.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:49 smithi007 ceph-mon[25357]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:16:50.361 INFO:teuthology.orchestra.run.smithi001.stdout:176093659186 2024-08-28T20:16:50.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 -- 172.21.15.1:0/2472205355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8105b20 msgr2=0x7f43b8105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 --2- 172.21.15.1:0/2472205355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8105b20 0x7f43b8105f30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009860 tx=0x7f43ac02a340 comp rx=0 tx=0).stop 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 -- 172.21.15.1:0/2472205355 shutdown_connections 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 --2- 172.21.15.1:0/2472205355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b810b460 0x7f43b810b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 --2- 172.21.15.1:0/2472205355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b810bdb0 0x7f43b81125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 --2- 172.21.15.1:0/2472205355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b8105b20 0x7f43b8105f30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 -- 172.21.15.1:0/2472205355 >> 172.21.15.1:0/2472205355 conn(0x7f43b81015b0 msgr2=0x7f43b8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:50.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 -- 172.21.15.1:0/2472205355 shutdown_connections 2024-08-28T20:16:50.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.611+0000 7f43bf600640 1 -- 172.21.15.1:0/2472205355 wait complete. 2024-08-28T20:16:50.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.612+0000 7f43bf600640 1 Processor -- start 2024-08-28T20:16:50.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 -- start start 2024-08-28T20:16:50.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b8105b20 0x7f43b819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:50.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b810b460 0x7f43b819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:50.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b810bdb0 0x7f43b81a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:50.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8115a70 con 0x7f43b8105b20 2024-08-28T20:16:50.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81158f0 con 0x7f43b810b460 2024-08-28T20:16:50.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bf600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8115bf0 con 0x7f43b810bdb0 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b810b460 0x7f43b819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b810b460 0x7f43b819c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56650/0 (socket says 172.21.15.1:56650) 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43b7e00640 1 -- 172.21.15.1:0/2665044992 learned_addr learned my addr 172.21.15.1:0/2665044992 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.613+0000 7f43bcc00640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b8105b20 0x7f43b819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43bd600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b810bdb0 0x7f43b81a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43b7e00640 1 -- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b810bdb0 msgr2=0x7f43b81a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43b7e00640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b810bdb0 0x7f43b81a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43b7e00640 1 -- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b8105b20 msgr2=0x7f43b819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43b7e00640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b8105b20 0x7f43b819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43b7e00640 1 -- 172.21.15.1:0/2665044992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b81a2390 con 0x7f43b810b460 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.614+0000 7f43b7e00640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b810b460 0x7f43b819c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f43a400e9c0 tx=0x7f43a400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.615+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a400ccc0 con 0x7f43b810b460 2024-08-28T20:16:50.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.615+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a40108e0 con 0x7f43b810b460 2024-08-28T20:16:50.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.615+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40187e0 con 0x7f43b810b460 2024-08-28T20:16:50.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.615+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b81a2680 con 0x7f43b810b460 2024-08-28T20:16:50.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.615+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81a8de0 con 0x7f43b810b460 2024-08-28T20:16:50.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.616+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43b80638b0 con 0x7f43b810b460 2024-08-28T20:16:50.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.619+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f43a4010430 con 0x7f43b810b460 2024-08-28T20:16:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.620+0000 7f43b5600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43a00b4bc0 0x7f43a00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:50.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.620+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f43a40e5de0 con 0x7f43b810b460 2024-08-28T20:16:50.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.620+0000 7f43bcc00640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43a00b4bc0 0x7f43a00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.621+0000 7f43b5600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] conn(0x7f43a00be730 0x7f43a00c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.621+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 --> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43a4027e50 con 0x7f43a00be730 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.621+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f43a40e6190 con 0x7f43b810b460 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.621+0000 7f43bd600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] conn(0x7f43a00be730 0x7f43a00c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.621+0000 7f43bcc00640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43a00b4bc0 0x7f43a00b70d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43ac02a930 tx=0x7f43ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.621+0000 7f43bd600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] conn(0x7f43a00be730 0x7f43a00c0c20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:50.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.622+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== osd.11 v2:172.21.15.121:6824/1879105040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43a4027e50 con 0x7f43a00be730 2024-08-28T20:16:50.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.638+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 --> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f43b8063cb0 con 0x7f43a00be730 2024-08-28T20:16:50.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.639+0000 7f43b5600640 1 -- 172.21.15.1:0/2665044992 <== osd.11 v2:172.21.15.121:6824/1879105040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f43b8063cb0 con 0x7f43a00be730 2024-08-28T20:16:50.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] conn(0x7f43a00be730 msgr2=0x7f43a00c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:50.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] conn(0x7f43a00be730 0x7f43a00c0c20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43a00b4bc0 msgr2=0x7f43a00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:50.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f43a00b4bc0 0x7f43a00b70d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43ac02a930 tx=0x7f43ac0058d0 comp rx=0 tx=0).stop 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b810b460 msgr2=0x7f43b819c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 --2- 172.21.15.1:0/2665044992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b810b460 0x7f43b819c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f43a400e9c0 tx=0x7f43a400ee80 comp rx=0 tx=0).stop 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bd600640 1 -- 172.21.15.1:0/2665044992 reap_dead start 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 shutdown_connections 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 >> 172.21.15.1:0/2665044992 conn(0x7f43b81015b0 msgr2=0x7f43b81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 shutdown_connections 2024-08-28T20:16:50.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:50.640+0000 7f43bf600640 1 -- 172.21.15.1:0/2665044992 wait complete. 2024-08-28T20:16:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:50 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:50.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:50 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:51.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:51.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:51.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:51.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:50 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:16:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:51 smithi001 ceph-mon[20984]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:16:52.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:51 smithi007 ceph-mon[25357]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:16:52.210 INFO:teuthology.orchestra.run.smithi001.stdout:103079215170 2024-08-28T20:16:52.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-28T20:16:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:51 smithi121 ceph-mon[25248]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:16:52.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 -- 172.21.15.1:0/1339983599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714077120 msgr2=0x7fc714075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:52.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 --2- 172.21.15.1:0/1339983599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714077120 0x7fc714075550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc704009860 tx=0x7fc70402a340 comp rx=0 tx=0).stop 2024-08-28T20:16:52.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 -- 172.21.15.1:0/1339983599 shutdown_connections 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 --2- 172.21.15.1:0/1339983599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc714114020 0x7fc7141164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 --2- 172.21.15.1:0/1339983599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714075b70 0x7fc714075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 --2- 172.21.15.1:0/1339983599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714077120 0x7fc714075550 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 -- 172.21.15.1:0/1339983599 >> 172.21.15.1:0/1339983599 conn(0x7fc7140ff1e0 msgr2=0x7fc714101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 -- 172.21.15.1:0/1339983599 shutdown_connections 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.472+0000 7fc713e00640 1 -- 172.21.15.1:0/1339983599 wait complete. 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.474+0000 7fc713e00640 1 Processor -- start 2024-08-28T20:16:52.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.474+0000 7fc713e00640 1 -- start start 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc714075b70 0x7fc7141a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714077120 0x7fc7141a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714114020 0x7fc7141a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc714119c60 con 0x7fc714075b70 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc714119ae0 con 0x7fc714114020 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc714119de0 con 0x7fc714077120 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc712a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc714075b70 0x7fc7141a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714114020 0x7fc7141a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714114020 0x7fc7141a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56668/0 (socket says 172.21.15.1:56668) 2024-08-28T20:16:52.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.475+0000 7fc713400640 1 -- 172.21.15.1:0/2912860452 learned_addr learned my addr 172.21.15.1:0/2912860452 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:52.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc712000640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714077120 0x7fc7141a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:52.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc713400640 1 -- 172.21.15.1:0/2912860452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714077120 msgr2=0x7fc7141a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc713400640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714077120 0x7fc7141a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc713400640 1 -- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc714075b70 msgr2=0x7fc7141a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc713400640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc714075b70 0x7fc7141a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc713400640 1 -- 172.21.15.1:0/2912860452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7141a65e0 con 0x7fc714114020 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc713400640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714114020 0x7fc7141a5eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00eb10 tx=0x7fc70c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.476+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c004b20 con 0x7fc714114020 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.477+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7141a68d0 con 0x7fc714114020 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.477+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc70c004cc0 con 0x7fc714114020 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.477+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c010670 con 0x7fc714114020 2024-08-28T20:16:52.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.477+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7141ad030 con 0x7fc714114020 2024-08-28T20:16:52.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.478+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7140638f0 con 0x7fc714114020 2024-08-28T20:16:52.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.480+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fc70c005020 con 0x7fc714114020 2024-08-28T20:16:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.482+0000 7fc70b400640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc6f80b4c40 0x7fc6f80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:52.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.482+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc70c0e5aa0 con 0x7fc714114020 2024-08-28T20:16:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.482+0000 7fc70b400640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] conn(0x7fc6f80be7b0 0x7fc6f80c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.482+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 --> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc70c009030 con 0x7fc6f80be7b0 2024-08-28T20:16:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.482+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fc70c0e5e50 con 0x7fc714114020 2024-08-28T20:16:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.483+0000 7fc712a00640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc6f80b4c40 0x7fc6f80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:52.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.483+0000 7fc712000640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] conn(0x7fc6f80be7b0 0x7fc6f80c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:52.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.483+0000 7fc712000640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] conn(0x7fc6f80be7b0 0x7fc6f80c0ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:52.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.484+0000 7fc712a00640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc6f80b4c40 0x7fc6f80b7150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc70402a930 tx=0x7fc7040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:52.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.485+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== osd.7 v2:172.21.15.7:6816/1084781736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc70c009030 con 0x7fc6f80be7b0 2024-08-28T20:16:52.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.499+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 --> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc714063d70 con 0x7fc6f80be7b0 2024-08-28T20:16:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.500+0000 7fc70b400640 1 -- 172.21.15.1:0/2912860452 <== osd.7 v2:172.21.15.7:6816/1084781736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc714063d70 con 0x7fc6f80be7b0 2024-08-28T20:16:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.500+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] conn(0x7fc6f80be7b0 msgr2=0x7fc6f80c0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.500+0000 7fc713e00640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] conn(0x7fc6f80be7b0 0x7fc6f80c0ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc6f80b4c40 msgr2=0x7fc6f80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc6f80b4c40 0x7fc6f80b7150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc70402a930 tx=0x7fc7040058d0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714114020 msgr2=0x7fc7141a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 --2- 172.21.15.1:0/2912860452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc714114020 0x7fc7141a5eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00eb10 tx=0x7fc70c00c2d0 comp rx=0 tx=0).stop 2024-08-28T20:16:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713400640 1 -- 172.21.15.1:0/2912860452 reap_dead start 2024-08-28T20:16:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 shutdown_connections 2024-08-28T20:16:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 >> 172.21.15.1:0/2912860452 conn(0x7fc7140ff1e0 msgr2=0x7fc71410ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 shutdown_connections 2024-08-28T20:16:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:52.501+0000 7fc713e00640 1 -- 172.21.15.1:0/2912860452 wait complete. 2024-08-28T20:16:53.064 INFO:teuthology.orchestra.run.smithi001.stdout:77309411400 2024-08-28T20:16:53.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-28T20:16:53.610 INFO:teuthology.orchestra.run.smithi001.stdout:150323855415 2024-08-28T20:16:53.611 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-28T20:16:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:53 smithi007 ceph-mon[25357]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-28T20:16:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:53 smithi001 ceph-mon[20984]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-28T20:16:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:53 smithi121 ceph-mon[25248]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-28T20:16:54.349 INFO:teuthology.orchestra.run.smithi001.stdout:193273528366 2024-08-28T20:16:54.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-28T20:16:55.138 INFO:teuthology.orchestra.run.smithi001.stdout:261993005085 2024-08-28T20:16:55.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-28T20:16:55.552 INFO:teuthology.orchestra.run.smithi001.stdout:128849018941 2024-08-28T20:16:55.552 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-28T20:16:55.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 -- 172.21.15.1:0/1424367834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad010fe80 msgr2=0x7fcad01122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:55.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1424367834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad010fe80 0x7fcad01122c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009ca0 tx=0x7fcac802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 -- 172.21.15.1:0/1424367834 shutdown_connections 2024-08-28T20:16:55.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1424367834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad010fe80 0x7fcad01122c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1424367834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcad0075ea0 0x7fcad010f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1424367834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcad0075550 0x7fcad0075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 -- 172.21.15.1:0/1424367834 >> 172.21.15.1:0/1424367834 conn(0x7fcad00ff370 msgr2=0x7fcad01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 -- 172.21.15.1:0/1424367834 shutdown_connections 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.916+0000 7fcad4e00640 1 -- 172.21.15.1:0/1424367834 wait complete. 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.917+0000 7fcad4e00640 1 Processor -- start 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.917+0000 7fcad4e00640 1 -- start start 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcad4e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcad0075550 0x7fcad019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcad4e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad0075ea0 0x7fcad019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcad4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcad010fe80 0x7fcad01a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:55.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcad4e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0115a30 con 0x7fcad0075ea0 2024-08-28T20:16:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcad4e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcad01158b0 con 0x7fcad010fe80 2024-08-28T20:16:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcad4e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0115bb0 con 0x7fcad0075550 2024-08-28T20:16:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcacd400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad0075ea0 0x7fcad019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcacd400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad0075ea0 0x7fcad019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40908/0 (socket says 172.21.15.1:40908) 2024-08-28T20:16:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcacd400640 1 -- 172.21.15.1:0/1765560253 learned_addr learned my addr 172.21.15.1:0/1765560253 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcacde00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcad0075550 0x7fcad019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.918+0000 7fcace800640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcad010fe80 0x7fcad01a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcacd400640 1 -- 172.21.15.1:0/1765560253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcad0075550 msgr2=0x7fcad019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcacd400640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcad0075550 0x7fcad019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcacd400640 1 -- 172.21.15.1:0/1765560253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcad010fe80 msgr2=0x7fcad01a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcacd400640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcad010fe80 0x7fcad01a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcacd400640 1 -- 172.21.15.1:0/1765560253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad01a23b0 con 0x7fcad0075ea0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcacd400640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad0075ea0 0x7fcad019c9e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9c0 tx=0x7fcabc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00cd80 con 0x7fcad0075ea0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad01a26a0 con 0x7fcad0075ea0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcabc0035f0 con 0x7fcad0075ea0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc010690 con 0x7fcad0075ea0 2024-08-28T20:16:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.919+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad01a8e00 con 0x7fcad0075ea0 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.920+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcad010a3d0 con 0x7fcad0075ea0 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.923+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fcabc004000 con 0x7fcad0075ea0 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.925+0000 7fcac6a00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcab40b4bc0 0x7fcab40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.925+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fcabc0e5ad0 con 0x7fcad0075ea0 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.926+0000 7fcacde00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcab40b4bc0 0x7fcab40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.926+0000 7fcac6a00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] conn(0x7fcab40be730 0x7fcab40c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.926+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 --> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcab40c12f0 con 0x7fcab40be730 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.926+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fcabc0e5e80 con 0x7fcad0075ea0 2024-08-28T20:16:55.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.926+0000 7fcace800640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] conn(0x7fcab40be730 0x7fcab40c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.926+0000 7fcacde00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcab40b4bc0 0x7fcab40b70d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005d00 tx=0x7fcac000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.927+0000 7fcace800640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] conn(0x7fcab40be730 0x7fcab40c0c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.928+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== osd.9 v2:172.21.15.1:6826/3838494531 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcab40c12f0 con 0x7fcab40be730 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.942+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 --> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcad0076a60 con 0x7fcab40be730 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.942+0000 7fcac6a00640 1 -- 172.21.15.1:0/1765560253 <== osd.9 v2:172.21.15.1:6826/3838494531 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcad0076a60 con 0x7fcab40be730 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] conn(0x7fcab40be730 msgr2=0x7fcab40c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] conn(0x7fcab40be730 0x7fcab40c0c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcab40b4bc0 msgr2=0x7fcab40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcab40b4bc0 0x7fcab40b70d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005d00 tx=0x7fcac000b410 comp rx=0 tx=0).stop 2024-08-28T20:16:55.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad0075ea0 msgr2=0x7fcad019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:55.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 --2- 172.21.15.1:0/1765560253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcad0075ea0 0x7fcad019c9e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9c0 tx=0x7fcabc00ee80 comp rx=0 tx=0).stop 2024-08-28T20:16:55.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcace800640 1 -- 172.21.15.1:0/1765560253 reap_dead start 2024-08-28T20:16:55.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 shutdown_connections 2024-08-28T20:16:55.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 >> 172.21.15.1:0/1765560253 conn(0x7fcad00ff370 msgr2=0x7fcad01099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:55.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 shutdown_connections 2024-08-28T20:16:55.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:54.943+0000 7fcad4e00640 1 -- 172.21.15.1:0/1765560253 wait complete. 2024-08-28T20:16:55.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:55 smithi001 ceph-mon[20984]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:16:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:55 smithi007 ceph-mon[25357]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:16:56.233 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:55 smithi121 ceph-mon[25248]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:16:56.342 INFO:teuthology.orchestra.run.smithi001.stdout:214748364839 2024-08-28T20:16:56.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-28T20:16:56.783 INFO:teuthology.orchestra.run.smithi001.stdout:240518168613 2024-08-28T20:16:56.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-28T20:16:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:57.308 INFO:teuthology.orchestra.run.smithi001.stdout:283467841561 2024-08-28T20:16:57.314 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-28T20:16:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:57.858 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:57 smithi001 ceph-mon[20984]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 -- 172.21.15.1:0/264524270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd454105b20 msgr2=0x7fd454105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 --2- 172.21.15.1:0/264524270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd454105b20 0x7fd454105f30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd448009900 tx=0x7fd44802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 -- 172.21.15.1:0/264524270 shutdown_connections 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 --2- 172.21.15.1:0/264524270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd45410bdb0 0x7fd4541125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 --2- 172.21.15.1:0/264524270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 --2- 172.21.15.1:0/264524270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd454105b20 0x7fd454105f30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 -- 172.21.15.1:0/264524270 >> 172.21.15.1:0/264524270 conn(0x7fd4541015b0 msgr2=0x7fd454103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 -- 172.21.15.1:0/264524270 shutdown_connections 2024-08-28T20:16:58.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.038+0000 7fd45c200640 1 -- 172.21.15.1:0/264524270 wait complete. 2024-08-28T20:16:58.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.039+0000 7fd45c200640 1 Processor -- start 2024-08-28T20:16:58.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.039+0000 7fd45c200640 1 -- start start 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45c200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd454105b20 0x7fd45419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45c200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45c200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd45410bdb0 0x7fd4541a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45c200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd454115a70 con 0x7fd45410bdb0 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45c200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4541158f0 con 0x7fd454105b20 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45c200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd454115bf0 con 0x7fd45410b460 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd458e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd458e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45419ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44542/0 (socket says 172.21.15.1:44542) 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd459800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd454105b20 0x7fd45419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd458e00640 1 -- 172.21.15.1:0/3138135177 learned_addr learned my addr 172.21.15.1:0/3138135177 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:58.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.040+0000 7fd45a200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd45410bdb0 0x7fd4541a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd458e00640 1 -- 172.21.15.1:0/3138135177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd454105b20 msgr2=0x7fd45419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd458e00640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd454105b20 0x7fd45419c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd458e00640 1 -- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd45410bdb0 msgr2=0x7fd4541a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd458e00640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd45410bdb0 0x7fd4541a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd458e00640 1 -- 172.21.15.1:0/3138135177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541a23f0 con 0x7fd45410b460 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd458e00640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45419ca20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e9c0 tx=0x7fd44000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44000ccc0 con 0x7fd45410b460 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4400054d0 con 0x7fd45410b460 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541a26e0 con 0x7fd45410b460 2024-08-28T20:16:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.041+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440010430 con 0x7fd45410b460 2024-08-28T20:16:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.042+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4541a8e40 con 0x7fd45410b460 2024-08-28T20:16:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.042+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd454105f30 con 0x7fd45410b460 2024-08-28T20:16:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.045+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fd440005000 con 0x7fd45410b460 2024-08-28T20:16:58.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.046+0000 7fd452000640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd43c0b4bc0 0x7fd43c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.047+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fd4400e5810 con 0x7fd45410b460 2024-08-28T20:16:58.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.047+0000 7fd459800640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd43c0b4bc0 0x7fd43c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.047+0000 7fd459800640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd43c0b4bc0 0x7fd43c0b70d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd448031440 tx=0x7fd448009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:58.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.048+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd440056130 con 0x7fd45410b460 2024-08-28T20:16:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:57 smithi007 ceph-mon[25357]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:16:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:57 smithi121 ceph-mon[25248]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:16:58.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.249+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd45419d5b0 con 0x7fd45410b460 2024-08-28T20:16:58.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.250+0000 7fd452000640 1 -- 172.21.15.1:0/3138135177 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd45419d5b0 con 0x7fd45410b460 2024-08-28T20:16:58.251 INFO:teuthology.orchestra.run.smithi001.stdout:34359738451 2024-08-28T20:16:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd43c0b4bc0 msgr2=0x7fd43c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd43c0b4bc0 0x7fd43c0b70d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd448031440 tx=0x7fd448009560 comp rx=0 tx=0).stop 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 msgr2=0x7fd45419ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45419ca20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e9c0 tx=0x7fd44000ee80 comp rx=0 tx=0).stop 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 shutdown_connections 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd43c0b4bc0 0x7fd43c0b70d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd45410bdb0 0x7fd4541a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd45410b460 0x7fd45419ca20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 --2- 172.21.15.1:0/3138135177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd454105b20 0x7fd45419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 >> 172.21.15.1:0/3138135177 conn(0x7fd4541015b0 msgr2=0x7fd4541039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 shutdown_connections 2024-08-28T20:16:58.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.252+0000 7fd45c200640 1 -- 172.21.15.1:0/3138135177 wait complete. 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 -- 172.21.15.1:0/314468776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c1141d0 msgr2=0x7f7f5c1166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 --2- 172.21.15.1:0/314468776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1166a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009ca0 tx=0x7f7f5402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 -- 172.21.15.1:0/314468776 shutdown_connections 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 --2- 172.21.15.1:0/314468776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 --2- 172.21.15.1:0/314468776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1166a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 --2- 172.21.15.1:0/314468776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c077120 0x7f7f5c075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 -- 172.21.15.1:0/314468776 >> 172.21.15.1:0/314468776 conn(0x7f7f5c07b5f0 msgr2=0x7f7f5c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 -- 172.21.15.1:0/314468776 shutdown_connections 2024-08-28T20:16:58.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.817+0000 7f7f62400640 1 -- 172.21.15.1:0/314468776 wait complete. 2024-08-28T20:16:58.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.818+0000 7f7f62400640 1 Processor -- start 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.818+0000 7f7f62400640 1 -- start start 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f62400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f62400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c077120 0x7f7f5c1a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f62400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f62400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c119e60 con 0x7f7f5c075b70 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f62400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c119ce0 con 0x7f7f5c1141d0 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f62400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c119fe0 con 0x7f7f5c077120 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c1a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59064/0 (socket says 172.21.15.1:59064) 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f5b400640 1 -- 172.21.15.1:0/2167476370 learned_addr learned my addr 172.21.15.1:0/2167476370 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f5be00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.819+0000 7f7f53e00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c077120 0x7f7f5c1a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5be00640 1 -- 172.21.15.1:0/2167476370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c077120 msgr2=0x7f7f5c1a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5be00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c077120 0x7f7f5c1a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5be00640 1 -- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 msgr2=0x7f7f5c1a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5be00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c1a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5be00640 1 -- 172.21.15.1:0/2167476370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c1a6700 con 0x7f7f5c1141d0 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5b400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c1a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f53e00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c077120 0x7f7f5c1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f5be00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1a5fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f54005e30 tx=0x7f7f540317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54003b70 con 0x7f7f5c1141d0 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c1a6990 con 0x7f7f5c1141d0 2024-08-28T20:16:58.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f54003d10 con 0x7f7f5c1141d0 2024-08-28T20:16:58.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5402f970 con 0x7f7f5c1141d0 2024-08-28T20:16:58.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.820+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1ad150 con 0x7f7f5c1141d0 2024-08-28T20:16:58.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.821+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c075f80 con 0x7f7f5c1141d0 2024-08-28T20:16:58.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.824+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f7f54004b40 con 0x7f7f5c1141d0 2024-08-28T20:16:58.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.825+0000 7f7f58c00640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7f400b4bc0 0x7f7f400b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:16:58.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.825+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7f54106440 con 0x7f7f5c1141d0 2024-08-28T20:16:58.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.825+0000 7f7f5b400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7f400b4bc0 0x7f7f400b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:16:58.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.826+0000 7f7f5b400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7f400b4bc0 0x7f7f400b70d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c011500 tx=0x7f7f4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:16:58.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:58.827+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f540cd3a0 con 0x7f7f5c1141d0 2024-08-28T20:16:58.883 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:58.883 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:58.906 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:58 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3138135177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-28T20:16:59.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.037+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7f5c1ad3b0 con 0x7f7f5c1141d0 2024-08-28T20:16:59.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.037+0000 7f7f58c00640 1 -- 172.21.15.1:0/2167476370 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f540ccca0 con 0x7f7f5c1141d0 2024-08-28T20:16:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:193273528367 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7f400b4bc0 msgr2=0x7f7f400b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7f400b4bc0 0x7f7f400b70d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c011500 tx=0x7f7f4c005f90 comp rx=0 tx=0).stop 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c1141d0 msgr2=0x7f7f5c1a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1a5fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f54005e30 tx=0x7f7f540317c0 comp rx=0 tx=0).stop 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 shutdown_connections 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7f400b4bc0 0x7f7f400b70d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f5c1141d0 0x7f7f5c1a5fd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f5c077120 0x7f7f5c1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 --2- 172.21.15.1:0/2167476370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f5c075b70 0x7f7f5c1a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 >> 172.21.15.1:0/2167476370 conn(0x7f7f5c07b5f0 msgr2=0x7f7f5c112aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 shutdown_connections 2024-08-28T20:16:59.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:16:59.040+0000 7f7f62400640 1 -- 172.21.15.1:0/2167476370 wait complete. 2024-08-28T20:16:59.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:58 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3138135177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-28T20:16:59.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:58 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3138135177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-28T20:16:59.641 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:59.642 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:59.686 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738448 got 34359738451 for osd.0 2024-08-28T20:16:59.686 DEBUG:teuthology.parallel:result is None 2024-08-28T20:16:59.753 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:59.761 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:59.761 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:59.766 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:16:59.813 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:59 smithi001 ceph-mon[20984]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-28T20:16:59.814 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:16:59 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2167476370' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-28T20:17:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:59 smithi007 ceph-mon[25357]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-28T20:17:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:16:59 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2167476370' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-28T20:17:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:59 smithi121 ceph-mon[25248]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-28T20:17:00.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:16:59 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2167476370' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 -- 172.21.15.1:0/1513519469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0075b70 msgr2=0x7f76c0075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 --2- 172.21.15.1:0/1513519469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0075b70 0x7f76c0075f80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009900 tx=0x7f76ac02a410 comp rx=0 tx=0).stop 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 -- 172.21.15.1:0/1513519469 shutdown_connections 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 --2- 172.21.15.1:0/1513519469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c0075b70 0x7f76c0075f80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 --2- 172.21.15.1:0/1513519469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76c01141d0 0x7f76c01166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 --2- 172.21.15.1:0/1513519469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0077120 0x7f76c0075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.345+0000 7f76c7200640 1 -- 172.21.15.1:0/1513519469 >> 172.21.15.1:0/1513519469 conn(0x7f76c007b5f0 msgr2=0x7f76c007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.346+0000 7f76c7200640 1 -- 172.21.15.1:0/1513519469 shutdown_connections 2024-08-28T20:17:00.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.346+0000 7f76c7200640 1 -- 172.21.15.1:0/1513519469 wait complete. 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.347+0000 7f76c7200640 1 Processor -- start 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.347+0000 7f76c7200640 1 -- start start 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.347+0000 7f76c7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 0x7f76c01a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.347+0000 7f76c7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76c0077120 0x7f76c01a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76c7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c01141d0 0x7f76c01a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76c7200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0119dd0 con 0x7f76c01141d0 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76c7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0119c50 con 0x7f76c0075b70 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76c7200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0119f50 con 0x7f76c0077120 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 0x7f76c01a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 0x7f76c01a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:53640/0 (socket says 172.21.15.1:53640) 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 -- 172.21.15.1:0/3196676895 learned_addr learned my addr 172.21.15.1:0/3196676895 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:00.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76c5200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c01141d0 0x7f76c01a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bf400640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76c0077120 0x7f76c01a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 -- 172.21.15.1:0/3196676895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76c0077120 msgr2=0x7f76c01a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76c0077120 0x7f76c01a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 -- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c01141d0 msgr2=0x7f76c01a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c01141d0 0x7f76c01a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.348+0000 7f76bfe00640 1 -- 172.21.15.1:0/3196676895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c01a67f0 con 0x7f76c0075b70 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.349+0000 7f76bfe00640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 0x7f76c01a0880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76b000e9f0 tx=0x7f76b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.349+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b000cd80 con 0x7f76c0075b70 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.349+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c01a6ae0 con 0x7f76c0075b70 2024-08-28T20:17:00.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.349+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01ad240 con 0x7f76c0075b70 2024-08-28T20:17:00.741 INFO:teuthology.orchestra.run.smithi001.stdout:103079215171 2024-08-28T20:17:00.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.349+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76b00108e0 con 0x7f76c0075b70 2024-08-28T20:17:00.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.349+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0018980 con 0x7f76c0075b70 2024-08-28T20:17:00.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.351+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a00052c0 con 0x7f76c0075b70 2024-08-28T20:17:00.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.354+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f76b0010430 con 0x7f76c0075b70 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.355+0000 7f76bcc00640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f76a40b4bc0 0x7f76a40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.355+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f76b00e55d0 con 0x7f76c0075b70 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.355+0000 7f76bf400640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f76a40b4bc0 0x7f76a40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.356+0000 7f76bf400640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f76a40b4bc0 0x7f76a40b70d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76ac005ab0 tx=0x7f76ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.357+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f76b00abee0 con 0x7f76c0075b70 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.556+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f76a0005880 con 0x7f76c0075b70 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.557+0000 7f76bcc00640 1 -- 172.21.15.1:0/3196676895 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f76b00b06a0 con 0x7f76c0075b70 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f76a40b4bc0 msgr2=0x7f76a40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f76a40b4bc0 0x7f76a40b70d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76ac005ab0 tx=0x7f76ac000bc0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 msgr2=0x7f76c01a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 0x7f76c01a0880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76b000e9f0 tx=0x7f76b000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 shutdown_connections 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f76a40b4bc0 0x7f76a40b70d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76c01141d0 0x7f76c01a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76c0077120 0x7f76c01a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 --2- 172.21.15.1:0/3196676895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c0075b70 0x7f76c01a0880 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:00.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 >> 172.21.15.1:0/3196676895 conn(0x7f76c007b5f0 msgr2=0x7f76c0112ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:00.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 shutdown_connections 2024-08-28T20:17:00.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.560+0000 7f76c7200640 1 -- 172.21.15.1:0/3196676895 wait complete. 2024-08-28T20:17:00.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:00 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3196676895' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-28T20:17:00.934 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.782+0000 7f5864600640 1 -- 172.21.15.1:0/3984530030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 msgr2=0x7f585c104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.782+0000 7f5864600640 1 --2- 172.21.15.1:0/3984530030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c104b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5850009900 tx=0x7f585002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 -- 172.21.15.1:0/3984530030 shutdown_connections 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 --2- 172.21.15.1:0/3984530030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 --2- 172.21.15.1:0/3984530030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f585c10dbd0 0x7f585c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 --2- 172.21.15.1:0/3984530030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c104b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 -- 172.21.15.1:0/3984530030 >> 172.21.15.1:0/3984530030 conn(0x7f585c0794e0 msgr2=0x7f585c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 -- 172.21.15.1:0/3984530030 shutdown_connections 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.783+0000 7f5864600640 1 -- 172.21.15.1:0/3984530030 wait complete. 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 Processor -- start 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 -- start start 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:01.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f585c10dbd0 0x7f585c1a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1138a0 con 0x7f585c1050c0 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113720 con 0x7f585c10dbd0 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.784+0000 7f5864600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113a20 con 0x7f585c104770 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59102/0 (socket says 172.21.15.1:59102) 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c19c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44598/0 (socket says 172.21.15.1:44598) 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861200640 1 -- 172.21.15.1:0/196525082 learned_addr learned my addr 172.21.15.1:0/196525082 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5862600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f585c10dbd0 0x7f585c1a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 -- 172.21.15.1:0/196525082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f585c10dbd0 msgr2=0x7f585c1a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f585c10dbd0 0x7f585c1a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 -- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 msgr2=0x7f585c19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:01.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c19cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861c00640 1 -- 172.21.15.1:0/196525082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c1a24e0 con 0x7f585c104770 2024-08-28T20:17:01.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.785+0000 7f5861200640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:01.041 INFO:teuthology.orchestra.run.smithi001.stdout:128849018944 2024-08-28T20:17:01.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.786+0000 7f5861c00640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c19c570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f585002a910 tx=0x7f5850003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.786+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585003f070 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.786+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5850031b60 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.786+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850035030 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.786+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c1a2770 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.786+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c1a8f30 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.787+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c06bfe0 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.789+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f5850042070 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.791+0000 7f585a000640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f58440b4c40 0x7f58440b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.791+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f58501057a0 con 0x7f585c104770 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.791+0000 7f5861200640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f58440b4c40 0x7f58440b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:01.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.792+0000 7f5861200640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f58440b4c40 0x7f58440b7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f585c10f8d0 tx=0x7f5848005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.795+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f58500cc0b0 con 0x7f585c104770 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.999+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f585c1a9130 con 0x7f585c104770 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:00.999+0000 7f585a000640 1 -- 172.21.15.1:0/196525082 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f58500d0870 con 0x7f585c104770 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f58440b4c40 msgr2=0x7f58440b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f58440b4c40 0x7f58440b7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f585c10f8d0 tx=0x7f5848005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 msgr2=0x7f585c19c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c19c570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f585002a910 tx=0x7f5850003c10 comp rx=0 tx=0).stop 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 shutdown_connections 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f58440b4c40 0x7f58440b7150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f585c1050c0 0x7f585c19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f585c10dbd0 0x7f585c1a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 --2- 172.21.15.1:0/196525082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f585c104770 0x7f585c19c570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 >> 172.21.15.1:0/196525082 conn(0x7f585c0794e0 msgr2=0x7f585c10c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:01.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 shutdown_connections 2024-08-28T20:17:01.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:01.002+0000 7f5864600640 1 -- 172.21.15.1:0/196525082 wait complete. 2024-08-28T20:17:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:00 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3196676895' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-28T20:17:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:00 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3196676895' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-28T20:17:01.889 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018941 got 128849018944 for osd.4 2024-08-28T20:17:01.889 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:02.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:01 smithi001 ceph-mon[20984]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:02.056 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:01 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/196525082' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-28T20:17:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:01 smithi007 ceph-mon[25357]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:01 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/196525082' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-28T20:17:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:01 smithi121 ceph-mon[25248]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:02.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:01 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/196525082' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-28T20:17:02.762 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528366 got 193273528367 for osd.7 2024-08-28T20:17:02.762 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:02.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:02 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1481497172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-28T20:17:03.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 -- 172.21.15.1:0/720225949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c103750 msgr2=0x7f513c103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 --2- 172.21.15.1:0/720225949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c103750 0x7f513c103b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5130009900 tx=0x7f513002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 -- 172.21.15.1:0/720225949 shutdown_connections 2024-08-28T20:17:03.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 --2- 172.21.15.1:0/720225949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c1099e0 0x7f513c110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 --2- 172.21.15.1:0/720225949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f513c109090 0x7f513c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 --2- 172.21.15.1:0/720225949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c103750 0x7f513c103b60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.014+0000 7f5142a00640 1 -- 172.21.15.1:0/720225949 >> 172.21.15.1:0/720225949 conn(0x7f513c0ff1a0 msgr2=0x7f513c1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:03.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.015+0000 7f5142a00640 1 -- 172.21.15.1:0/720225949 shutdown_connections 2024-08-28T20:17:03.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.015+0000 7f5142a00640 1 -- 172.21.15.1:0/720225949 wait complete. 2024-08-28T20:17:03.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 Processor -- start 2024-08-28T20:17:03.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 -- start start 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c103750 0x7f513c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f513c109090 0x7f513c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 0x7f513c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f513c113690 con 0x7f513c1099e0 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f513c113510 con 0x7f513c103750 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f513c113810 con 0x7f513c109090 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.016+0000 7f5142000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 0x7f513c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 0x7f513c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59142/0 (socket says 172.21.15.1:59142) 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 -- 172.21.15.1:0/1961272631 learned_addr learned my addr 172.21.15.1:0/1961272631 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5140c00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f513c109090 0x7f513c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5141600640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c103750 0x7f513c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 -- 172.21.15.1:0/1961272631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f513c109090 msgr2=0x7f513c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f513c109090 0x7f513c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 -- 172.21.15.1:0/1961272631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c103750 msgr2=0x7f513c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c103750 0x7f513c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 -- 172.21.15.1:0/1961272631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c1a8380 con 0x7f513c1099e0 2024-08-28T20:17:03.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5141600640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c103750 0x7f513c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:03.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.017+0000 7f5142000640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 0x7f513c075f30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f513400eb10 tx=0x7f513400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.018+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134004b20 con 0x7f513c1099e0 2024-08-28T20:17:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.018+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c1a8670 con 0x7f513c1099e0 2024-08-28T20:17:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.018+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5134004cc0 con 0x7f513c1099e0 2024-08-28T20:17:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.018+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134010670 con 0x7f513c1099e0 2024-08-28T20:17:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.018+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1a8bb0 con 0x7f513c1099e0 2024-08-28T20:17:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.019+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c103b60 con 0x7f513c1099e0 2024-08-28T20:17:03.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.021+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f5134005000 con 0x7f513c1099e0 2024-08-28T20:17:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.023+0000 7f513a000640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51240b4c40 0x7f51240b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.023+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f51340e5990 con 0x7f513c1099e0 2024-08-28T20:17:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.023+0000 7f5141600640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51240b4c40 0x7f51240b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.024+0000 7f5141600640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51240b4c40 0x7f51240b7150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5130000c00 tx=0x7f5130031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:03.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.025+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5134056130 con 0x7f513c1099e0 2024-08-28T20:17:03.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:02 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1481497172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-28T20:17:03.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.225+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f513c10b790 con 0x7f513c1099e0 2024-08-28T20:17:03.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.225+0000 7f513a000640 1 -- 172.21.15.1:0/1961272631 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f51340ac950 con 0x7f513c1099e0 2024-08-28T20:17:03.227 INFO:teuthology.orchestra.run.smithi001.stdout:150323855417 2024-08-28T20:17:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51240b4c40 msgr2=0x7f51240b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51240b4c40 0x7f51240b7150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5130000c00 tx=0x7f5130031400 comp rx=0 tx=0).stop 2024-08-28T20:17:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 msgr2=0x7f513c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 0x7f513c075f30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f513400eb10 tx=0x7f513400c2d0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 shutdown_connections 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f51240b4c40 0x7f51240b7150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f513c1099e0 0x7f513c075f30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f513c109090 0x7f513c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 --2- 172.21.15.1:0/1961272631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f513c103750 0x7f513c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 >> 172.21.15.1:0/1961272631 conn(0x7f513c0ff1a0 msgr2=0x7f513c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 shutdown_connections 2024-08-28T20:17:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:03.228+0000 7f5142a00640 1 -- 172.21.15.1:0/1961272631 wait complete. 2024-08-28T20:17:03.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:02 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1481497172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-28T20:17:03.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.235+0000 7f7082200640 1 -- 172.21.15.1:0/1704103048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c109070 msgr2=0x7f707c109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.235+0000 7f7082200640 1 --2- 172.21.15.1:0/1704103048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c109070 0x7f707c109480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7068009900 tx=0x7f706802a410 comp rx=0 tx=0).stop 2024-08-28T20:17:03.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 -- 172.21.15.1:0/1704103048 shutdown_connections 2024-08-28T20:17:03.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 --2- 172.21.15.1:0/1704103048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c109070 0x7f707c109480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 --2- 172.21.15.1:0/1704103048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c1099c0 0x7f707c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 --2- 172.21.15.1:0/1704103048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f707c103730 0x7f707c103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 -- 172.21.15.1:0/1704103048 >> 172.21.15.1:0/1704103048 conn(0x7f707c0ff180 msgr2=0x7f707c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 -- 172.21.15.1:0/1704103048 shutdown_connections 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.236+0000 7f7082200640 1 -- 172.21.15.1:0/1704103048 wait complete. 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.237+0000 7f7082200640 1 Processor -- start 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 -- start start 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 0x7f707c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c109070 0x7f707c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f707c1099c0 0x7f707c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f707c113680 con 0x7f707c103730 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f707c113500 con 0x7f707c109070 2024-08-28T20:17:03.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7082200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f707c113800 con 0x7f707c1099c0 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.238+0000 7f7080e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 0x7f707c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 0x7f707c19a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59120/0 (socket says 172.21.15.1:59120) 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 -- 172.21.15.1:0/1481497172 learned_addr learned my addr 172.21.15.1:0/1481497172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7081800640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f707c1099c0 0x7f707c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f707be00640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c109070 0x7f707c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 -- 172.21.15.1:0/1481497172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f707c1099c0 msgr2=0x7f707c19f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f707c1099c0 0x7f707c19f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 -- 172.21.15.1:0/1481497172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c109070 msgr2=0x7f707c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c109070 0x7f707c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 -- 172.21.15.1:0/1481497172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c19ffe0 con 0x7f707c103730 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.239+0000 7f7080e00640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 0x7f707c19a070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f707000e9f0 tx=0x7f707000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:03.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.240+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707000cd80 con 0x7f707c103730 2024-08-28T20:17:03.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.240+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70700108e0 con 0x7f707c103730 2024-08-28T20:17:03.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.240+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c1a02d0 con 0x7f707c103730 2024-08-28T20:17:03.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.240+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070018980 con 0x7f707c103730 2024-08-28T20:17:03.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.240+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c1a6a30 con 0x7f707c103730 2024-08-28T20:17:03.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.241+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707c103b40 con 0x7f707c103730 2024-08-28T20:17:03.341 INFO:teuthology.orchestra.run.smithi001.stdout:214748364842 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.243+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f7070010430 con 0x7f707c103730 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.245+0000 7f7079600640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70640b4bc0 0x7f70640b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.245+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f70700e5b20 con 0x7f707c103730 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.245+0000 7f707be00640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70640b4bc0 0x7f70640b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.246+0000 7f707be00640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70640b4bc0 0x7f70640b70d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f706802aa00 tx=0x7f7068005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.247+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70700ac430 con 0x7f707c103730 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.449+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f707c02e430 con 0x7f707c103730 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.449+0000 7f7079600640 1 -- 172.21.15.1:0/1481497172 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f70700b0bf0 con 0x7f707c103730 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70640b4bc0 msgr2=0x7f70640b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70640b4bc0 0x7f70640b70d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f706802aa00 tx=0x7f7068005a20 comp rx=0 tx=0).stop 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 msgr2=0x7f707c19a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 0x7f707c19a070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f707000e9f0 tx=0x7f707000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 shutdown_connections 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70640b4bc0 0x7f70640b70d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f707c1099c0 0x7f707c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c109070 0x7f707c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 --2- 172.21.15.1:0/1481497172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f707c103730 0x7f707c19a070 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 >> 172.21.15.1:0/1481497172 conn(0x7f707c0ff180 msgr2=0x7f707c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 shutdown_connections 2024-08-28T20:17:03.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:02.452+0000 7f7082200640 1 -- 172.21.15.1:0/1481497172 wait complete. 2024-08-28T20:17:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:03 smithi001 ceph-mon[20984]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:03 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1961272631' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-28T20:17:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:03 smithi007 ceph-mon[25357]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:03 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1961272631' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-28T20:17:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:03 smithi121 ceph-mon[25248]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:03 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1961272631' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 -- 172.21.15.1:0/4030695938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 msgr2=0x7f3b6010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 --2- 172.21.15.1:0/4030695938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b6010d610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009900 tx=0x7f3b4802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 -- 172.21.15.1:0/4030695938 shutdown_connections 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 --2- 172.21.15.1:0/4030695938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b6010dbd0 0x7f3b601100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 --2- 172.21.15.1:0/4030695938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b6010d610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 --2- 172.21.15.1:0/4030695938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b60104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 -- 172.21.15.1:0/4030695938 >> 172.21.15.1:0/4030695938 conn(0x7f3b600794e0 msgr2=0x7f3b600798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 -- 172.21.15.1:0/4030695938 shutdown_connections 2024-08-28T20:17:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.670+0000 7f3b66a00640 1 -- 172.21.15.1:0/4030695938 wait complete. 2024-08-28T20:17:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 -- 172.21.15.1:0/3026356663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78077120 msgr2=0x7fde78075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 --2- 172.21.15.1:0/3026356663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78077120 0x7fde78075550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde68009900 tx=0x7fde6802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 -- 172.21.15.1:0/3026356663 shutdown_connections 2024-08-28T20:17:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 --2- 172.21.15.1:0/3026356663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde781141f0 0x7fde781166c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 --2- 172.21.15.1:0/3026356663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde78075b70 0x7fde78075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 --2- 172.21.15.1:0/3026356663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78077120 0x7fde78075550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.540+0000 7fde7d600640 1 -- 172.21.15.1:0/3026356663 >> 172.21.15.1:0/3026356663 conn(0x7fde780ff3b0 msgr2=0x7fde78101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.541+0000 7fde7d600640 1 -- 172.21.15.1:0/3026356663 shutdown_connections 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.541+0000 7fde7d600640 1 -- 172.21.15.1:0/3026356663 wait complete. 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 Processor -- start 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 -- start start 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 0x7fde781a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde78077120 0x7fde781a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde781141f0 0x7fde781a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fde78119e30 con 0x7fde78075b70 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fde78119cb0 con 0x7fde78077120 2024-08-28T20:17:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde7d600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fde78119fb0 con 0x7fde781141f0 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde76a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 0x7fde781a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde76a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 0x7fde781a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59154/0 (socket says 172.21.15.1:59154) 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.542+0000 7fde76a00640 1 -- 172.21.15.1:0/239534734 learned_addr learned my addr 172.21.15.1:0/239534734 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76000640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde78077120 0x7fde781a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde77400640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde781141f0 0x7fde781a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76a00640 1 -- 172.21.15.1:0/239534734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde781141f0 msgr2=0x7fde781a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76a00640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde781141f0 0x7fde781a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76a00640 1 -- 172.21.15.1:0/239534734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde78077120 msgr2=0x7fde781a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76a00640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde78077120 0x7fde781a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76a00640 1 -- 172.21.15.1:0/239534734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde781a6750 con 0x7fde78075b70 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76000640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde78077120 0x7fde781a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.543+0000 7fde76a00640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 0x7fde781a07e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde68005940 tx=0x7fde680040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.544+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6803f030 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.544+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde680044c0 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.544+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde781a69e0 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.544+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68035070 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.544+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde781ad1a0 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.545+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde78076a60 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.547+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fde68042030 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.550+0000 7fde6f400640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde5c0b4c40 0x7fde5c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.550+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fde68105630 con 0x7fde78075b70 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.550+0000 7fde76000640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde5c0b4c40 0x7fde5c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.551+0000 7fde76000640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde5c0b4c40 0x7fde5c0b7150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde78116230 tx=0x7fde64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.554+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fde680cbf40 con 0x7fde78075b70 2024-08-28T20:17:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.671+0000 7f3b66a00640 1 Processor -- start 2024-08-28T20:17:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.671+0000 7f3b66a00640 1 -- start start 2024-08-28T20:17:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b66a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b601024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b601029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b66a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b6010dbd0 0x7f3b60102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b66a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60113810 con 0x7f3b6010dbd0 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b66a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60113690 con 0x7f3b601050c0 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b66a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60113990 con 0x7f3b60104770 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b5fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b601024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b601029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b5fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b601024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44660/0 (socket says 172.21.15.1:44660) 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b601029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:53740/0 (socket says 172.21.15.1:53740) 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b5fe00640 1 -- 172.21.15.1:0/3941572678 learned_addr learned my addr 172.21.15.1:0/3941572678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.672+0000 7f3b64a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b6010dbd0 0x7f3b60102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b5fe00640 1 -- 172.21.15.1:0/3941572678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 msgr2=0x7f3b601029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b5fe00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b601029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b5fe00640 1 -- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b6010dbd0 msgr2=0x7f3b60102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b5fe00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b6010dbd0 0x7f3b60102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b5fe00640 1 -- 172.21.15.1:0/3941572678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b601a8540 con 0x7f3b60104770 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b57e00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b601029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.673+0000 7f3b5fe00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b601024b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000e9c0 tx=0x7f3b5000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.674+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000cd80 con 0x7f3b60104770 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.674+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b500035f0 con 0x7f3b60104770 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.674+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b601a8830 con 0x7f3b60104770 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.674+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50010690 con 0x7f3b60104770 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.674+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b601a8d40 con 0x7f3b60104770 2024-08-28T20:17:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.675+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6006bfe0 con 0x7f3b60104770 2024-08-28T20:17:04.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.679+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f3b50004000 con 0x7f3b60104770 2024-08-28T20:17:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.680+0000 7f3b5d600640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b440b4c40 0x7f3b440b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.681+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3b500e5940 con 0x7f3b60104770 2024-08-28T20:17:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.681+0000 7f3b57e00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b440b4c40 0x7f3b440b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.681+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3b500ac8a0 con 0x7f3b60104770 2024-08-28T20:17:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.682+0000 7f3b57e00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b440b4c40 0x7f3b440b7150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009230 tx=0x7f3b48031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:04.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.770+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fde78112f80 con 0x7fde78075b70 2024-08-28T20:17:04.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.770+0000 7fde6f400640 1 -- 172.21.15.1:0/239534734 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde680d0700 con 0x7fde78075b70 2024-08-28T20:17:04.772 INFO:teuthology.orchestra.run.smithi001.stdout:55834574926 2024-08-28T20:17:04.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde5c0b4c40 msgr2=0x7fde5c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde5c0b4c40 0x7fde5c0b7150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde78116230 tx=0x7fde64005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 msgr2=0x7fde781a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 0x7fde781a07e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde68005940 tx=0x7fde680040c0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 shutdown_connections 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde5c0b4c40 0x7fde5c0b7150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde781141f0 0x7fde781a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde78077120 0x7fde781a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 --2- 172.21.15.1:0/239534734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde78075b70 0x7fde781a07e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 >> 172.21.15.1:0/239534734 conn(0x7fde780ff3b0 msgr2=0x7fde781100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 shutdown_connections 2024-08-28T20:17:04.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.773+0000 7fde7d600640 1 -- 172.21.15.1:0/239534734 wait complete. 2024-08-28T20:17:04.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.887+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3b60104b80 con 0x7f3b60104770 2024-08-28T20:17:04.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.888+0000 7f3b5d600640 1 -- 172.21.15.1:0/3941572678 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b60104b80 con 0x7f3b60104770 2024-08-28T20:17:04.889 INFO:teuthology.orchestra.run.smithi001.stdout:77309411403 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b440b4c40 msgr2=0x7f3b440b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b440b4c40 0x7f3b440b7150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009230 tx=0x7f3b48031400 comp rx=0 tx=0).stop 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 msgr2=0x7f3b601024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b601024b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000e9c0 tx=0x7f3b5000ee80 comp rx=0 tx=0).stop 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 shutdown_connections 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b440b4c40 0x7f3b440b7150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b6010dbd0 0x7f3b60102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b601050c0 0x7f3b601029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 --2- 172.21.15.1:0/3941572678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b60104770 0x7f3b601024b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:04.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 >> 172.21.15.1:0/3941572678 conn(0x7f3b600794e0 msgr2=0x7f3b601065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:04.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 shutdown_connections 2024-08-28T20:17:04.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:04.891+0000 7f3b66a00640 1 -- 172.21.15.1:0/3941572678 wait complete. 2024-08-28T20:17:04.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:04 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/239534734' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-28T20:17:05.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:04 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/239534734' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-28T20:17:05.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:04 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/239534734' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-28T20:17:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:05 smithi007 ceph-mon[25357]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:05 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3941572678' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-28T20:17:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:05 smithi001 ceph-mon[20984]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:05 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3941572678' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-28T20:17:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:05 smithi121 ceph-mon[25248]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:05 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3941572678' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-28T20:17:06.313 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:06.343 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215170 got 103079215171 for osd.3 2024-08-28T20:17:06.343 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:06.673 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855415 got 150323855417 for osd.5 2024-08-28T20:17:06.674 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:07.624 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364839 got 214748364842 for osd.8 2024-08-28T20:17:07.624 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:07.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 -- 172.21.15.1:0/4256428924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 msgr2=0x7f25081166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 --2- 172.21.15.1:0/4256428924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081166c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2500009ca0 tx=0x7f250002a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 -- 172.21.15.1:0/4256428924 shutdown_connections 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 --2- 172.21.15.1:0/4256428924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081166c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 --2- 172.21.15.1:0/4256428924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508075b70 0x7f2508075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 --2- 172.21.15.1:0/4256428924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508077120 0x7f2508075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 -- 172.21.15.1:0/4256428924 >> 172.21.15.1:0/4256428924 conn(0x7f25080ff370 msgr2=0x7f25081017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 -- 172.21.15.1:0/4256428924 shutdown_connections 2024-08-28T20:17:07.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.913+0000 7f250d600640 1 -- 172.21.15.1:0/4256428924 wait complete. 2024-08-28T20:17:07.916 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:07 smithi001 ceph-mon[20984]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:07.916 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:07 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1918877726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.914+0000 7f250d600640 1 Processor -- start 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.914+0000 7f250d600640 1 -- start start 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f250d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 0x7f25081a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f250d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508077120 0x7f25081a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f250d600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f250d600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2508119e80 con 0x7f25081141f0 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f250d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2508119d00 con 0x7f2508077120 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f250d600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f250811a000 con 0x7f2508075b70 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f2506a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 0x7f25081a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f2507400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f2506a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 0x7f25081a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49564/0 (socket says 172.21.15.1:49564) 2024-08-28T20:17:07.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f2507400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50116/0 (socket says 172.21.15.1:50116) 2024-08-28T20:17:07.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f2506a00640 1 -- 172.21.15.1:0/904314550 learned_addr learned my addr 172.21.15.1:0/904314550 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:07.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.915+0000 7f2506000640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508077120 0x7f25081a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506a00640 1 -- 172.21.15.1:0/904314550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508077120 msgr2=0x7f25081a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506a00640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508077120 0x7f25081a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506a00640 1 -- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 msgr2=0x7f25081a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506a00640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506a00640 1 -- 172.21.15.1:0/904314550 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25081a66e0 con 0x7f2508075b70 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506000640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508077120 0x7f25081a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f2506a00640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 0x7f25081a0770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24f800d950 tx=0x7f24f800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8017070 con 0x7f2508075b70 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24f8009c30 con 0x7f2508075b70 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25081a69d0 con 0x7f2508075b70 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f800f620 con 0x7f2508075b70 2024-08-28T20:17:07.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.916+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25081ad130 con 0x7f2508075b70 2024-08-28T20:17:07.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.918+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2508075f80 con 0x7f2508075b70 2024-08-28T20:17:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.920+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f24f8010460 con 0x7f2508075b70 2024-08-28T20:17:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.921+0000 7f24ff400640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f24ec0b4bc0 0x7f24ec0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.921+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f24f80e4f20 con 0x7f2508075b70 2024-08-28T20:17:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.921+0000 7f2506000640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f24ec0b4bc0 0x7f24ec0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.922+0000 7f2506000640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f24ec0b4bc0 0x7f24ec0b70d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2508115f20 tx=0x7f24f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:07.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.925+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24f8009de0 con 0x7f2508075b70 2024-08-28T20:17:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.299+0000 7fc32fe00640 1 -- 172.21.15.1:0/1417149791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 msgr2=0x7fc330075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.299+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1417149791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc330075f80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009900 tx=0x7fc31c02a410 comp rx=0 tx=0).stop 2024-08-28T20:17:08.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 -- 172.21.15.1:0/1417149791 shutdown_connections 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1417149791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc330075f80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1417149791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330114020 0x7fc3301164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1417149791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330077120 0x7fc330075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 -- 172.21.15.1:0/1417149791 >> 172.21.15.1:0/1417149791 conn(0x7fc3300ff1e0 msgr2=0x7fc330101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 -- 172.21.15.1:0/1417149791 shutdown_connections 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.300+0000 7fc32fe00640 1 -- 172.21.15.1:0/1417149791 wait complete. 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 Processor -- start 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 -- start start 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc3301a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330077120 0x7fc3301a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:08.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330114020 0x7fc3301a5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc330119c60 con 0x7fc330075b70 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc330119ae0 con 0x7fc330114020 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.301+0000 7fc32fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc330119de0 con 0x7fc330077120 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc3301a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc3301a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50088/0 (socket says 172.21.15.1:50088) 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 -- 172.21.15.1:0/1918877726 learned_addr learned my addr 172.21.15.1:0/1918877726 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32f400640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330114020 0x7fc3301a5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32e000640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330077120 0x7fc3301a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 -- 172.21.15.1:0/1918877726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330077120 msgr2=0x7fc3301a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330077120 0x7fc3301a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 -- 172.21.15.1:0/1918877726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330114020 msgr2=0x7fc3301a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330114020 0x7fc3301a5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 -- 172.21.15.1:0/1918877726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3301a6640 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32f400640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330114020 0x7fc3301a5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.302+0000 7fc32ea00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc3301a06d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc32000e9f0 tx=0x7fc32000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.303+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000cd80 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.303+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3200108e0 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.303+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320018980 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.303+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3301a6930 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.303+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3301ad090 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.304+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc330076a60 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.306+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fc320010430 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.308+0000 7fc327400640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3140b4c40 0x7fc3140b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.308+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc3200e55c0 con 0x7fc330075b70 2024-08-28T20:17:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.308+0000 7fc32e000640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3140b4c40 0x7fc3140b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.309+0000 7fc32e000640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3140b4c40 0x7fc3140b7150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc31c000c00 tx=0x7fc31c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.312+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3200abed0 con 0x7fc330075b70 2024-08-28T20:17:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.520+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc330075f80 con 0x7fc330075b70 2024-08-28T20:17:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.520+0000 7fc327400640 1 -- 172.21.15.1:0/1918877726 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3200b0690 con 0x7fc330075b70 2024-08-28T20:17:08.032 INFO:teuthology.orchestra.run.smithi001.stdout:240518168615 2024-08-28T20:17:08.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3140b4c40 msgr2=0x7fc3140b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3140b4c40 0x7fc3140b7150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc31c000c00 tx=0x7fc31c031400 comp rx=0 tx=0).stop 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 msgr2=0x7fc3301a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc3301a06d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc32000e9f0 tx=0x7fc32000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 shutdown_connections 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3140b4c40 0x7fc3140b7150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc330114020 0x7fc3301a5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330077120 0x7fc3301a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 --2- 172.21.15.1:0/1918877726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc330075b70 0x7fc3301a06d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 >> 172.21.15.1:0/1918877726 conn(0x7fc3300ff1e0 msgr2=0x7fc33010ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 shutdown_connections 2024-08-28T20:17:08.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:07.523+0000 7fc32fe00640 1 -- 172.21.15.1:0/1918877726 wait complete. 2024-08-28T20:17:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:07 smithi007 ceph-mon[25357]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:07 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1918877726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-28T20:17:08.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.127+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2508112f50 con 0x7f2508075b70 2024-08-28T20:17:08.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.127+0000 7f24ff400640 1 -- 172.21.15.1:0/904314550 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f24f80b43c0 con 0x7f2508075b70 2024-08-28T20:17:08.129 INFO:teuthology.orchestra.run.smithi001.stdout:176093659190 2024-08-28T20:17:08.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f24ec0b4bc0 msgr2=0x7f24ec0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f24ec0b4bc0 0x7f24ec0b70d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2508115f20 tx=0x7f24f4005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 msgr2=0x7f25081a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 0x7f25081a0770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24f800d950 tx=0x7f24f800de10 comp rx=0 tx=0).stop 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 shutdown_connections 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f24ec0b4bc0 0x7f24ec0b70d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25081141f0 0x7f25081a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2508077120 0x7f25081a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 --2- 172.21.15.1:0/904314550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2508075b70 0x7f25081a0770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 >> 172.21.15.1:0/904314550 conn(0x7f25080ff370 msgr2=0x7f25081100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 shutdown_connections 2024-08-28T20:17:08.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:08.130+0000 7f250d600640 1 -- 172.21.15.1:0/904314550 wait complete. 2024-08-28T20:17:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:07 smithi121 ceph-mon[25248]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:08.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:07 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1918877726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-28T20:17:09.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:08 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/904314550' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-28T20:17:09.078 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:08 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/904314550' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-28T20:17:09.080 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411403 for osd.2 2024-08-28T20:17:09.080 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:09.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:08 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/904314550' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-28T20:17:09.986 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168613 got 240518168615 for osd.9 2024-08-28T20:17:09.987 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:09 smithi007 ceph-mon[25357]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:10.176 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:09 smithi001 ceph-mon[20984]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:09 smithi121 ceph-mon[25248]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:10.387 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574926 for osd.1 2024-08-28T20:17:10.387 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 -- 172.21.15.1:0/1852671302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 msgr2=0x7f29f010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 --2- 172.21.15.1:0/1852671302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 0x7f29f010d610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009900 tx=0x7f29dc02a400 comp rx=0 tx=0).stop 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 -- 172.21.15.1:0/1852671302 shutdown_connections 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 --2- 172.21.15.1:0/1852671302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 --2- 172.21.15.1:0/1852671302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 0x7f29f010d610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 --2- 172.21.15.1:0/1852671302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f0104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 -- 172.21.15.1:0/1852671302 >> 172.21.15.1:0/1852671302 conn(0x7f29f00794e0 msgr2=0x7f29f00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 -- 172.21.15.1:0/1852671302 shutdown_connections 2024-08-28T20:17:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.685+0000 7f29f5200640 1 -- 172.21.15.1:0/1852671302 wait complete. 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.686+0000 7f29f5200640 1 Processor -- start 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.686+0000 7f29f5200640 1 -- start start 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29f5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29f5200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 0x7f29f019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29f5200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29f5200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01137f0 con 0x7f29f010dbd0 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29f5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0113670 con 0x7f29f0104770 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29f5200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0113970 con 0x7f29f01050c0 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ee800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ee800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50126/0 (socket says 172.21.15.1:50126) 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f019c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:53166/0 (socket says 172.21.15.1:53166) 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ed400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 0x7f29f019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ee800640 1 -- 172.21.15.1:0/1101977982 learned_addr learned my addr 172.21.15.1:0/1101977982 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ede00640 1 -- 172.21.15.1:0/1101977982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 msgr2=0x7f29f019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.687+0000 7f29ede00640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 0x7f29f019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29ede00640 1 -- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 msgr2=0x7f29f01a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29ede00640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29ede00640 1 -- 172.21.15.1:0/1101977982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f01a23b0 con 0x7f29f0104770 2024-08-28T20:17:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29ee800640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29ede00640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f019c440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f29e000e9c0 tx=0x7f29e000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e000ccc0 con 0x7f29f0104770 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f01a26a0 con 0x7f29f0104770 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e00035f0 con 0x7f29f0104770 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e000ce60 con 0x7f29f0104770 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.688+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01a8e00 con 0x7f29f0104770 2024-08-28T20:17:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.689+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f006bfe0 con 0x7f29f0104770 2024-08-28T20:17:10.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.692+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f29e0004000 con 0x7f29f0104770 2024-08-28T20:17:10.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.693+0000 7f29e6a00640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f29d40b4bc0 0x7f29d40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:10.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.693+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f29e00e5800 con 0x7f29f0104770 2024-08-28T20:17:10.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.694+0000 7f29ed400640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f29d40b4bc0 0x7f29d40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:10.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.694+0000 7f29ed400640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f29d40b4bc0 0x7f29d40b70d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009230 tx=0x7f29dc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:10.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.695+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29e00ac7f0 con 0x7f29f0104770 2024-08-28T20:17:10.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.903+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f29f019d570 con 0x7f29f0104770 2024-08-28T20:17:10.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.903+0000 7f29e6a00640 1 -- 172.21.15.1:0/1101977982 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f29e00ac0f0 con 0x7f29f0104770 2024-08-28T20:17:10.905 INFO:teuthology.orchestra.run.smithi001.stdout:261993005091 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f29d40b4bc0 msgr2=0x7f29d40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f29d40b4bc0 0x7f29d40b70d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009230 tx=0x7f29dc031400 comp rx=0 tx=0).stop 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 msgr2=0x7f29f019c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f019c440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f29e000e9c0 tx=0x7f29e000ee80 comp rx=0 tx=0).stop 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 shutdown_connections 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f29d40b4bc0 0x7f29d40b70d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29f010dbd0 0x7f29f01a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29f01050c0 0x7f29f019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 --2- 172.21.15.1:0/1101977982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f0104770 0x7f29f019c440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 >> 172.21.15.1:0/1101977982 conn(0x7f29f00794e0 msgr2=0x7f29f01099c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.906+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 shutdown_connections 2024-08-28T20:17:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:10.907+0000 7f29f5200640 1 -- 172.21.15.1:0/1101977982 wait complete. 2024-08-28T20:17:11.686 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005085 got 261993005091 for osd.10 2024-08-28T20:17:11.687 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:11.900 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:11 smithi001 ceph-mon[20984]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:11.900 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:11 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1101977982' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 -- 172.21.15.1:0/910063279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a010b470 msgr2=0x7f05a010b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 --2- 172.21.15.1:0/910063279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a010b470 0x7f05a010b880 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f058c009900 tx=0x7f058c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 -- 172.21.15.1:0/910063279 shutdown_connections 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 --2- 172.21.15.1:0/910063279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a010b470 0x7f05a010b880 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 --2- 172.21.15.1:0/910063279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a010bdc0 0x7f05a01125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 --2- 172.21.15.1:0/910063279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05a0105b30 0x7f05a0105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 -- 172.21.15.1:0/910063279 >> 172.21.15.1:0/910063279 conn(0x7f05a0101600 msgr2=0x7f05a0103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 -- 172.21.15.1:0/910063279 shutdown_connections 2024-08-28T20:17:11.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.976+0000 7f05a5000640 1 -- 172.21.15.1:0/910063279 wait complete. 2024-08-28T20:17:11.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.977+0000 7f05a5000640 1 Processor -- start 2024-08-28T20:17:11.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.977+0000 7f05a5000640 1 -- start start 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f05a5000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 0x7f05a019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f05a5000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a010b470 0x7f05a019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f05a5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05a010bdc0 0x7f05a01a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f05a5000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0115ad0 con 0x7f05a0105b30 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f05a5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0115950 con 0x7f05a010bdc0 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f05a5000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0115c50 con 0x7f05a010b470 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f059de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 0x7f05a019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f059de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 0x7f05a019c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50152/0 (socket says 172.21.15.1:50152) 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f059e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05a010bdc0 0x7f05a01a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:11.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f059de00640 1 -- 172.21.15.1:0/743492173 learned_addr learned my addr 172.21.15.1:0/743492173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:11.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.978+0000 7f059d400640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a010b470 0x7f05a019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f059de00640 1 -- 172.21.15.1:0/743492173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a010b470 msgr2=0x7f05a019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f059de00640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a010b470 0x7f05a019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f059de00640 1 -- 172.21.15.1:0/743492173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05a010bdc0 msgr2=0x7f05a01a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f059de00640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05a010bdc0 0x7f05a01a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f059de00640 1 -- 172.21.15.1:0/743492173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a01a2510 con 0x7f05a0105b30 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f059de00640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 0x7f05a019c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f059000e9f0 tx=0x7f059000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059000cd80 con 0x7f05a0105b30 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a01a2800 con 0x7f05a0105b30 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05900108e0 con 0x7f05a0105b30 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590018980 con 0x7f05a0105b30 2024-08-28T20:17:11.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.979+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a01a8f60 con 0x7f05a0105b30 2024-08-28T20:17:11.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.981+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a0105f40 con 0x7f05a0105b30 2024-08-28T20:17:11.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.983+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f0590010430 con 0x7f05a0105b30 2024-08-28T20:17:11.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.984+0000 7f0596a00640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f05840b4c40 0x7f05840b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.985+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f05900e55c0 con 0x7f05a0105b30 2024-08-28T20:17:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.985+0000 7f059d400640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f05840b4c40 0x7f05840b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.985+0000 7f059d400640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f05840b4c40 0x7f05840b7150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f058c02a9e0 tx=0x7f058c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:11.989+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f05900abed0 con 0x7f05a0105b30 2024-08-28T20:17:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:11 smithi007 ceph-mon[25357]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:11 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1101977982' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-28T20:17:12.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.186+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f05a010d620 con 0x7f05a0105b30 2024-08-28T20:17:12.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.187+0000 7f0596a00640 1 -- 172.21.15.1:0/743492173 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f05900b0690 con 0x7f05a0105b30 2024-08-28T20:17:12.189 INFO:teuthology.orchestra.run.smithi001.stdout:283467841565 2024-08-28T20:17:12.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f05840b4c40 msgr2=0x7f05840b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:12.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f05840b4c40 0x7f05840b7150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f058c02a9e0 tx=0x7f058c005a20 comp rx=0 tx=0).stop 2024-08-28T20:17:12.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 msgr2=0x7f05a019c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 0x7f05a019c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f059000e9f0 tx=0x7f059000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 shutdown_connections 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f05840b4c40 0x7f05840b7150 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05a010bdc0 0x7f05a01a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a010b470 0x7f05a019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 --2- 172.21.15.1:0/743492173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05a0105b30 0x7f05a019c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 >> 172.21.15.1:0/743492173 conn(0x7f05a0101600 msgr2=0x7f05a010ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 shutdown_connections 2024-08-28T20:17:12.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:12.190+0000 7f05a5000640 1 -- 172.21.15.1:0/743492173 wait complete. 2024-08-28T20:17:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:11 smithi121 ceph-mon[25248]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:11 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1101977982' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-28T20:17:12.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659186 got 176093659190 for osd.6 2024-08-28T20:17:12.613 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:12.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:12 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/743492173' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-28T20:17:13.115 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841561 got 283467841565 for osd.11 2024-08-28T20:17:13.115 DEBUG:teuthology.parallel:result is None 2024-08-28T20:17:13.115 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-28T20:17:13.115 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T20:17:13.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:12 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/743492173' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-28T20:17:13.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:12 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/743492173' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-28T20:17:13.532 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:13 smithi001 ceph-mon[20984]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:13 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:14.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 -- 172.21.15.1:0/1687542180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d28104560 msgr2=0x7f2d28104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:14.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/1687542180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d28104560 0x7f2d28104970 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009900 tx=0x7f2d1c02a410 comp rx=0 tx=0).stop 2024-08-28T20:17:14.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 -- 172.21.15.1:0/1687542180 shutdown_connections 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/1687542180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d2810d9c0 0x7f2d2810feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/1687542180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104eb0 0x7f2d2810d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/1687542180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d28104560 0x7f2d28104970 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.185+0000 7f2d2ea00640 1 -- 172.21.15.1:0/1687542180 >> 172.21.15.1:0/1687542180 conn(0x7f2d280fe060 msgr2=0x7f2d281004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.186+0000 7f2d2ea00640 1 -- 172.21.15.1:0/1687542180 shutdown_connections 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.186+0000 7f2d2ea00640 1 -- 172.21.15.1:0/1687542180 wait complete. 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.187+0000 7f2d2ea00640 1 Processor -- start 2024-08-28T20:17:14.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.187+0000 7f2d2ea00640 1 -- start start 2024-08-28T20:17:14.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104560 0x7f2d281022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:14.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d28104eb0 0x7f2d281027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:14.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d2810d9c0 0x7f2d28102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2ea00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d28113630 con 0x7f2d2810d9c0 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281134b0 con 0x7f2d28104560 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2ea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281137b0 con 0x7f2d28104eb0 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104560 0x7f2d281022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104560 0x7f2d281022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:53186/0 (socket says 172.21.15.1:53186) 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2d600640 1 -- 172.21.15.1:0/3557967858 learned_addr learned my addr 172.21.15.1:0/3557967858 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.188+0000 7f2d2cc00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d28104eb0 0x7f2d281027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:14.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.189+0000 7f2d2e000640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d2810d9c0 0x7f2d28102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:14.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.189+0000 7f2d2cc00640 1 -- 172.21.15.1:0/3557967858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104560 msgr2=0x7f2d281022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:14.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.189+0000 7f2d2cc00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104560 0x7f2d281022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.189+0000 7f2d2cc00640 1 -- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d2810d9c0 msgr2=0x7f2d28102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.189+0000 7f2d2cc00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d2810d9c0 0x7f2d28102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.189+0000 7f2d2cc00640 1 -- 172.21.15.1:0/3557967858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d281a8360 con 0x7f2d28104eb0 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.190+0000 7f2d2cc00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d28104eb0 0x7f2d281027e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d2806a830 tx=0x7f2d1400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.190+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400cc40 con 0x7f2d28104eb0 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.190+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d1400cde0 con 0x7f2d28104eb0 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.190+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14018780 con 0x7f2d28104eb0 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.191+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d281a8650 con 0x7f2d28104eb0 2024-08-28T20:17:14.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.191+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d281a8b40 con 0x7f2d28104eb0 2024-08-28T20:17:14.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.192+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d28104970 con 0x7f2d28104eb0 2024-08-28T20:17:14.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.195+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f2d14010a90 con 0x7f2d28104eb0 2024-08-28T20:17:14.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.197+0000 7f2d26000640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2d100b4c40 0x7f2d100b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:14.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.198+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2d140e55a0 con 0x7f2d28104eb0 2024-08-28T20:17:14.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.198+0000 7f2d2d600640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2d100b4c40 0x7f2d100b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:14.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.198+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2d140e5a20 con 0x7f2d28104eb0 2024-08-28T20:17:14.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.199+0000 7f2d2d600640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2d100b4c40 0x7f2d100b7150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009230 tx=0x7f2d1c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:13 smithi121 ceph-mon[25248]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:14.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:13 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:13 smithi007 ceph-mon[25357]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:13 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:14.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.391+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d28106ae0 con 0x7f2d100b4c40 2024-08-28T20:17:14.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.395+0000 7f2d26000640 1 -- 172.21.15.1:0/3557967858 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258705 (secure 0 0 0) 0x7f2d28106ae0 con 0x7f2d100b4c40 2024-08-28T20:17:14.400 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:14.401 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2d100b4c40 msgr2=0x7f2d100b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2d100b4c40 0x7f2d100b7150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009230 tx=0x7f2d1c0058d0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d28104eb0 msgr2=0x7f2d281027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d28104eb0 0x7f2d281027e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d2806a830 tx=0x7f2d1400ee50 comp rx=0 tx=0).stop 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 shutdown_connections 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2d100b4c40 0x7f2d100b7150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d2810d9c0 0x7f2d28102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d28104eb0 0x7f2d281027e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 --2- 172.21.15.1:0/3557967858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d28104560 0x7f2d281022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 >> 172.21.15.1:0/3557967858 conn(0x7f2d280fe060 msgr2=0x7f2d281063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 shutdown_connections 2024-08-28T20:17:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:14.400+0000 7f2d2ea00640 1 -- 172.21.15.1:0/3557967858 wait complete. 2024-08-28T20:17:15.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:17:15.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:17:15.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:14 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:15.153 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-08-28T20:17:14.181299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654203,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":478,"num_read_kb":330,"num_write":287,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":2954152,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373608,"kb_used_data":11868,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568216,"statfs":{"total":1151940427776,"available":1151557853184,"internally_reserved":0,"allocated":12152832,"data_stored":6806877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003336"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258561+0000","last_change":"2024-08-28T20:15:53.090200+0000","last_active":"2024-08-28T20:16:09.258561+0000","last_peered":"2024-08-28T20:16:09.258561+0000","last_clean":"2024-08-28T20:16:09.258561+0000","last_became_active":"2024-08-28T20:15:53.089819+0000","last_became_peered":"2024-08-28T20:15:53.089819+0000","last_unstale":"2024-08-28T20:16:09.258561+0000","last_undegraded":"2024-08-28T20:16:09.258561+0000","last_fullsized":"2024-08-28T20:16:09.258561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:24:35.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260865+0000","last_change":"2024-08-28T20:15:53.094139+0000","last_active":"2024-08-28T20:16:09.260865+0000","last_peered":"2024-08-28T20:16:09.260865+0000","last_clean":"2024-08-28T20:16:09.260865+0000","last_became_active":"2024-08-28T20:15:53.093920+0000","last_became_peered":"2024-08-28T20:15:53.093920+0000","last_unstale":"2024-08-28T20:16:09.260865+0000","last_undegraded":"2024-08-28T20:16:09.260865+0000","last_fullsized":"2024-08-28T20:16:09.260865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:50:00.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261007+0000","last_change":"2024-08-28T20:15:53.087364+0000","last_active":"2024-08-28T20:16:09.261007+0000","last_peered":"2024-08-28T20:16:09.261007+0000","last_clean":"2024-08-28T20:16:09.261007+0000","last_became_active":"2024-08-28T20:15:53.087030+0000","last_became_peered":"2024-08-28T20:15:53.087030+0000","last_unstale":"2024-08-28T20:16:09.261007+0000","last_undegraded":"2024-08-28T20:16:09.261007+0000","last_fullsized":"2024-08-28T20:16:09.261007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:27:40.000046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255390+0000","last_change":"2024-08-28T20:15:53.072409+0000","last_active":"2024-08-28T20:16:09.255390+0000","last_peered":"2024-08-28T20:16:09.255390+0000","last_clean":"2024-08-28T20:16:09.255390+0000","last_became_active":"2024-08-28T20:15:53.071946+0000","last_became_peered":"2024-08-28T20:15:53.071946+0000","last_unstale":"2024-08-28T20:16:09.255390+0000","last_undegraded":"2024-08-28T20:16:09.255390+0000","last_fullsized":"2024-08-28T20:16:09.255390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:14:07.246976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254046+0000","last_change":"2024-08-28T20:15:53.084238+0000","last_active":"2024-08-28T20:16:09.254046+0000","last_peered":"2024-08-28T20:16:09.254046+0000","last_clean":"2024-08-28T20:16:09.254046+0000","last_became_active":"2024-08-28T20:15:53.083835+0000","last_became_peered":"2024-08-28T20:15:53.083835+0000","last_unstale":"2024-08-28T20:16:09.254046+0000","last_undegraded":"2024-08-28T20:16:09.254046+0000","last_fullsized":"2024-08-28T20:16:09.254046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:50:19.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250676+0000","last_change":"2024-08-28T20:15:53.071186+0000","last_active":"2024-08-28T20:16:09.250676+0000","last_peered":"2024-08-28T20:16:09.250676+0000","last_clean":"2024-08-28T20:16:09.250676+0000","last_became_active":"2024-08-28T20:15:53.070764+0000","last_became_peered":"2024-08-28T20:15:53.070764+0000","last_unstale":"2024-08-28T20:16:09.250676+0000","last_undegraded":"2024-08-28T20:16:09.250676+0000","last_fullsized":"2024-08-28T20:16:09.250676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:21.079888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256210+0000","last_change":"2024-08-28T20:15:53.079022+0000","last_active":"2024-08-28T20:16:09.256210+0000","last_peered":"2024-08-28T20:16:09.256210+0000","last_clean":"2024-08-28T20:16:09.256210+0000","last_became_active":"2024-08-28T20:15:53.078618+0000","last_became_peered":"2024-08-28T20:15:53.078618+0000","last_unstale":"2024-08-28T20:16:09.256210+0000","last_undegraded":"2024-08-28T20:16:09.256210+0000","last_fullsized":"2024-08-28T20:16:09.256210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:49:09.296997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250232+0000","last_change":"2024-08-28T20:15:53.068898+0000","last_active":"2024-08-28T20:16:09.250232+0000","last_peered":"2024-08-28T20:16:09.250232+0000","last_clean":"2024-08-28T20:16:09.250232+0000","last_became_active":"2024-08-28T20:15:53.068578+0000","last_became_peered":"2024-08-28T20:15:53.068578+0000","last_unstale":"2024-08-28T20:16:09.250232+0000","last_undegraded":"2024-08-28T20:16:09.250232+0000","last_fullsized":"2024-08-28T20:16:09.250232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:53:30.220402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255901+0000","last_change":"2024-08-28T20:15:53.077445+0000","last_active":"2024-08-28T20:16:09.255901+0000","last_peered":"2024-08-28T20:16:09.255901+0000","last_clean":"2024-08-28T20:16:09.255901+0000","last_became_active":"2024-08-28T20:15:53.077060+0000","last_became_peered":"2024-08-28T20:15:53.077060+0000","last_unstale":"2024-08-28T20:16:09.255901+0000","last_undegraded":"2024-08-28T20:16:09.255901+0000","last_fullsized":"2024-08-28T20:16:09.255901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:52.441510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259634+0000","last_change":"2024-08-28T20:16:09.259500+0000","last_active":"2024-08-28T20:16:09.259634+0000","last_peered":"2024-08-28T20:16:09.259634+0000","last_clean":"2024-08-28T20:16:09.259634+0000","last_became_active":"2024-08-28T20:16:09.258797+0000","last_became_peered":"2024-08-28T20:16:09.258797+0000","last_unstale":"2024-08-28T20:16:09.259634+0000","last_undegraded":"2024-08-28T20:16:09.259634+0000","last_fullsized":"2024-08-28T20:16:09.259634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:08.497860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256722+0000","last_change":"2024-08-28T20:15:53.080978+0000","last_active":"2024-08-28T20:16:09.256722+0000","last_peered":"2024-08-28T20:16:09.256722+0000","last_clean":"2024-08-28T20:16:09.256722+0000","last_became_active":"2024-08-28T20:15:53.080608+0000","last_became_peered":"2024-08-28T20:15:53.080608+0000","last_unstale":"2024-08-28T20:16:09.256722+0000","last_undegraded":"2024-08-28T20:16:09.256722+0000","last_fullsized":"2024-08-28T20:16:09.256722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:18:03.005125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256938+0000","last_change":"2024-08-28T20:15:53.067312+0000","last_active":"2024-08-28T20:16:09.256938+0000","last_peered":"2024-08-28T20:16:09.256938+0000","last_clean":"2024-08-28T20:16:09.256938+0000","last_became_active":"2024-08-28T20:15:53.066802+0000","last_became_peered":"2024-08-28T20:15:53.066802+0000","last_unstale":"2024-08-28T20:16:09.256938+0000","last_undegraded":"2024-08-28T20:16:09.256938+0000","last_fullsized":"2024-08-28T20:16:09.256938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:27:28.079309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253418+0000","last_change":"2024-08-28T20:15:53.077877+0000","last_active":"2024-08-28T20:16:09.253418+0000","last_peered":"2024-08-28T20:16:09.253418+0000","last_clean":"2024-08-28T20:16:09.253418+0000","last_became_active":"2024-08-28T20:15:53.077374+0000","last_became_peered":"2024-08-28T20:15:53.077374+0000","last_unstale":"2024-08-28T20:16:09.253418+0000","last_undegraded":"2024-08-28T20:16:09.253418+0000","last_fullsized":"2024-08-28T20:16:09.253418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:27:34.692183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260489+0000","last_change":"2024-08-28T20:15:53.090043+0000","last_active":"2024-08-28T20:16:09.260489+0000","last_peered":"2024-08-28T20:16:09.260489+0000","last_clean":"2024-08-28T20:16:09.260489+0000","last_became_active":"2024-08-28T20:15:53.089693+0000","last_became_peered":"2024-08-28T20:15:53.089693+0000","last_unstale":"2024-08-28T20:16:09.260489+0000","last_undegraded":"2024-08-28T20:16:09.260489+0000","last_fullsized":"2024-08-28T20:16:09.260489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:04:10.505280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259563+0000","last_change":"2024-08-28T20:15:53.090981+0000","last_active":"2024-08-28T20:16:09.259563+0000","last_peered":"2024-08-28T20:16:09.259563+0000","last_clean":"2024-08-28T20:16:09.259563+0000","last_became_active":"2024-08-28T20:15:53.087896+0000","last_became_peered":"2024-08-28T20:15:53.087896+0000","last_unstale":"2024-08-28T20:16:09.259563+0000","last_undegraded":"2024-08-28T20:16:09.259563+0000","last_fullsized":"2024-08-28T20:16:09.259563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:35.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254797+0000","last_change":"2024-08-28T20:15:53.090219+0000","last_active":"2024-08-28T20:16:09.254797+0000","last_peered":"2024-08-28T20:16:09.254797+0000","last_clean":"2024-08-28T20:16:09.254797+0000","last_became_active":"2024-08-28T20:15:53.089683+0000","last_became_peered":"2024-08-28T20:15:53.089683+0000","last_unstale":"2024-08-28T20:16:09.254797+0000","last_undegraded":"2024-08-28T20:16:09.254797+0000","last_fullsized":"2024-08-28T20:16:09.254797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:12:04.413154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258615+0000","last_change":"2024-08-28T20:15:53.091256+0000","last_active":"2024-08-28T20:16:09.258615+0000","last_peered":"2024-08-28T20:16:09.258615+0000","last_clean":"2024-08-28T20:16:09.258615+0000","last_became_active":"2024-08-28T20:15:53.090869+0000","last_became_peered":"2024-08-28T20:15:53.090869+0000","last_unstale":"2024-08-28T20:16:09.258615+0000","last_undegraded":"2024-08-28T20:16:09.258615+0000","last_fullsized":"2024-08-28T20:16:09.258615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:35:49.475470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255033+0000","last_change":"2024-08-28T20:15:53.077695+0000","last_active":"2024-08-28T20:16:09.255033+0000","last_peered":"2024-08-28T20:16:09.255033+0000","last_clean":"2024-08-28T20:16:09.255033+0000","last_became_active":"2024-08-28T20:15:53.077243+0000","last_became_peered":"2024-08-28T20:15:53.077243+0000","last_unstale":"2024-08-28T20:16:09.255033+0000","last_undegraded":"2024-08-28T20:16:09.255033+0000","last_fullsized":"2024-08-28T20:16:09.255033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:09:37.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254063+0000","last_change":"2024-08-28T20:15:53.095662+0000","last_active":"2024-08-28T20:16:09.254063+0000","last_peered":"2024-08-28T20:16:09.254063+0000","last_clean":"2024-08-28T20:16:09.254063+0000","last_became_active":"2024-08-28T20:15:53.095211+0000","last_became_peered":"2024-08-28T20:15:53.095211+0000","last_unstale":"2024-08-28T20:16:09.254063+0000","last_undegraded":"2024-08-28T20:16:09.254063+0000","last_fullsized":"2024-08-28T20:16:09.254063+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:58.137756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258204+0000","last_change":"2024-08-28T20:15:53.076938+0000","last_active":"2024-08-28T20:16:09.258204+0000","last_peered":"2024-08-28T20:16:09.258204+0000","last_clean":"2024-08-28T20:16:09.258204+0000","last_became_active":"2024-08-28T20:15:53.076445+0000","last_became_peered":"2024-08-28T20:15:53.076445+0000","last_unstale":"2024-08-28T20:16:09.258204+0000","last_undegraded":"2024-08-28T20:16:09.258204+0000","last_fullsized":"2024-08-28T20:16:09.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:13:53.477053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253506+0000","last_change":"2024-08-28T20:15:53.094262+0000","last_active":"2024-08-28T20:16:09.253506+0000","last_peered":"2024-08-28T20:16:09.253506+0000","last_clean":"2024-08-28T20:16:09.253506+0000","last_became_active":"2024-08-28T20:15:53.093927+0000","last_became_peered":"2024-08-28T20:15:53.093927+0000","last_unstale":"2024-08-28T20:16:09.253506+0000","last_undegraded":"2024-08-28T20:16:09.253506+0000","last_fullsized":"2024-08-28T20:16:09.253506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:04:46.586527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255159+0000","last_change":"2024-08-28T20:15:53.081244+0000","last_active":"2024-08-28T20:16:09.255159+0000","last_peered":"2024-08-28T20:16:09.255159+0000","last_clean":"2024-08-28T20:16:09.255159+0000","last_became_active":"2024-08-28T20:15:53.080813+0000","last_became_peered":"2024-08-28T20:15:53.080813+0000","last_unstale":"2024-08-28T20:16:09.255159+0000","last_undegraded":"2024-08-28T20:16:09.255159+0000","last_fullsized":"2024-08-28T20:16:09.255159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:31.052514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250252+0000","last_change":"2024-08-28T20:15:53.084469+0000","last_active":"2024-08-28T20:16:09.250252+0000","last_peered":"2024-08-28T20:16:09.250252+0000","last_clean":"2024-08-28T20:16:09.250252+0000","last_became_active":"2024-08-28T20:15:53.083815+0000","last_became_peered":"2024-08-28T20:15:53.083815+0000","last_unstale":"2024-08-28T20:16:09.250252+0000","last_undegraded":"2024-08-28T20:16:09.250252+0000","last_fullsized":"2024-08-28T20:16:09.250252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:36.615505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251099+0000","last_change":"2024-08-28T20:15:53.063396+0000","last_active":"2024-08-28T20:16:09.251099+0000","last_peered":"2024-08-28T20:16:09.251099+0000","last_clean":"2024-08-28T20:16:09.251099+0000","last_became_active":"2024-08-28T20:15:53.062970+0000","last_became_peered":"2024-08-28T20:15:53.062970+0000","last_unstale":"2024-08-28T20:16:09.251099+0000","last_undegraded":"2024-08-28T20:16:09.251099+0000","last_fullsized":"2024-08-28T20:16:09.251099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:50:44.559623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250848+0000","last_change":"2024-08-28T20:15:53.085787+0000","last_active":"2024-08-28T20:16:09.250848+0000","last_peered":"2024-08-28T20:16:09.250848+0000","last_clean":"2024-08-28T20:16:09.250848+0000","last_became_active":"2024-08-28T20:15:53.085449+0000","last_became_peered":"2024-08-28T20:15:53.085449+0000","last_unstale":"2024-08-28T20:16:09.250848+0000","last_undegraded":"2024-08-28T20:16:09.250848+0000","last_fullsized":"2024-08-28T20:16:09.250848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:00:35.687940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254477+0000","last_change":"2024-08-28T20:15:53.079482+0000","last_active":"2024-08-28T20:16:09.254477+0000","last_peered":"2024-08-28T20:16:09.254477+0000","last_clean":"2024-08-28T20:16:09.254477+0000","last_became_active":"2024-08-28T20:15:53.079046+0000","last_became_peered":"2024-08-28T20:15:53.079046+0000","last_unstale":"2024-08-28T20:16:09.254477+0000","last_undegraded":"2024-08-28T20:16:09.254477+0000","last_fullsized":"2024-08-28T20:16:09.254477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:51:50.026095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258263+0000","last_change":"2024-08-28T20:15:53.075651+0000","last_active":"2024-08-28T20:16:09.258263+0000","last_peered":"2024-08-28T20:16:09.258263+0000","last_clean":"2024-08-28T20:16:09.258263+0000","last_became_active":"2024-08-28T20:15:53.075231+0000","last_became_peered":"2024-08-28T20:15:53.075231+0000","last_unstale":"2024-08-28T20:16:09.258263+0000","last_undegraded":"2024-08-28T20:16:09.258263+0000","last_fullsized":"2024-08-28T20:16:09.258263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:50.828987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253693+0000","last_change":"2024-08-28T20:15:53.097623+0000","last_active":"2024-08-28T20:16:09.253693+0000","last_peered":"2024-08-28T20:16:09.253693+0000","last_clean":"2024-08-28T20:16:09.253693+0000","last_became_active":"2024-08-28T20:15:53.095633+0000","last_became_peered":"2024-08-28T20:15:53.095633+0000","last_unstale":"2024-08-28T20:16:09.253693+0000","last_undegraded":"2024-08-28T20:16:09.253693+0000","last_fullsized":"2024-08-28T20:16:09.253693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:05.559906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260644+0000","last_change":"2024-08-28T20:15:53.078030+0000","last_active":"2024-08-28T20:16:09.260644+0000","last_peered":"2024-08-28T20:16:09.260644+0000","last_clean":"2024-08-28T20:16:09.260644+0000","last_became_active":"2024-08-28T20:15:53.076535+0000","last_became_peered":"2024-08-28T20:15:53.076535+0000","last_unstale":"2024-08-28T20:16:09.260644+0000","last_undegraded":"2024-08-28T20:16:09.260644+0000","last_fullsized":"2024-08-28T20:16:09.260644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:33:07.028039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253467+0000","last_change":"2024-08-28T20:15:53.096481+0000","last_active":"2024-08-28T20:16:09.253467+0000","last_peered":"2024-08-28T20:16:09.253467+0000","last_clean":"2024-08-28T20:16:09.253467+0000","last_became_active":"2024-08-28T20:15:53.096098+0000","last_became_peered":"2024-08-28T20:15:53.096098+0000","last_unstale":"2024-08-28T20:16:09.253467+0000","last_undegraded":"2024-08-28T20:16:09.253467+0000","last_fullsized":"2024-08-28T20:16:09.253467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:31:35.450650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254251+0000","last_change":"2024-08-28T20:15:53.070940+0000","last_active":"2024-08-28T20:16:09.254251+0000","last_peered":"2024-08-28T20:16:09.254251+0000","last_clean":"2024-08-28T20:16:09.254251+0000","last_became_active":"2024-08-28T20:15:53.070559+0000","last_became_peered":"2024-08-28T20:15:53.070559+0000","last_unstale":"2024-08-28T20:16:09.254251+0000","last_undegraded":"2024-08-28T20:16:09.254251+0000","last_fullsized":"2024-08-28T20:16:09.254251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:04:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257928+0000","last_change":"2024-08-28T20:15:53.071293+0000","last_active":"2024-08-28T20:16:09.257928+0000","last_peered":"2024-08-28T20:16:09.257928+0000","last_clean":"2024-08-28T20:16:09.257928+0000","last_became_active":"2024-08-28T20:15:53.070937+0000","last_became_peered":"2024-08-28T20:15:53.070937+0000","last_unstale":"2024-08-28T20:16:09.257928+0000","last_undegraded":"2024-08-28T20:16:09.257928+0000","last_fullsized":"2024-08-28T20:16:09.257928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:20:03.463030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254102+0000","last_change":"2024-08-28T20:15:53.080834+0000","last_active":"2024-08-28T20:16:09.254102+0000","last_peered":"2024-08-28T20:16:09.254102+0000","last_clean":"2024-08-28T20:16:09.254102+0000","last_became_active":"2024-08-28T20:15:53.080446+0000","last_became_peered":"2024-08-28T20:15:53.080446+0000","last_unstale":"2024-08-28T20:16:09.254102+0000","last_undegraded":"2024-08-28T20:16:09.254102+0000","last_fullsized":"2024-08-28T20:16:09.254102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:30:31.404656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:10.362397+0000","last_change":"2024-08-28T20:15:50.038701+0000","last_active":"2024-08-28T20:17:10.362397+0000","last_peered":"2024-08-28T20:17:10.362397+0000","last_clean":"2024-08-28T20:17:10.362397+0000","last_became_active":"2024-08-28T20:15:50.038383+0000","last_became_peered":"2024-08-28T20:15:50.038383+0000","last_unstale":"2024-08-28T20:17:10.362397+0000","last_undegraded":"2024-08-28T20:17:10.362397+0000","last_fullsized":"2024-08-28T20:17:10.362397+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:20:03.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251526+0000","last_change":"2024-08-28T20:15:53.058433+0000","last_active":"2024-08-28T20:16:09.251526+0000","last_peered":"2024-08-28T20:16:09.251526+0000","last_clean":"2024-08-28T20:16:09.251526+0000","last_became_active":"2024-08-28T20:15:53.058088+0000","last_became_peered":"2024-08-28T20:15:53.058088+0000","last_unstale":"2024-08-28T20:16:09.251526+0000","last_undegraded":"2024-08-28T20:16:09.251526+0000","last_fullsized":"2024-08-28T20:16:09.251526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:58:10.507808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.264327+0000","last_change":"2024-08-28T20:16:09.264205+0000","last_active":"2024-08-28T20:16:09.264327+0000","last_peered":"2024-08-28T20:16:09.264327+0000","last_clean":"2024-08-28T20:16:09.264327+0000","last_became_active":"2024-08-28T20:16:09.257407+0000","last_became_peered":"2024-08-28T20:16:09.257407+0000","last_unstale":"2024-08-28T20:16:09.264327+0000","last_undegraded":"2024-08-28T20:16:09.264327+0000","last_fullsized":"2024-08-28T20:16:09.264327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:57:44.507993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252938+0000","last_change":"2024-08-28T20:15:50.038447+0000","last_active":"2024-08-28T20:16:09.252938+0000","last_peered":"2024-08-28T20:16:09.252938+0000","last_clean":"2024-08-28T20:16:09.252938+0000","last_became_active":"2024-08-28T20:15:50.037428+0000","last_became_peered":"2024-08-28T20:15:50.037428+0000","last_unstale":"2024-08-28T20:16:09.252938+0000","last_undegraded":"2024-08-28T20:16:09.252938+0000","last_fullsized":"2024-08-28T20:16:09.252938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:31:36.805904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250318+0000","last_change":"2024-08-28T20:15:53.086731+0000","last_active":"2024-08-28T20:16:09.250318+0000","last_peered":"2024-08-28T20:16:09.250318+0000","last_clean":"2024-08-28T20:16:09.250318+0000","last_became_active":"2024-08-28T20:15:53.086300+0000","last_became_peered":"2024-08-28T20:15:53.086300+0000","last_unstale":"2024-08-28T20:16:09.250318+0000","last_undegraded":"2024-08-28T20:16:09.250318+0000","last_fullsized":"2024-08-28T20:16:09.250318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:33:30.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251493+0000","last_change":"2024-08-28T20:15:50.037252+0000","last_active":"2024-08-28T20:16:09.251493+0000","last_peered":"2024-08-28T20:16:09.251493+0000","last_clean":"2024-08-28T20:16:09.251493+0000","last_became_active":"2024-08-28T20:15:50.036778+0000","last_became_peered":"2024-08-28T20:15:50.036778+0000","last_unstale":"2024-08-28T20:16:09.251493+0000","last_undegraded":"2024-08-28T20:16:09.251493+0000","last_fullsized":"2024-08-28T20:16:09.251493+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:11:16.685741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254245+0000","last_change":"2024-08-28T20:15:53.070510+0000","last_active":"2024-08-28T20:16:09.254245+0000","last_peered":"2024-08-28T20:16:09.254245+0000","last_clean":"2024-08-28T20:16:09.254245+0000","last_became_active":"2024-08-28T20:15:53.070006+0000","last_became_peered":"2024-08-28T20:15:53.070006+0000","last_unstale":"2024-08-28T20:16:09.254245+0000","last_undegraded":"2024-08-28T20:16:09.254245+0000","last_fullsized":"2024-08-28T20:16:09.254245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:06.081692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:07.356509+0000","last_change":"2024-08-28T20:15:50.036777+0000","last_active":"2024-08-28T20:17:07.356509+0000","last_peered":"2024-08-28T20:17:07.356509+0000","last_clean":"2024-08-28T20:17:07.356509+0000","last_became_active":"2024-08-28T20:15:50.036329+0000","last_became_peered":"2024-08-28T20:15:50.036329+0000","last_unstale":"2024-08-28T20:17:07.356509+0000","last_undegraded":"2024-08-28T20:17:07.356509+0000","last_fullsized":"2024-08-28T20:17:07.356509+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:58:06.285314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255588+0000","last_change":"2024-08-28T20:15:53.077888+0000","last_active":"2024-08-28T20:16:09.255588+0000","last_peered":"2024-08-28T20:16:09.255588+0000","last_clean":"2024-08-28T20:16:09.255588+0000","last_became_active":"2024-08-28T20:15:53.074925+0000","last_became_peered":"2024-08-28T20:15:53.074925+0000","last_unstale":"2024-08-28T20:16:09.255588+0000","last_undegraded":"2024-08-28T20:16:09.255588+0000","last_fullsized":"2024-08-28T20:16:09.255588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:18:59.262238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256613+0000","last_change":"2024-08-28T20:15:50.038654+0000","last_active":"2024-08-28T20:16:09.256613+0000","last_peered":"2024-08-28T20:16:09.256613+0000","last_clean":"2024-08-28T20:16:09.256613+0000","last_became_active":"2024-08-28T20:15:50.038208+0000","last_became_peered":"2024-08-28T20:15:50.038208+0000","last_unstale":"2024-08-28T20:16:09.256613+0000","last_undegraded":"2024-08-28T20:16:09.256613+0000","last_fullsized":"2024-08-28T20:16:09.256613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:20.845229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259937+0000","last_change":"2024-08-28T20:15:53.085682+0000","last_active":"2024-08-28T20:16:09.259937+0000","last_peered":"2024-08-28T20:16:09.259937+0000","last_clean":"2024-08-28T20:16:09.259937+0000","last_became_active":"2024-08-28T20:15:53.085312+0000","last_became_peered":"2024-08-28T20:15:53.085312+0000","last_unstale":"2024-08-28T20:16:09.259937+0000","last_undegraded":"2024-08-28T20:16:09.259937+0000","last_fullsized":"2024-08-28T20:16:09.259937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:36:21.112522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251741+0000","last_change":"2024-08-28T20:15:50.194955+0000","last_active":"2024-08-28T20:16:09.251741+0000","last_peered":"2024-08-28T20:16:09.251741+0000","last_clean":"2024-08-28T20:16:09.251741+0000","last_became_active":"2024-08-28T20:15:50.194473+0000","last_became_peered":"2024-08-28T20:15:50.194473+0000","last_unstale":"2024-08-28T20:16:09.251741+0000","last_undegraded":"2024-08-28T20:16:09.251741+0000","last_fullsized":"2024-08-28T20:16:09.251741+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:29:21.702692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255283+0000","last_change":"2024-08-28T20:15:53.075495+0000","last_active":"2024-08-28T20:16:09.255283+0000","last_peered":"2024-08-28T20:16:09.255283+0000","last_clean":"2024-08-28T20:16:09.255283+0000","last_became_active":"2024-08-28T20:15:53.071017+0000","last_became_peered":"2024-08-28T20:15:53.071017+0000","last_unstale":"2024-08-28T20:16:09.255283+0000","last_undegraded":"2024-08-28T20:16:09.255283+0000","last_fullsized":"2024-08-28T20:16:09.255283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:20:17.809878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'27","reported_seq":201,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:08.358429+0000","last_change":"2024-08-28T20:16:09.288268+0000","last_active":"2024-08-28T20:17:08.358429+0000","last_peered":"2024-08-28T20:17:08.358429+0000","last_clean":"2024-08-28T20:17:08.358429+0000","last_became_active":"2024-08-28T20:16:09.259977+0000","last_became_peered":"2024-08-28T20:16:09.259977+0000","last_unstale":"2024-08-28T20:17:08.358429+0000","last_undegraded":"2024-08-28T20:17:08.358429+0000","last_fullsized":"2024-08-28T20:17:08.358429+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:10:36.700199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":121,"num_write":28,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255423+0000","last_change":"2024-08-28T20:15:53.073649+0000","last_active":"2024-08-28T20:16:09.255423+0000","last_peered":"2024-08-28T20:16:09.255423+0000","last_clean":"2024-08-28T20:16:09.255423+0000","last_became_active":"2024-08-28T20:15:53.073314+0000","last_became_peered":"2024-08-28T20:15:53.073314+0000","last_unstale":"2024-08-28T20:16:09.255423+0000","last_undegraded":"2024-08-28T20:16:09.255423+0000","last_fullsized":"2024-08-28T20:16:09.255423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:12.160611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254043+0000","last_change":"2024-08-28T20:15:50.038301+0000","last_active":"2024-08-28T20:16:09.254043+0000","last_peered":"2024-08-28T20:16:09.254043+0000","last_clean":"2024-08-28T20:16:09.254043+0000","last_became_active":"2024-08-28T20:15:50.037068+0000","last_became_peered":"2024-08-28T20:15:50.037068+0000","last_unstale":"2024-08-28T20:16:09.254043+0000","last_undegraded":"2024-08-28T20:16:09.254043+0000","last_fullsized":"2024-08-28T20:16:09.254043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:55:55.874707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252981+0000","last_change":"2024-08-28T20:15:53.085561+0000","last_active":"2024-08-28T20:16:09.252981+0000","last_peered":"2024-08-28T20:16:09.252981+0000","last_clean":"2024-08-28T20:16:09.252981+0000","last_became_active":"2024-08-28T20:15:53.085184+0000","last_became_peered":"2024-08-28T20:15:53.085184+0000","last_unstale":"2024-08-28T20:16:09.252981+0000","last_undegraded":"2024-08-28T20:16:09.252981+0000","last_fullsized":"2024-08-28T20:16:09.252981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:19:29.992874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251181+0000","last_change":"2024-08-28T20:15:50.040070+0000","last_active":"2024-08-28T20:16:09.251181+0000","last_peered":"2024-08-28T20:16:09.251181+0000","last_clean":"2024-08-28T20:16:09.251181+0000","last_became_active":"2024-08-28T20:15:50.039613+0000","last_became_peered":"2024-08-28T20:15:50.039613+0000","last_unstale":"2024-08-28T20:16:09.251181+0000","last_undegraded":"2024-08-28T20:16:09.251181+0000","last_fullsized":"2024-08-28T20:16:09.251181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:58:55.014173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.263222+0000","last_change":"2024-08-28T20:16:09.263069+0000","last_active":"2024-08-28T20:16:09.263222+0000","last_peered":"2024-08-28T20:16:09.263222+0000","last_clean":"2024-08-28T20:16:09.263222+0000","last_became_active":"2024-08-28T20:16:09.262112+0000","last_became_peered":"2024-08-28T20:16:09.262112+0000","last_unstale":"2024-08-28T20:16:09.263222+0000","last_undegraded":"2024-08-28T20:16:09.263222+0000","last_fullsized":"2024-08-28T20:16:09.263222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:48.595659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:12.368634+0000","last_change":"2024-08-28T20:16:09.268467+0000","last_active":"2024-08-28T20:17:12.368634+0000","last_peered":"2024-08-28T20:17:12.368634+0000","last_clean":"2024-08-28T20:17:12.368634+0000","last_became_active":"2024-08-28T20:16:09.262061+0000","last_became_peered":"2024-08-28T20:16:09.262061+0000","last_unstale":"2024-08-28T20:17:12.368634+0000","last_undegraded":"2024-08-28T20:17:12.368634+0000","last_fullsized":"2024-08-28T20:17:12.368634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:24:13.257421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255761+0000","last_change":"2024-08-28T20:15:53.079473+0000","last_active":"2024-08-28T20:16:09.255761+0000","last_peered":"2024-08-28T20:16:09.255761+0000","last_clean":"2024-08-28T20:16:09.255761+0000","last_became_active":"2024-08-28T20:15:53.079103+0000","last_became_peered":"2024-08-28T20:15:53.079103+0000","last_unstale":"2024-08-28T20:16:09.255761+0000","last_undegraded":"2024-08-28T20:16:09.255761+0000","last_fullsized":"2024-08-28T20:16:09.255761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:43:59.476622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.283415+0000","last_change":"2024-08-28T20:16:09.282923+0000","last_active":"2024-08-28T20:16:09.283415+0000","last_peered":"2024-08-28T20:16:09.283415+0000","last_clean":"2024-08-28T20:16:09.283415+0000","last_became_active":"2024-08-28T20:16:09.262506+0000","last_became_peered":"2024-08-28T20:16:09.262506+0000","last_unstale":"2024-08-28T20:16:09.283415+0000","last_undegraded":"2024-08-28T20:16:09.283415+0000","last_fullsized":"2024-08-28T20:16:09.283415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:37:49.969128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,4],"acting":[11,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260986+0000","last_change":"2024-08-28T20:16:09.260875+0000","last_active":"2024-08-28T20:16:09.260986+0000","last_peered":"2024-08-28T20:16:09.260986+0000","last_clean":"2024-08-28T20:16:09.260986+0000","last_became_active":"2024-08-28T20:16:09.260450+0000","last_became_peered":"2024-08-28T20:16:09.260450+0000","last_unstale":"2024-08-28T20:16:09.260986+0000","last_undegraded":"2024-08-28T20:16:09.260986+0000","last_fullsized":"2024-08-28T20:16:09.260986+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:12:15.671882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255671+0000","last_change":"2024-08-28T20:15:50.032115+0000","last_active":"2024-08-28T20:16:09.255671+0000","last_peered":"2024-08-28T20:16:09.255671+0000","last_clean":"2024-08-28T20:16:09.255671+0000","last_became_active":"2024-08-28T20:15:50.031743+0000","last_became_peered":"2024-08-28T20:15:50.031743+0000","last_unstale":"2024-08-28T20:16:09.255671+0000","last_undegraded":"2024-08-28T20:16:09.255671+0000","last_fullsized":"2024-08-28T20:16:09.255671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:48.764221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257991+0000","last_change":"2024-08-28T20:15:53.072928+0000","last_active":"2024-08-28T20:16:09.257991+0000","last_peered":"2024-08-28T20:16:09.257991+0000","last_clean":"2024-08-28T20:16:09.257991+0000","last_became_active":"2024-08-28T20:15:53.072550+0000","last_became_peered":"2024-08-28T20:15:53.072550+0000","last_unstale":"2024-08-28T20:16:09.257991+0000","last_undegraded":"2024-08-28T20:16:09.257991+0000","last_fullsized":"2024-08-28T20:16:09.257991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:02.518088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254273+0000","last_change":"2024-08-28T20:15:50.037322+0000","last_active":"2024-08-28T20:16:09.254273+0000","last_peered":"2024-08-28T20:16:09.254273+0000","last_clean":"2024-08-28T20:16:09.254273+0000","last_became_active":"2024-08-28T20:15:50.036886+0000","last_became_peered":"2024-08-28T20:15:50.036886+0000","last_unstale":"2024-08-28T20:16:09.254273+0000","last_undegraded":"2024-08-28T20:16:09.254273+0000","last_fullsized":"2024-08-28T20:16:09.254273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:27:33.370255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256787+0000","last_change":"2024-08-28T20:15:53.070188+0000","last_active":"2024-08-28T20:16:09.256787+0000","last_peered":"2024-08-28T20:16:09.256787+0000","last_clean":"2024-08-28T20:16:09.256787+0000","last_became_active":"2024-08-28T20:15:53.069576+0000","last_became_peered":"2024-08-28T20:15:53.069576+0000","last_unstale":"2024-08-28T20:16:09.256787+0000","last_undegraded":"2024-08-28T20:16:09.256787+0000","last_fullsized":"2024-08-28T20:16:09.256787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:40.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251992+0000","last_change":"2024-08-28T20:15:50.037700+0000","last_active":"2024-08-28T20:16:09.251992+0000","last_peered":"2024-08-28T20:16:09.251992+0000","last_clean":"2024-08-28T20:16:09.251992+0000","last_became_active":"2024-08-28T20:15:50.037114+0000","last_became_peered":"2024-08-28T20:15:50.037114+0000","last_unstale":"2024-08-28T20:16:09.251992+0000","last_undegraded":"2024-08-28T20:16:09.251992+0000","last_fullsized":"2024-08-28T20:16:09.251992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:18:04.478513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256616+0000","last_change":"2024-08-28T20:15:53.080964+0000","last_active":"2024-08-28T20:16:09.256616+0000","last_peered":"2024-08-28T20:16:09.256616+0000","last_clean":"2024-08-28T20:16:09.256616+0000","last_became_active":"2024-08-28T20:15:53.080575+0000","last_became_peered":"2024-08-28T20:15:53.080575+0000","last_unstale":"2024-08-28T20:16:09.256616+0000","last_undegraded":"2024-08-28T20:16:09.256616+0000","last_fullsized":"2024-08-28T20:16:09.256616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:27:22.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255568+0000","last_change":"2024-08-28T20:15:50.195346+0000","last_active":"2024-08-28T20:16:09.255568+0000","last_peered":"2024-08-28T20:16:09.255568+0000","last_clean":"2024-08-28T20:16:09.255568+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255568+0000","last_undegraded":"2024-08-28T20:16:09.255568+0000","last_fullsized":"2024-08-28T20:16:09.255568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:57.094246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256860+0000","last_change":"2024-08-28T20:15:53.081887+0000","last_active":"2024-08-28T20:16:09.256860+0000","last_peered":"2024-08-28T20:16:09.256860+0000","last_clean":"2024-08-28T20:16:09.256860+0000","last_became_active":"2024-08-28T20:15:53.081468+0000","last_became_peered":"2024-08-28T20:15:53.081468+0000","last_unstale":"2024-08-28T20:16:09.256860+0000","last_undegraded":"2024-08-28T20:16:09.256860+0000","last_fullsized":"2024-08-28T20:16:09.256860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:36:56.711342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256111+0000","last_change":"2024-08-28T20:14:34.441400+0000","last_active":"2024-08-28T20:16:09.256111+0000","last_peered":"2024-08-28T20:16:09.256111+0000","last_clean":"2024-08-28T20:16:09.256111+0000","last_became_active":"2024-08-28T20:14:34.435613+0000","last_became_peered":"2024-08-28T20:14:34.435613+0000","last_unstale":"2024-08-28T20:16:09.256111+0000","last_undegraded":"2024-08-28T20:16:09.256111+0000","last_fullsized":"2024-08-28T20:16:09.256111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_clean_scrub_stamp":"2024-08-28T20:11:05.289764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:44:58.327028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256253+0000","last_change":"2024-08-28T20:15:50.034574+0000","last_active":"2024-08-28T20:16:09.256253+0000","last_peered":"2024-08-28T20:16:09.256253+0000","last_clean":"2024-08-28T20:16:09.256253+0000","last_became_active":"2024-08-28T20:15:50.034191+0000","last_became_peered":"2024-08-28T20:15:50.034191+0000","last_unstale":"2024-08-28T20:16:09.256253+0000","last_undegraded":"2024-08-28T20:16:09.256253+0000","last_fullsized":"2024-08-28T20:16:09.256253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:02:17.165360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250475+0000","last_change":"2024-08-28T20:15:53.079974+0000","last_active":"2024-08-28T20:16:09.250475+0000","last_peered":"2024-08-28T20:16:09.250475+0000","last_clean":"2024-08-28T20:16:09.250475+0000","last_became_active":"2024-08-28T20:15:53.079263+0000","last_became_peered":"2024-08-28T20:15:53.079263+0000","last_unstale":"2024-08-28T20:16:09.250475+0000","last_undegraded":"2024-08-28T20:16:09.250475+0000","last_fullsized":"2024-08-28T20:16:09.250475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:06:09.158005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255980+0000","last_change":"2024-08-28T20:15:50.032856+0000","last_active":"2024-08-28T20:16:09.255980+0000","last_peered":"2024-08-28T20:16:09.255980+0000","last_clean":"2024-08-28T20:16:09.255980+0000","last_became_active":"2024-08-28T20:15:50.032378+0000","last_became_peered":"2024-08-28T20:15:50.032378+0000","last_unstale":"2024-08-28T20:16:09.255980+0000","last_undegraded":"2024-08-28T20:16:09.255980+0000","last_fullsized":"2024-08-28T20:16:09.255980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:10:43.559574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252851+0000","last_change":"2024-08-28T20:15:53.082998+0000","last_active":"2024-08-28T20:16:09.252851+0000","last_peered":"2024-08-28T20:16:09.252851+0000","last_clean":"2024-08-28T20:16:09.252851+0000","last_became_active":"2024-08-28T20:15:53.082579+0000","last_became_peered":"2024-08-28T20:15:53.082579+0000","last_unstale":"2024-08-28T20:16:09.252851+0000","last_undegraded":"2024-08-28T20:16:09.252851+0000","last_fullsized":"2024-08-28T20:16:09.252851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:56:31.892013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:11.365905+0000","last_change":"2024-08-28T20:15:50.195181+0000","last_active":"2024-08-28T20:17:11.365905+0000","last_peered":"2024-08-28T20:17:11.365905+0000","last_clean":"2024-08-28T20:17:11.365905+0000","last_became_active":"2024-08-28T20:15:50.194233+0000","last_became_peered":"2024-08-28T20:15:50.194233+0000","last_unstale":"2024-08-28T20:17:11.365905+0000","last_undegraded":"2024-08-28T20:17:11.365905+0000","last_fullsized":"2024-08-28T20:17:11.365905+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:10:18.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251255+0000","last_change":"2024-08-28T20:15:53.065425+0000","last_active":"2024-08-28T20:16:09.251255+0000","last_peered":"2024-08-28T20:16:09.251255+0000","last_clean":"2024-08-28T20:16:09.251255+0000","last_became_active":"2024-08-28T20:15:53.065021+0000","last_became_peered":"2024-08-28T20:15:53.065021+0000","last_unstale":"2024-08-28T20:16:09.251255+0000","last_undegraded":"2024-08-28T20:16:09.251255+0000","last_fullsized":"2024-08-28T20:16:09.251255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:40.792120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256421+0000","last_change":"2024-08-28T20:15:50.038730+0000","last_active":"2024-08-28T20:16:09.256421+0000","last_peered":"2024-08-28T20:16:09.256421+0000","last_clean":"2024-08-28T20:16:09.256421+0000","last_became_active":"2024-08-28T20:15:50.036791+0000","last_became_peered":"2024-08-28T20:15:50.036791+0000","last_unstale":"2024-08-28T20:16:09.256421+0000","last_undegraded":"2024-08-28T20:16:09.256421+0000","last_fullsized":"2024-08-28T20:16:09.256421+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:18:51.484781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250942+0000","last_change":"2024-08-28T20:15:53.087092+0000","last_active":"2024-08-28T20:16:09.250942+0000","last_peered":"2024-08-28T20:16:09.250942+0000","last_clean":"2024-08-28T20:16:09.250942+0000","last_became_active":"2024-08-28T20:15:53.086614+0000","last_became_peered":"2024-08-28T20:15:53.086614+0000","last_unstale":"2024-08-28T20:16:09.250942+0000","last_undegraded":"2024-08-28T20:16:09.250942+0000","last_fullsized":"2024-08-28T20:16:09.250942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:47:00.962576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254705+0000","last_change":"2024-08-28T20:15:50.194838+0000","last_active":"2024-08-28T20:16:09.254705+0000","last_peered":"2024-08-28T20:16:09.254705+0000","last_clean":"2024-08-28T20:16:09.254705+0000","last_became_active":"2024-08-28T20:15:50.194378+0000","last_became_peered":"2024-08-28T20:15:50.194378+0000","last_unstale":"2024-08-28T20:16:09.254705+0000","last_undegraded":"2024-08-28T20:16:09.254705+0000","last_fullsized":"2024-08-28T20:16:09.254705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:53:56.395001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250871+0000","last_change":"2024-08-28T20:15:53.089721+0000","last_active":"2024-08-28T20:16:09.250871+0000","last_peered":"2024-08-28T20:16:09.250871+0000","last_clean":"2024-08-28T20:16:09.250871+0000","last_became_active":"2024-08-28T20:15:53.089240+0000","last_became_peered":"2024-08-28T20:15:53.089240+0000","last_unstale":"2024-08-28T20:16:09.250871+0000","last_undegraded":"2024-08-28T20:16:09.250871+0000","last_fullsized":"2024-08-28T20:16:09.250871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:55.859753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255661+0000","last_change":"2024-08-28T20:15:50.195290+0000","last_active":"2024-08-28T20:16:09.255661+0000","last_peered":"2024-08-28T20:16:09.255661+0000","last_clean":"2024-08-28T20:16:09.255661+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255661+0000","last_undegraded":"2024-08-28T20:16:09.255661+0000","last_fullsized":"2024-08-28T20:16:09.255661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:44.915047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253801+0000","last_change":"2024-08-28T20:15:53.079572+0000","last_active":"2024-08-28T20:16:09.253801+0000","last_peered":"2024-08-28T20:16:09.253801+0000","last_clean":"2024-08-28T20:16:09.253801+0000","last_became_active":"2024-08-28T20:15:53.074745+0000","last_became_peered":"2024-08-28T20:15:53.074745+0000","last_unstale":"2024-08-28T20:16:09.253801+0000","last_undegraded":"2024-08-28T20:16:09.253801+0000","last_fullsized":"2024-08-28T20:16:09.253801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:44.989383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'11","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:26.081068+0000","last_change":"2024-08-28T20:15:50.040420+0000","last_active":"2024-08-28T20:16:26.081068+0000","last_peered":"2024-08-28T20:16:26.081068+0000","last_clean":"2024-08-28T20:16:26.081068+0000","last_became_active":"2024-08-28T20:15:50.039932+0000","last_became_peered":"2024-08-28T20:15:50.039932+0000","last_unstale":"2024-08-28T20:16:26.081068+0000","last_undegraded":"2024-08-28T20:16:26.081068+0000","last_fullsized":"2024-08-28T20:16:26.081068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:13.062974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250922+0000","last_change":"2024-08-28T20:15:53.073177+0000","last_active":"2024-08-28T20:16:09.250922+0000","last_peered":"2024-08-28T20:16:09.250922+0000","last_clean":"2024-08-28T20:16:09.250922+0000","last_became_active":"2024-08-28T20:15:53.072323+0000","last_became_peered":"2024-08-28T20:15:53.072323+0000","last_unstale":"2024-08-28T20:16:09.250922+0000","last_undegraded":"2024-08-28T20:16:09.250922+0000","last_fullsized":"2024-08-28T20:16:09.250922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:18:43.672990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253954+0000","last_change":"2024-08-28T20:15:50.114223+0000","last_active":"2024-08-28T20:16:09.253954+0000","last_peered":"2024-08-28T20:16:09.253954+0000","last_clean":"2024-08-28T20:16:09.253954+0000","last_became_active":"2024-08-28T20:15:50.113798+0000","last_became_peered":"2024-08-28T20:15:50.113798+0000","last_unstale":"2024-08-28T20:16:09.253954+0000","last_undegraded":"2024-08-28T20:16:09.253954+0000","last_fullsized":"2024-08-28T20:16:09.253954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:24:56.354493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261002+0000","last_change":"2024-08-28T20:15:53.097744+0000","last_active":"2024-08-28T20:16:09.261002+0000","last_peered":"2024-08-28T20:16:09.261002+0000","last_clean":"2024-08-28T20:16:09.261002+0000","last_became_active":"2024-08-28T20:15:53.096093+0000","last_became_peered":"2024-08-28T20:15:53.096093+0000","last_unstale":"2024-08-28T20:16:09.261002+0000","last_undegraded":"2024-08-28T20:16:09.261002+0000","last_fullsized":"2024-08-28T20:16:09.261002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:40:36.650309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254952+0000","last_change":"2024-08-28T20:15:50.194574+0000","last_active":"2024-08-28T20:16:09.254952+0000","last_peered":"2024-08-28T20:16:09.254952+0000","last_clean":"2024-08-28T20:16:09.254952+0000","last_became_active":"2024-08-28T20:15:50.194174+0000","last_became_peered":"2024-08-28T20:15:50.194174+0000","last_unstale":"2024-08-28T20:16:09.254952+0000","last_undegraded":"2024-08-28T20:16:09.254952+0000","last_fullsized":"2024-08-28T20:16:09.254952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:07:30.795200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253928+0000","last_change":"2024-08-28T20:15:53.074015+0000","last_active":"2024-08-28T20:16:09.253928+0000","last_peered":"2024-08-28T20:16:09.253928+0000","last_clean":"2024-08-28T20:16:09.253928+0000","last_became_active":"2024-08-28T20:15:53.073641+0000","last_became_peered":"2024-08-28T20:15:53.073641+0000","last_unstale":"2024-08-28T20:16:09.253928+0000","last_undegraded":"2024-08-28T20:16:09.253928+0000","last_fullsized":"2024-08-28T20:16:09.253928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:55.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250392+0000","last_change":"2024-08-28T20:15:50.038105+0000","last_active":"2024-08-28T20:16:09.250392+0000","last_peered":"2024-08-28T20:16:09.250392+0000","last_clean":"2024-08-28T20:16:09.250392+0000","last_became_active":"2024-08-28T20:15:50.037721+0000","last_became_peered":"2024-08-28T20:15:50.037721+0000","last_unstale":"2024-08-28T20:16:09.250392+0000","last_undegraded":"2024-08-28T20:16:09.250392+0000","last_fullsized":"2024-08-28T20:16:09.250392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:24:58.941095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258053+0000","last_change":"2024-08-28T20:15:53.090160+0000","last_active":"2024-08-28T20:16:09.258053+0000","last_peered":"2024-08-28T20:16:09.258053+0000","last_clean":"2024-08-28T20:16:09.258053+0000","last_became_active":"2024-08-28T20:15:53.089739+0000","last_became_peered":"2024-08-28T20:15:53.089739+0000","last_unstale":"2024-08-28T20:16:09.258053+0000","last_undegraded":"2024-08-28T20:16:09.258053+0000","last_fullsized":"2024-08-28T20:16:09.258053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:51:32.384124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253620+0000","last_change":"2024-08-28T20:15:50.036817+0000","last_active":"2024-08-28T20:16:09.253620+0000","last_peered":"2024-08-28T20:16:09.253620+0000","last_clean":"2024-08-28T20:16:09.253620+0000","last_became_active":"2024-08-28T20:15:50.036425+0000","last_became_peered":"2024-08-28T20:15:50.036425+0000","last_unstale":"2024-08-28T20:16:09.253620+0000","last_undegraded":"2024-08-28T20:16:09.253620+0000","last_fullsized":"2024-08-28T20:16:09.253620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:16:59.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250559+0000","last_change":"2024-08-28T20:15:53.090616+0000","last_active":"2024-08-28T20:16:09.250559+0000","last_peered":"2024-08-28T20:16:09.250559+0000","last_clean":"2024-08-28T20:16:09.250559+0000","last_became_active":"2024-08-28T20:15:53.089204+0000","last_became_peered":"2024-08-28T20:15:53.089204+0000","last_unstale":"2024-08-28T20:16:09.250559+0000","last_undegraded":"2024-08-28T20:16:09.250559+0000","last_fullsized":"2024-08-28T20:16:09.250559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:24:39.423756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":45,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.269132+0000","last_change":"2024-08-28T20:16:09.268949+0000","last_active":"2024-08-28T20:16:09.269132+0000","last_peered":"2024-08-28T20:16:09.269132+0000","last_clean":"2024-08-28T20:16:09.269132+0000","last_became_active":"2024-08-28T20:16:09.258665+0000","last_became_peered":"2024-08-28T20:16:09.258665+0000","last_unstale":"2024-08-28T20:16:09.269132+0000","last_undegraded":"2024-08-28T20:16:09.269132+0000","last_fullsized":"2024-08-28T20:16:09.269132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:43:11.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256137+0000","last_change":"2024-08-28T20:15:53.075853+0000","last_active":"2024-08-28T20:16:09.256137+0000","last_peered":"2024-08-28T20:16:09.256137+0000","last_clean":"2024-08-28T20:16:09.256137+0000","last_became_active":"2024-08-28T20:15:53.075429+0000","last_became_peered":"2024-08-28T20:15:53.075429+0000","last_unstale":"2024-08-28T20:16:09.256137+0000","last_undegraded":"2024-08-28T20:16:09.256137+0000","last_fullsized":"2024-08-28T20:16:09.256137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:09.301878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257135+0000","last_change":"2024-08-28T20:16:09.256999+0000","last_active":"2024-08-28T20:16:09.257135+0000","last_peered":"2024-08-28T20:16:09.257135+0000","last_clean":"2024-08-28T20:16:09.257135+0000","last_became_active":"2024-08-28T20:16:09.256508+0000","last_became_peered":"2024-08-28T20:16:09.256508+0000","last_unstale":"2024-08-28T20:16:09.257135+0000","last_undegraded":"2024-08-28T20:16:09.257135+0000","last_fullsized":"2024-08-28T20:16:09.257135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T08:08:23.494703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254657+0000","last_change":"2024-08-28T20:15:50.040047+0000","last_active":"2024-08-28T20:16:09.254657+0000","last_peered":"2024-08-28T20:16:09.254657+0000","last_clean":"2024-08-28T20:16:09.254657+0000","last_became_active":"2024-08-28T20:15:50.039656+0000","last_became_peered":"2024-08-28T20:15:50.039656+0000","last_unstale":"2024-08-28T20:16:09.254657+0000","last_undegraded":"2024-08-28T20:16:09.254657+0000","last_fullsized":"2024-08-28T20:16:09.254657+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:13:30.986352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255216+0000","last_change":"2024-08-28T20:15:53.076441+0000","last_active":"2024-08-28T20:16:09.255216+0000","last_peered":"2024-08-28T20:16:09.255216+0000","last_clean":"2024-08-28T20:16:09.255216+0000","last_became_active":"2024-08-28T20:15:53.076091+0000","last_became_peered":"2024-08-28T20:15:53.076091+0000","last_unstale":"2024-08-28T20:16:09.255216+0000","last_undegraded":"2024-08-28T20:16:09.255216+0000","last_fullsized":"2024-08-28T20:16:09.255216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:45:13.500267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255533+0000","last_change":"2024-08-28T20:15:50.034114+0000","last_active":"2024-08-28T20:16:09.255533+0000","last_peered":"2024-08-28T20:16:09.255533+0000","last_clean":"2024-08-28T20:16:09.255533+0000","last_became_active":"2024-08-28T20:15:50.033681+0000","last_became_peered":"2024-08-28T20:15:50.033681+0000","last_unstale":"2024-08-28T20:16:09.255533+0000","last_undegraded":"2024-08-28T20:16:09.255533+0000","last_fullsized":"2024-08-28T20:16:09.255533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:06:09.372632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260281+0000","last_change":"2024-08-28T20:15:53.088870+0000","last_active":"2024-08-28T20:16:09.260281+0000","last_peered":"2024-08-28T20:16:09.260281+0000","last_clean":"2024-08-28T20:16:09.260281+0000","last_became_active":"2024-08-28T20:15:53.088536+0000","last_became_peered":"2024-08-28T20:15:53.088536+0000","last_unstale":"2024-08-28T20:16:09.260281+0000","last_undegraded":"2024-08-28T20:16:09.260281+0000","last_fullsized":"2024-08-28T20:16:09.260281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:20:28.927016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250862+0000","last_change":"2024-08-28T20:15:50.194803+0000","last_active":"2024-08-28T20:16:09.250862+0000","last_peered":"2024-08-28T20:16:09.250862+0000","last_clean":"2024-08-28T20:16:09.250862+0000","last_became_active":"2024-08-28T20:15:50.194351+0000","last_became_peered":"2024-08-28T20:15:50.194351+0000","last_unstale":"2024-08-28T20:16:09.250862+0000","last_undegraded":"2024-08-28T20:16:09.250862+0000","last_fullsized":"2024-08-28T20:16:09.250862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:44:14.751785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250705+0000","last_change":"2024-08-28T20:15:53.083914+0000","last_active":"2024-08-28T20:16:09.250705+0000","last_peered":"2024-08-28T20:16:09.250705+0000","last_clean":"2024-08-28T20:16:09.250705+0000","last_became_active":"2024-08-28T20:15:53.081282+0000","last_became_peered":"2024-08-28T20:15:53.081282+0000","last_unstale":"2024-08-28T20:16:09.250705+0000","last_undegraded":"2024-08-28T20:16:09.250705+0000","last_fullsized":"2024-08-28T20:16:09.250705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:21.373284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255271+0000","last_change":"2024-08-28T20:15:50.034299+0000","last_active":"2024-08-28T20:16:09.255271+0000","last_peered":"2024-08-28T20:16:09.255271+0000","last_clean":"2024-08-28T20:16:09.255271+0000","last_became_active":"2024-08-28T20:15:50.033858+0000","last_became_peered":"2024-08-28T20:15:50.033858+0000","last_unstale":"2024-08-28T20:16:09.255271+0000","last_undegraded":"2024-08-28T20:16:09.255271+0000","last_fullsized":"2024-08-28T20:16:09.255271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:38:41.264067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63601,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":402,"num_read_kb":266,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2312,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841566,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":405362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005091,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1055352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168617,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":404507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364845,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":404315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528370,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36748,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708404,"statfs":{"total":95995035648,"available":95957405696,"internally_reserved":0,"allocated":1437696,"data_stored":995769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659192,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":403896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855420,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":996041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":464045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":404207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":843776,"data_stored":405318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":462898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":405167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T20:17:15.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T20:17:15.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:17:15.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:17:15.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:14 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:15.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:17:15.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:17:15.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:14 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:17:15.533 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:15.927 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:15 smithi001 ceph-mon[20984]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:15.927 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:15 smithi001 ceph-mon[20984]: from='client.24997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:17:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 -- 172.21.15.1:0/3453423317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 msgr2=0x7f2f4c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 --2- 172.21.15.1:0/3453423317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c1103c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009ca0 tx=0x7f2f4402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 -- 172.21.15.1:0/3453423317 shutdown_connections 2024-08-28T20:17:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 --2- 172.21.15.1:0/3453423317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c1103c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 --2- 172.21.15.1:0/3453423317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c109240 0x7f2f4c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 --2- 172.21.15.1:0/3453423317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f4c103900 0x7f2f4c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 -- 172.21.15.1:0/3453423317 >> 172.21.15.1:0/3453423317 conn(0x7f2f4c07b5f0 msgr2=0x7f2f4c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.103+0000 7f2f54400640 1 -- 172.21.15.1:0/3453423317 shutdown_connections 2024-08-28T20:17:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.104+0000 7f2f54400640 1 -- 172.21.15.1:0/3453423317 wait complete. 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 Processor -- start 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 -- start start 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c103900 0x7f2f4c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f4c109240 0x7f2f4c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c19d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c111660 con 0x7f2f4c109b90 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1114e0 con 0x7f2f4c109240 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.105+0000 7f2f54400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1117e0 con 0x7f2f4c103900 2024-08-28T20:17:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f52400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c19d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:16.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c103900 0x7f2f4c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:16.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f52400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c19d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50180/0 (socket says 172.21.15.1:50180) 2024-08-28T20:17:16.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f52400640 1 -- 172.21.15.1:0/1254116363 learned_addr learned my addr 172.21.15.1:0/1254116363 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:16.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51000640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f4c109240 0x7f2f4c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 -- 172.21.15.1:0/1254116363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f4c109240 msgr2=0x7f2f4c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f4c109240 0x7f2f4c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 -- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 msgr2=0x7f2f4c19d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c19d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 -- 172.21.15.1:0/1254116363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c19df80 con 0x7f2f4c103900 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.106+0000 7f2f51a00640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c103900 0x7f2f4c198010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009af0 tx=0x7f2f400071c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.107+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40007e00 con 0x7f2f4c103900 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.107+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c19e270 con 0x7f2f4c103900 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.107+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f4001e070 con 0x7f2f4c103900 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.107+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40018770 con 0x7f2f4c103900 2024-08-28T20:17:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.107+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c1a49d0 con 0x7f2f4c103900 2024-08-28T20:17:16.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.108+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4c103d10 con 0x7f2f4c103900 2024-08-28T20:17:16.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.110+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f2f40019b30 con 0x7f2f4c103900 2024-08-28T20:17:16.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.112+0000 7f2f4a000640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2f340b4bc0 0x7f2f340b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:16.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.112+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2f400e9250 con 0x7f2f4c103900 2024-08-28T20:17:16.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.112+0000 7f2f51000640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2f340b4bc0 0x7f2f340b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:16.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.113+0000 7f2f51000640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2f340b4bc0 0x7f2f340b70d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c106d80 tx=0x7f2f38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:16.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.116+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2f40016070 con 0x7f2f4c103900 2024-08-28T20:17:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:15 smithi121 ceph-mon[25248]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:15 smithi121 ceph-mon[25248]: from='client.24997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:17:16.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.309+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f4c0635a0 con 0x7f2f340b4bc0 2024-08-28T20:17:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:15 smithi007 ceph-mon[25357]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:15 smithi007 ceph-mon[25357]: from='client.24997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:17:16.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.314+0000 7f2f4a000640 1 -- 172.21.15.1:0/1254116363 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258705 (secure 0 0 0) 0x7f2f4c0635a0 con 0x7f2f340b4bc0 2024-08-28T20:17:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:16.319 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2f340b4bc0 msgr2=0x7f2f340b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2f340b4bc0 0x7f2f340b70d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c106d80 tx=0x7f2f38005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c103900 msgr2=0x7f2f4c198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c103900 0x7f2f4c198010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009af0 tx=0x7f2f400071c0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 shutdown_connections 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2f340b4bc0 0x7f2f340b70d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f4c109b90 0x7f2f4c19d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f4c109240 0x7f2f4c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 --2- 172.21.15.1:0/1254116363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f4c103900 0x7f2f4c198010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:16.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 >> 172.21.15.1:0/1254116363 conn(0x7f2f4c07b5f0 msgr2=0x7f2f4c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:16.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 shutdown_connections 2024-08-28T20:17:16.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:16.318+0000 7f2f54400640 1 -- 172.21.15.1:0/1254116363 wait complete. 2024-08-28T20:17:17.103 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-08-28T20:17:16.181985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654203,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":493,"num_read_kb":340,"num_write":287,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":2954152,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373608,"kb_used_data":11868,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568216,"statfs":{"total":1151940427776,"available":1151557853184,"internally_reserved":0,"allocated":12152832,"data_stored":6806877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003352"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258561+0000","last_change":"2024-08-28T20:15:53.090200+0000","last_active":"2024-08-28T20:16:09.258561+0000","last_peered":"2024-08-28T20:16:09.258561+0000","last_clean":"2024-08-28T20:16:09.258561+0000","last_became_active":"2024-08-28T20:15:53.089819+0000","last_became_peered":"2024-08-28T20:15:53.089819+0000","last_unstale":"2024-08-28T20:16:09.258561+0000","last_undegraded":"2024-08-28T20:16:09.258561+0000","last_fullsized":"2024-08-28T20:16:09.258561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:24:35.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260865+0000","last_change":"2024-08-28T20:15:53.094139+0000","last_active":"2024-08-28T20:16:09.260865+0000","last_peered":"2024-08-28T20:16:09.260865+0000","last_clean":"2024-08-28T20:16:09.260865+0000","last_became_active":"2024-08-28T20:15:53.093920+0000","last_became_peered":"2024-08-28T20:15:53.093920+0000","last_unstale":"2024-08-28T20:16:09.260865+0000","last_undegraded":"2024-08-28T20:16:09.260865+0000","last_fullsized":"2024-08-28T20:16:09.260865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:50:00.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261007+0000","last_change":"2024-08-28T20:15:53.087364+0000","last_active":"2024-08-28T20:16:09.261007+0000","last_peered":"2024-08-28T20:16:09.261007+0000","last_clean":"2024-08-28T20:16:09.261007+0000","last_became_active":"2024-08-28T20:15:53.087030+0000","last_became_peered":"2024-08-28T20:15:53.087030+0000","last_unstale":"2024-08-28T20:16:09.261007+0000","last_undegraded":"2024-08-28T20:16:09.261007+0000","last_fullsized":"2024-08-28T20:16:09.261007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:27:40.000046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255390+0000","last_change":"2024-08-28T20:15:53.072409+0000","last_active":"2024-08-28T20:16:09.255390+0000","last_peered":"2024-08-28T20:16:09.255390+0000","last_clean":"2024-08-28T20:16:09.255390+0000","last_became_active":"2024-08-28T20:15:53.071946+0000","last_became_peered":"2024-08-28T20:15:53.071946+0000","last_unstale":"2024-08-28T20:16:09.255390+0000","last_undegraded":"2024-08-28T20:16:09.255390+0000","last_fullsized":"2024-08-28T20:16:09.255390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:14:07.246976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254046+0000","last_change":"2024-08-28T20:15:53.084238+0000","last_active":"2024-08-28T20:16:09.254046+0000","last_peered":"2024-08-28T20:16:09.254046+0000","last_clean":"2024-08-28T20:16:09.254046+0000","last_became_active":"2024-08-28T20:15:53.083835+0000","last_became_peered":"2024-08-28T20:15:53.083835+0000","last_unstale":"2024-08-28T20:16:09.254046+0000","last_undegraded":"2024-08-28T20:16:09.254046+0000","last_fullsized":"2024-08-28T20:16:09.254046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:50:19.618455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250676+0000","last_change":"2024-08-28T20:15:53.071186+0000","last_active":"2024-08-28T20:16:09.250676+0000","last_peered":"2024-08-28T20:16:09.250676+0000","last_clean":"2024-08-28T20:16:09.250676+0000","last_became_active":"2024-08-28T20:15:53.070764+0000","last_became_peered":"2024-08-28T20:15:53.070764+0000","last_unstale":"2024-08-28T20:16:09.250676+0000","last_undegraded":"2024-08-28T20:16:09.250676+0000","last_fullsized":"2024-08-28T20:16:09.250676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:21.079888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256210+0000","last_change":"2024-08-28T20:15:53.079022+0000","last_active":"2024-08-28T20:16:09.256210+0000","last_peered":"2024-08-28T20:16:09.256210+0000","last_clean":"2024-08-28T20:16:09.256210+0000","last_became_active":"2024-08-28T20:15:53.078618+0000","last_became_peered":"2024-08-28T20:15:53.078618+0000","last_unstale":"2024-08-28T20:16:09.256210+0000","last_undegraded":"2024-08-28T20:16:09.256210+0000","last_fullsized":"2024-08-28T20:16:09.256210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:49:09.296997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250232+0000","last_change":"2024-08-28T20:15:53.068898+0000","last_active":"2024-08-28T20:16:09.250232+0000","last_peered":"2024-08-28T20:16:09.250232+0000","last_clean":"2024-08-28T20:16:09.250232+0000","last_became_active":"2024-08-28T20:15:53.068578+0000","last_became_peered":"2024-08-28T20:15:53.068578+0000","last_unstale":"2024-08-28T20:16:09.250232+0000","last_undegraded":"2024-08-28T20:16:09.250232+0000","last_fullsized":"2024-08-28T20:16:09.250232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:53:30.220402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255901+0000","last_change":"2024-08-28T20:15:53.077445+0000","last_active":"2024-08-28T20:16:09.255901+0000","last_peered":"2024-08-28T20:16:09.255901+0000","last_clean":"2024-08-28T20:16:09.255901+0000","last_became_active":"2024-08-28T20:15:53.077060+0000","last_became_peered":"2024-08-28T20:15:53.077060+0000","last_unstale":"2024-08-28T20:16:09.255901+0000","last_undegraded":"2024-08-28T20:16:09.255901+0000","last_fullsized":"2024-08-28T20:16:09.255901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:52.441510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259634+0000","last_change":"2024-08-28T20:16:09.259500+0000","last_active":"2024-08-28T20:16:09.259634+0000","last_peered":"2024-08-28T20:16:09.259634+0000","last_clean":"2024-08-28T20:16:09.259634+0000","last_became_active":"2024-08-28T20:16:09.258797+0000","last_became_peered":"2024-08-28T20:16:09.258797+0000","last_unstale":"2024-08-28T20:16:09.259634+0000","last_undegraded":"2024-08-28T20:16:09.259634+0000","last_fullsized":"2024-08-28T20:16:09.259634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:08.497860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256722+0000","last_change":"2024-08-28T20:15:53.080978+0000","last_active":"2024-08-28T20:16:09.256722+0000","last_peered":"2024-08-28T20:16:09.256722+0000","last_clean":"2024-08-28T20:16:09.256722+0000","last_became_active":"2024-08-28T20:15:53.080608+0000","last_became_peered":"2024-08-28T20:15:53.080608+0000","last_unstale":"2024-08-28T20:16:09.256722+0000","last_undegraded":"2024-08-28T20:16:09.256722+0000","last_fullsized":"2024-08-28T20:16:09.256722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:18:03.005125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256938+0000","last_change":"2024-08-28T20:15:53.067312+0000","last_active":"2024-08-28T20:16:09.256938+0000","last_peered":"2024-08-28T20:16:09.256938+0000","last_clean":"2024-08-28T20:16:09.256938+0000","last_became_active":"2024-08-28T20:15:53.066802+0000","last_became_peered":"2024-08-28T20:15:53.066802+0000","last_unstale":"2024-08-28T20:16:09.256938+0000","last_undegraded":"2024-08-28T20:16:09.256938+0000","last_fullsized":"2024-08-28T20:16:09.256938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:27:28.079309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253418+0000","last_change":"2024-08-28T20:15:53.077877+0000","last_active":"2024-08-28T20:16:09.253418+0000","last_peered":"2024-08-28T20:16:09.253418+0000","last_clean":"2024-08-28T20:16:09.253418+0000","last_became_active":"2024-08-28T20:15:53.077374+0000","last_became_peered":"2024-08-28T20:15:53.077374+0000","last_unstale":"2024-08-28T20:16:09.253418+0000","last_undegraded":"2024-08-28T20:16:09.253418+0000","last_fullsized":"2024-08-28T20:16:09.253418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:27:34.692183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260489+0000","last_change":"2024-08-28T20:15:53.090043+0000","last_active":"2024-08-28T20:16:09.260489+0000","last_peered":"2024-08-28T20:16:09.260489+0000","last_clean":"2024-08-28T20:16:09.260489+0000","last_became_active":"2024-08-28T20:15:53.089693+0000","last_became_peered":"2024-08-28T20:15:53.089693+0000","last_unstale":"2024-08-28T20:16:09.260489+0000","last_undegraded":"2024-08-28T20:16:09.260489+0000","last_fullsized":"2024-08-28T20:16:09.260489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:04:10.505280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259563+0000","last_change":"2024-08-28T20:15:53.090981+0000","last_active":"2024-08-28T20:16:09.259563+0000","last_peered":"2024-08-28T20:16:09.259563+0000","last_clean":"2024-08-28T20:16:09.259563+0000","last_became_active":"2024-08-28T20:15:53.087896+0000","last_became_peered":"2024-08-28T20:15:53.087896+0000","last_unstale":"2024-08-28T20:16:09.259563+0000","last_undegraded":"2024-08-28T20:16:09.259563+0000","last_fullsized":"2024-08-28T20:16:09.259563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:36:35.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254797+0000","last_change":"2024-08-28T20:15:53.090219+0000","last_active":"2024-08-28T20:16:09.254797+0000","last_peered":"2024-08-28T20:16:09.254797+0000","last_clean":"2024-08-28T20:16:09.254797+0000","last_became_active":"2024-08-28T20:15:53.089683+0000","last_became_peered":"2024-08-28T20:15:53.089683+0000","last_unstale":"2024-08-28T20:16:09.254797+0000","last_undegraded":"2024-08-28T20:16:09.254797+0000","last_fullsized":"2024-08-28T20:16:09.254797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:12:04.413154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258615+0000","last_change":"2024-08-28T20:15:53.091256+0000","last_active":"2024-08-28T20:16:09.258615+0000","last_peered":"2024-08-28T20:16:09.258615+0000","last_clean":"2024-08-28T20:16:09.258615+0000","last_became_active":"2024-08-28T20:15:53.090869+0000","last_became_peered":"2024-08-28T20:15:53.090869+0000","last_unstale":"2024-08-28T20:16:09.258615+0000","last_undegraded":"2024-08-28T20:16:09.258615+0000","last_fullsized":"2024-08-28T20:16:09.258615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:35:49.475470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255033+0000","last_change":"2024-08-28T20:15:53.077695+0000","last_active":"2024-08-28T20:16:09.255033+0000","last_peered":"2024-08-28T20:16:09.255033+0000","last_clean":"2024-08-28T20:16:09.255033+0000","last_became_active":"2024-08-28T20:15:53.077243+0000","last_became_peered":"2024-08-28T20:15:53.077243+0000","last_unstale":"2024-08-28T20:16:09.255033+0000","last_undegraded":"2024-08-28T20:16:09.255033+0000","last_fullsized":"2024-08-28T20:16:09.255033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:09:37.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254063+0000","last_change":"2024-08-28T20:15:53.095662+0000","last_active":"2024-08-28T20:16:09.254063+0000","last_peered":"2024-08-28T20:16:09.254063+0000","last_clean":"2024-08-28T20:16:09.254063+0000","last_became_active":"2024-08-28T20:15:53.095211+0000","last_became_peered":"2024-08-28T20:15:53.095211+0000","last_unstale":"2024-08-28T20:16:09.254063+0000","last_undegraded":"2024-08-28T20:16:09.254063+0000","last_fullsized":"2024-08-28T20:16:09.254063+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:58.137756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258204+0000","last_change":"2024-08-28T20:15:53.076938+0000","last_active":"2024-08-28T20:16:09.258204+0000","last_peered":"2024-08-28T20:16:09.258204+0000","last_clean":"2024-08-28T20:16:09.258204+0000","last_became_active":"2024-08-28T20:15:53.076445+0000","last_became_peered":"2024-08-28T20:15:53.076445+0000","last_unstale":"2024-08-28T20:16:09.258204+0000","last_undegraded":"2024-08-28T20:16:09.258204+0000","last_fullsized":"2024-08-28T20:16:09.258204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:13:53.477053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253506+0000","last_change":"2024-08-28T20:15:53.094262+0000","last_active":"2024-08-28T20:16:09.253506+0000","last_peered":"2024-08-28T20:16:09.253506+0000","last_clean":"2024-08-28T20:16:09.253506+0000","last_became_active":"2024-08-28T20:15:53.093927+0000","last_became_peered":"2024-08-28T20:15:53.093927+0000","last_unstale":"2024-08-28T20:16:09.253506+0000","last_undegraded":"2024-08-28T20:16:09.253506+0000","last_fullsized":"2024-08-28T20:16:09.253506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:04:46.586527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255159+0000","last_change":"2024-08-28T20:15:53.081244+0000","last_active":"2024-08-28T20:16:09.255159+0000","last_peered":"2024-08-28T20:16:09.255159+0000","last_clean":"2024-08-28T20:16:09.255159+0000","last_became_active":"2024-08-28T20:15:53.080813+0000","last_became_peered":"2024-08-28T20:15:53.080813+0000","last_unstale":"2024-08-28T20:16:09.255159+0000","last_undegraded":"2024-08-28T20:16:09.255159+0000","last_fullsized":"2024-08-28T20:16:09.255159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:31.052514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250252+0000","last_change":"2024-08-28T20:15:53.084469+0000","last_active":"2024-08-28T20:16:09.250252+0000","last_peered":"2024-08-28T20:16:09.250252+0000","last_clean":"2024-08-28T20:16:09.250252+0000","last_became_active":"2024-08-28T20:15:53.083815+0000","last_became_peered":"2024-08-28T20:15:53.083815+0000","last_unstale":"2024-08-28T20:16:09.250252+0000","last_undegraded":"2024-08-28T20:16:09.250252+0000","last_fullsized":"2024-08-28T20:16:09.250252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:36.615505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251099+0000","last_change":"2024-08-28T20:15:53.063396+0000","last_active":"2024-08-28T20:16:09.251099+0000","last_peered":"2024-08-28T20:16:09.251099+0000","last_clean":"2024-08-28T20:16:09.251099+0000","last_became_active":"2024-08-28T20:15:53.062970+0000","last_became_peered":"2024-08-28T20:15:53.062970+0000","last_unstale":"2024-08-28T20:16:09.251099+0000","last_undegraded":"2024-08-28T20:16:09.251099+0000","last_fullsized":"2024-08-28T20:16:09.251099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:50:44.559623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250848+0000","last_change":"2024-08-28T20:15:53.085787+0000","last_active":"2024-08-28T20:16:09.250848+0000","last_peered":"2024-08-28T20:16:09.250848+0000","last_clean":"2024-08-28T20:16:09.250848+0000","last_became_active":"2024-08-28T20:15:53.085449+0000","last_became_peered":"2024-08-28T20:15:53.085449+0000","last_unstale":"2024-08-28T20:16:09.250848+0000","last_undegraded":"2024-08-28T20:16:09.250848+0000","last_fullsized":"2024-08-28T20:16:09.250848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:00:35.687940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254477+0000","last_change":"2024-08-28T20:15:53.079482+0000","last_active":"2024-08-28T20:16:09.254477+0000","last_peered":"2024-08-28T20:16:09.254477+0000","last_clean":"2024-08-28T20:16:09.254477+0000","last_became_active":"2024-08-28T20:15:53.079046+0000","last_became_peered":"2024-08-28T20:15:53.079046+0000","last_unstale":"2024-08-28T20:16:09.254477+0000","last_undegraded":"2024-08-28T20:16:09.254477+0000","last_fullsized":"2024-08-28T20:16:09.254477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:51:50.026095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258263+0000","last_change":"2024-08-28T20:15:53.075651+0000","last_active":"2024-08-28T20:16:09.258263+0000","last_peered":"2024-08-28T20:16:09.258263+0000","last_clean":"2024-08-28T20:16:09.258263+0000","last_became_active":"2024-08-28T20:15:53.075231+0000","last_became_peered":"2024-08-28T20:15:53.075231+0000","last_unstale":"2024-08-28T20:16:09.258263+0000","last_undegraded":"2024-08-28T20:16:09.258263+0000","last_fullsized":"2024-08-28T20:16:09.258263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:50.828987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253693+0000","last_change":"2024-08-28T20:15:53.097623+0000","last_active":"2024-08-28T20:16:09.253693+0000","last_peered":"2024-08-28T20:16:09.253693+0000","last_clean":"2024-08-28T20:16:09.253693+0000","last_became_active":"2024-08-28T20:15:53.095633+0000","last_became_peered":"2024-08-28T20:15:53.095633+0000","last_unstale":"2024-08-28T20:16:09.253693+0000","last_undegraded":"2024-08-28T20:16:09.253693+0000","last_fullsized":"2024-08-28T20:16:09.253693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:05.559906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260644+0000","last_change":"2024-08-28T20:15:53.078030+0000","last_active":"2024-08-28T20:16:09.260644+0000","last_peered":"2024-08-28T20:16:09.260644+0000","last_clean":"2024-08-28T20:16:09.260644+0000","last_became_active":"2024-08-28T20:15:53.076535+0000","last_became_peered":"2024-08-28T20:15:53.076535+0000","last_unstale":"2024-08-28T20:16:09.260644+0000","last_undegraded":"2024-08-28T20:16:09.260644+0000","last_fullsized":"2024-08-28T20:16:09.260644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:33:07.028039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253467+0000","last_change":"2024-08-28T20:15:53.096481+0000","last_active":"2024-08-28T20:16:09.253467+0000","last_peered":"2024-08-28T20:16:09.253467+0000","last_clean":"2024-08-28T20:16:09.253467+0000","last_became_active":"2024-08-28T20:15:53.096098+0000","last_became_peered":"2024-08-28T20:15:53.096098+0000","last_unstale":"2024-08-28T20:16:09.253467+0000","last_undegraded":"2024-08-28T20:16:09.253467+0000","last_fullsized":"2024-08-28T20:16:09.253467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:31:35.450650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254251+0000","last_change":"2024-08-28T20:15:53.070940+0000","last_active":"2024-08-28T20:16:09.254251+0000","last_peered":"2024-08-28T20:16:09.254251+0000","last_clean":"2024-08-28T20:16:09.254251+0000","last_became_active":"2024-08-28T20:15:53.070559+0000","last_became_peered":"2024-08-28T20:15:53.070559+0000","last_unstale":"2024-08-28T20:16:09.254251+0000","last_undegraded":"2024-08-28T20:16:09.254251+0000","last_fullsized":"2024-08-28T20:16:09.254251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:04:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257928+0000","last_change":"2024-08-28T20:15:53.071293+0000","last_active":"2024-08-28T20:16:09.257928+0000","last_peered":"2024-08-28T20:16:09.257928+0000","last_clean":"2024-08-28T20:16:09.257928+0000","last_became_active":"2024-08-28T20:15:53.070937+0000","last_became_peered":"2024-08-28T20:15:53.070937+0000","last_unstale":"2024-08-28T20:16:09.257928+0000","last_undegraded":"2024-08-28T20:16:09.257928+0000","last_fullsized":"2024-08-28T20:16:09.257928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:20:03.463030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254102+0000","last_change":"2024-08-28T20:15:53.080834+0000","last_active":"2024-08-28T20:16:09.254102+0000","last_peered":"2024-08-28T20:16:09.254102+0000","last_clean":"2024-08-28T20:16:09.254102+0000","last_became_active":"2024-08-28T20:15:53.080446+0000","last_became_peered":"2024-08-28T20:15:53.080446+0000","last_unstale":"2024-08-28T20:16:09.254102+0000","last_undegraded":"2024-08-28T20:16:09.254102+0000","last_fullsized":"2024-08-28T20:16:09.254102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:30:31.404656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:10.362397+0000","last_change":"2024-08-28T20:15:50.038701+0000","last_active":"2024-08-28T20:17:10.362397+0000","last_peered":"2024-08-28T20:17:10.362397+0000","last_clean":"2024-08-28T20:17:10.362397+0000","last_became_active":"2024-08-28T20:15:50.038383+0000","last_became_peered":"2024-08-28T20:15:50.038383+0000","last_unstale":"2024-08-28T20:17:10.362397+0000","last_undegraded":"2024-08-28T20:17:10.362397+0000","last_fullsized":"2024-08-28T20:17:10.362397+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:20:03.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251526+0000","last_change":"2024-08-28T20:15:53.058433+0000","last_active":"2024-08-28T20:16:09.251526+0000","last_peered":"2024-08-28T20:16:09.251526+0000","last_clean":"2024-08-28T20:16:09.251526+0000","last_became_active":"2024-08-28T20:15:53.058088+0000","last_became_peered":"2024-08-28T20:15:53.058088+0000","last_unstale":"2024-08-28T20:16:09.251526+0000","last_undegraded":"2024-08-28T20:16:09.251526+0000","last_fullsized":"2024-08-28T20:16:09.251526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:58:10.507808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.264327+0000","last_change":"2024-08-28T20:16:09.264205+0000","last_active":"2024-08-28T20:16:09.264327+0000","last_peered":"2024-08-28T20:16:09.264327+0000","last_clean":"2024-08-28T20:16:09.264327+0000","last_became_active":"2024-08-28T20:16:09.257407+0000","last_became_peered":"2024-08-28T20:16:09.257407+0000","last_unstale":"2024-08-28T20:16:09.264327+0000","last_undegraded":"2024-08-28T20:16:09.264327+0000","last_fullsized":"2024-08-28T20:16:09.264327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:57:44.507993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252938+0000","last_change":"2024-08-28T20:15:50.038447+0000","last_active":"2024-08-28T20:16:09.252938+0000","last_peered":"2024-08-28T20:16:09.252938+0000","last_clean":"2024-08-28T20:16:09.252938+0000","last_became_active":"2024-08-28T20:15:50.037428+0000","last_became_peered":"2024-08-28T20:15:50.037428+0000","last_unstale":"2024-08-28T20:16:09.252938+0000","last_undegraded":"2024-08-28T20:16:09.252938+0000","last_fullsized":"2024-08-28T20:16:09.252938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:31:36.805904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250318+0000","last_change":"2024-08-28T20:15:53.086731+0000","last_active":"2024-08-28T20:16:09.250318+0000","last_peered":"2024-08-28T20:16:09.250318+0000","last_clean":"2024-08-28T20:16:09.250318+0000","last_became_active":"2024-08-28T20:15:53.086300+0000","last_became_peered":"2024-08-28T20:15:53.086300+0000","last_unstale":"2024-08-28T20:16:09.250318+0000","last_undegraded":"2024-08-28T20:16:09.250318+0000","last_fullsized":"2024-08-28T20:16:09.250318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:33:30.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251493+0000","last_change":"2024-08-28T20:15:50.037252+0000","last_active":"2024-08-28T20:16:09.251493+0000","last_peered":"2024-08-28T20:16:09.251493+0000","last_clean":"2024-08-28T20:16:09.251493+0000","last_became_active":"2024-08-28T20:15:50.036778+0000","last_became_peered":"2024-08-28T20:15:50.036778+0000","last_unstale":"2024-08-28T20:16:09.251493+0000","last_undegraded":"2024-08-28T20:16:09.251493+0000","last_fullsized":"2024-08-28T20:16:09.251493+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:11:16.685741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254245+0000","last_change":"2024-08-28T20:15:53.070510+0000","last_active":"2024-08-28T20:16:09.254245+0000","last_peered":"2024-08-28T20:16:09.254245+0000","last_clean":"2024-08-28T20:16:09.254245+0000","last_became_active":"2024-08-28T20:15:53.070006+0000","last_became_peered":"2024-08-28T20:15:53.070006+0000","last_unstale":"2024-08-28T20:16:09.254245+0000","last_undegraded":"2024-08-28T20:16:09.254245+0000","last_fullsized":"2024-08-28T20:16:09.254245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:58:06.081692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:12.364629+0000","last_change":"2024-08-28T20:15:50.036777+0000","last_active":"2024-08-28T20:17:12.364629+0000","last_peered":"2024-08-28T20:17:12.364629+0000","last_clean":"2024-08-28T20:17:12.364629+0000","last_became_active":"2024-08-28T20:15:50.036329+0000","last_became_peered":"2024-08-28T20:15:50.036329+0000","last_unstale":"2024-08-28T20:17:12.364629+0000","last_undegraded":"2024-08-28T20:17:12.364629+0000","last_fullsized":"2024-08-28T20:17:12.364629+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:58:06.285314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255588+0000","last_change":"2024-08-28T20:15:53.077888+0000","last_active":"2024-08-28T20:16:09.255588+0000","last_peered":"2024-08-28T20:16:09.255588+0000","last_clean":"2024-08-28T20:16:09.255588+0000","last_became_active":"2024-08-28T20:15:53.074925+0000","last_became_peered":"2024-08-28T20:15:53.074925+0000","last_unstale":"2024-08-28T20:16:09.255588+0000","last_undegraded":"2024-08-28T20:16:09.255588+0000","last_fullsized":"2024-08-28T20:16:09.255588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:18:59.262238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256613+0000","last_change":"2024-08-28T20:15:50.038654+0000","last_active":"2024-08-28T20:16:09.256613+0000","last_peered":"2024-08-28T20:16:09.256613+0000","last_clean":"2024-08-28T20:16:09.256613+0000","last_became_active":"2024-08-28T20:15:50.038208+0000","last_became_peered":"2024-08-28T20:15:50.038208+0000","last_unstale":"2024-08-28T20:16:09.256613+0000","last_undegraded":"2024-08-28T20:16:09.256613+0000","last_fullsized":"2024-08-28T20:16:09.256613+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:20.845229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.259937+0000","last_change":"2024-08-28T20:15:53.085682+0000","last_active":"2024-08-28T20:16:09.259937+0000","last_peered":"2024-08-28T20:16:09.259937+0000","last_clean":"2024-08-28T20:16:09.259937+0000","last_became_active":"2024-08-28T20:15:53.085312+0000","last_became_peered":"2024-08-28T20:15:53.085312+0000","last_unstale":"2024-08-28T20:16:09.259937+0000","last_undegraded":"2024-08-28T20:16:09.259937+0000","last_fullsized":"2024-08-28T20:16:09.259937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:36:21.112522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251741+0000","last_change":"2024-08-28T20:15:50.194955+0000","last_active":"2024-08-28T20:16:09.251741+0000","last_peered":"2024-08-28T20:16:09.251741+0000","last_clean":"2024-08-28T20:16:09.251741+0000","last_became_active":"2024-08-28T20:15:50.194473+0000","last_became_peered":"2024-08-28T20:15:50.194473+0000","last_unstale":"2024-08-28T20:16:09.251741+0000","last_undegraded":"2024-08-28T20:16:09.251741+0000","last_fullsized":"2024-08-28T20:16:09.251741+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:29:21.702692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255283+0000","last_change":"2024-08-28T20:15:53.075495+0000","last_active":"2024-08-28T20:16:09.255283+0000","last_peered":"2024-08-28T20:16:09.255283+0000","last_clean":"2024-08-28T20:16:09.255283+0000","last_became_active":"2024-08-28T20:15:53.071017+0000","last_became_peered":"2024-08-28T20:15:53.071017+0000","last_unstale":"2024-08-28T20:16:09.255283+0000","last_undegraded":"2024-08-28T20:16:09.255283+0000","last_fullsized":"2024-08-28T20:16:09.255283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:20:17.809878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'27","reported_seq":211,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:13.366026+0000","last_change":"2024-08-28T20:16:09.288268+0000","last_active":"2024-08-28T20:17:13.366026+0000","last_peered":"2024-08-28T20:17:13.366026+0000","last_clean":"2024-08-28T20:17:13.366026+0000","last_became_active":"2024-08-28T20:16:09.259977+0000","last_became_peered":"2024-08-28T20:16:09.259977+0000","last_unstale":"2024-08-28T20:17:13.366026+0000","last_undegraded":"2024-08-28T20:17:13.366026+0000","last_fullsized":"2024-08-28T20:17:13.366026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:10:36.700199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":28,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255423+0000","last_change":"2024-08-28T20:15:53.073649+0000","last_active":"2024-08-28T20:16:09.255423+0000","last_peered":"2024-08-28T20:16:09.255423+0000","last_clean":"2024-08-28T20:16:09.255423+0000","last_became_active":"2024-08-28T20:15:53.073314+0000","last_became_peered":"2024-08-28T20:15:53.073314+0000","last_unstale":"2024-08-28T20:16:09.255423+0000","last_undegraded":"2024-08-28T20:16:09.255423+0000","last_fullsized":"2024-08-28T20:16:09.255423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:12.160611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254043+0000","last_change":"2024-08-28T20:15:50.038301+0000","last_active":"2024-08-28T20:16:09.254043+0000","last_peered":"2024-08-28T20:16:09.254043+0000","last_clean":"2024-08-28T20:16:09.254043+0000","last_became_active":"2024-08-28T20:15:50.037068+0000","last_became_peered":"2024-08-28T20:15:50.037068+0000","last_unstale":"2024-08-28T20:16:09.254043+0000","last_undegraded":"2024-08-28T20:16:09.254043+0000","last_fullsized":"2024-08-28T20:16:09.254043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:55:55.874707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252981+0000","last_change":"2024-08-28T20:15:53.085561+0000","last_active":"2024-08-28T20:16:09.252981+0000","last_peered":"2024-08-28T20:16:09.252981+0000","last_clean":"2024-08-28T20:16:09.252981+0000","last_became_active":"2024-08-28T20:15:53.085184+0000","last_became_peered":"2024-08-28T20:15:53.085184+0000","last_unstale":"2024-08-28T20:16:09.252981+0000","last_undegraded":"2024-08-28T20:16:09.252981+0000","last_fullsized":"2024-08-28T20:16:09.252981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:19:29.992874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251181+0000","last_change":"2024-08-28T20:15:50.040070+0000","last_active":"2024-08-28T20:16:09.251181+0000","last_peered":"2024-08-28T20:16:09.251181+0000","last_clean":"2024-08-28T20:16:09.251181+0000","last_became_active":"2024-08-28T20:15:50.039613+0000","last_became_peered":"2024-08-28T20:15:50.039613+0000","last_unstale":"2024-08-28T20:16:09.251181+0000","last_undegraded":"2024-08-28T20:16:09.251181+0000","last_fullsized":"2024-08-28T20:16:09.251181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:58:55.014173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.263222+0000","last_change":"2024-08-28T20:16:09.263069+0000","last_active":"2024-08-28T20:16:09.263222+0000","last_peered":"2024-08-28T20:16:09.263222+0000","last_clean":"2024-08-28T20:16:09.263222+0000","last_became_active":"2024-08-28T20:16:09.262112+0000","last_became_peered":"2024-08-28T20:16:09.262112+0000","last_unstale":"2024-08-28T20:16:09.263222+0000","last_undegraded":"2024-08-28T20:16:09.263222+0000","last_fullsized":"2024-08-28T20:16:09.263222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:48.595659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'4","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:12.368634+0000","last_change":"2024-08-28T20:16:09.268467+0000","last_active":"2024-08-28T20:17:12.368634+0000","last_peered":"2024-08-28T20:17:12.368634+0000","last_clean":"2024-08-28T20:17:12.368634+0000","last_became_active":"2024-08-28T20:16:09.262061+0000","last_became_peered":"2024-08-28T20:16:09.262061+0000","last_unstale":"2024-08-28T20:17:12.368634+0000","last_undegraded":"2024-08-28T20:17:12.368634+0000","last_fullsized":"2024-08-28T20:17:12.368634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:24:13.257421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":588,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,10],"acting":[4,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255761+0000","last_change":"2024-08-28T20:15:53.079473+0000","last_active":"2024-08-28T20:16:09.255761+0000","last_peered":"2024-08-28T20:16:09.255761+0000","last_clean":"2024-08-28T20:16:09.255761+0000","last_became_active":"2024-08-28T20:15:53.079103+0000","last_became_peered":"2024-08-28T20:15:53.079103+0000","last_unstale":"2024-08-28T20:16:09.255761+0000","last_undegraded":"2024-08-28T20:16:09.255761+0000","last_fullsized":"2024-08-28T20:16:09.255761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:43:59.476622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.283415+0000","last_change":"2024-08-28T20:16:09.282923+0000","last_active":"2024-08-28T20:16:09.283415+0000","last_peered":"2024-08-28T20:16:09.283415+0000","last_clean":"2024-08-28T20:16:09.283415+0000","last_became_active":"2024-08-28T20:16:09.262506+0000","last_became_peered":"2024-08-28T20:16:09.262506+0000","last_unstale":"2024-08-28T20:16:09.283415+0000","last_undegraded":"2024-08-28T20:16:09.283415+0000","last_fullsized":"2024-08-28T20:16:09.283415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:37:49.969128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,4],"acting":[11,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260986+0000","last_change":"2024-08-28T20:16:09.260875+0000","last_active":"2024-08-28T20:16:09.260986+0000","last_peered":"2024-08-28T20:16:09.260986+0000","last_clean":"2024-08-28T20:16:09.260986+0000","last_became_active":"2024-08-28T20:16:09.260450+0000","last_became_peered":"2024-08-28T20:16:09.260450+0000","last_unstale":"2024-08-28T20:16:09.260986+0000","last_undegraded":"2024-08-28T20:16:09.260986+0000","last_fullsized":"2024-08-28T20:16:09.260986+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:12:15.671882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255671+0000","last_change":"2024-08-28T20:15:50.032115+0000","last_active":"2024-08-28T20:16:09.255671+0000","last_peered":"2024-08-28T20:16:09.255671+0000","last_clean":"2024-08-28T20:16:09.255671+0000","last_became_active":"2024-08-28T20:15:50.031743+0000","last_became_peered":"2024-08-28T20:15:50.031743+0000","last_unstale":"2024-08-28T20:16:09.255671+0000","last_undegraded":"2024-08-28T20:16:09.255671+0000","last_fullsized":"2024-08-28T20:16:09.255671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:57:48.764221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257991+0000","last_change":"2024-08-28T20:15:53.072928+0000","last_active":"2024-08-28T20:16:09.257991+0000","last_peered":"2024-08-28T20:16:09.257991+0000","last_clean":"2024-08-28T20:16:09.257991+0000","last_became_active":"2024-08-28T20:15:53.072550+0000","last_became_peered":"2024-08-28T20:15:53.072550+0000","last_unstale":"2024-08-28T20:16:09.257991+0000","last_undegraded":"2024-08-28T20:16:09.257991+0000","last_fullsized":"2024-08-28T20:16:09.257991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:37:02.518088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254273+0000","last_change":"2024-08-28T20:15:50.037322+0000","last_active":"2024-08-28T20:16:09.254273+0000","last_peered":"2024-08-28T20:16:09.254273+0000","last_clean":"2024-08-28T20:16:09.254273+0000","last_became_active":"2024-08-28T20:15:50.036886+0000","last_became_peered":"2024-08-28T20:15:50.036886+0000","last_unstale":"2024-08-28T20:16:09.254273+0000","last_undegraded":"2024-08-28T20:16:09.254273+0000","last_fullsized":"2024-08-28T20:16:09.254273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:27:33.370255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256787+0000","last_change":"2024-08-28T20:15:53.070188+0000","last_active":"2024-08-28T20:16:09.256787+0000","last_peered":"2024-08-28T20:16:09.256787+0000","last_clean":"2024-08-28T20:16:09.256787+0000","last_became_active":"2024-08-28T20:15:53.069576+0000","last_became_peered":"2024-08-28T20:15:53.069576+0000","last_unstale":"2024-08-28T20:16:09.256787+0000","last_undegraded":"2024-08-28T20:16:09.256787+0000","last_fullsized":"2024-08-28T20:16:09.256787+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:40.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251992+0000","last_change":"2024-08-28T20:15:50.037700+0000","last_active":"2024-08-28T20:16:09.251992+0000","last_peered":"2024-08-28T20:16:09.251992+0000","last_clean":"2024-08-28T20:16:09.251992+0000","last_became_active":"2024-08-28T20:15:50.037114+0000","last_became_peered":"2024-08-28T20:15:50.037114+0000","last_unstale":"2024-08-28T20:16:09.251992+0000","last_undegraded":"2024-08-28T20:16:09.251992+0000","last_fullsized":"2024-08-28T20:16:09.251992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:18:04.478513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256616+0000","last_change":"2024-08-28T20:15:53.080964+0000","last_active":"2024-08-28T20:16:09.256616+0000","last_peered":"2024-08-28T20:16:09.256616+0000","last_clean":"2024-08-28T20:16:09.256616+0000","last_became_active":"2024-08-28T20:15:53.080575+0000","last_became_peered":"2024-08-28T20:15:53.080575+0000","last_unstale":"2024-08-28T20:16:09.256616+0000","last_undegraded":"2024-08-28T20:16:09.256616+0000","last_fullsized":"2024-08-28T20:16:09.256616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:27:22.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255568+0000","last_change":"2024-08-28T20:15:50.195346+0000","last_active":"2024-08-28T20:16:09.255568+0000","last_peered":"2024-08-28T20:16:09.255568+0000","last_clean":"2024-08-28T20:16:09.255568+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255568+0000","last_undegraded":"2024-08-28T20:16:09.255568+0000","last_fullsized":"2024-08-28T20:16:09.255568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:57.094246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256860+0000","last_change":"2024-08-28T20:15:53.081887+0000","last_active":"2024-08-28T20:16:09.256860+0000","last_peered":"2024-08-28T20:16:09.256860+0000","last_clean":"2024-08-28T20:16:09.256860+0000","last_became_active":"2024-08-28T20:15:53.081468+0000","last_became_peered":"2024-08-28T20:15:53.081468+0000","last_unstale":"2024-08-28T20:16:09.256860+0000","last_undegraded":"2024-08-28T20:16:09.256860+0000","last_fullsized":"2024-08-28T20:16:09.256860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:36:56.711342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256111+0000","last_change":"2024-08-28T20:14:34.441400+0000","last_active":"2024-08-28T20:16:09.256111+0000","last_peered":"2024-08-28T20:16:09.256111+0000","last_clean":"2024-08-28T20:16:09.256111+0000","last_became_active":"2024-08-28T20:14:34.435613+0000","last_became_peered":"2024-08-28T20:14:34.435613+0000","last_unstale":"2024-08-28T20:16:09.256111+0000","last_undegraded":"2024-08-28T20:16:09.256111+0000","last_fullsized":"2024-08-28T20:16:09.256111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:11:05.289764+0000","last_clean_scrub_stamp":"2024-08-28T20:11:05.289764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:44:58.327028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256253+0000","last_change":"2024-08-28T20:15:50.034574+0000","last_active":"2024-08-28T20:16:09.256253+0000","last_peered":"2024-08-28T20:16:09.256253+0000","last_clean":"2024-08-28T20:16:09.256253+0000","last_became_active":"2024-08-28T20:15:50.034191+0000","last_became_peered":"2024-08-28T20:15:50.034191+0000","last_unstale":"2024-08-28T20:16:09.256253+0000","last_undegraded":"2024-08-28T20:16:09.256253+0000","last_fullsized":"2024-08-28T20:16:09.256253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:02:17.165360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250475+0000","last_change":"2024-08-28T20:15:53.079974+0000","last_active":"2024-08-28T20:16:09.250475+0000","last_peered":"2024-08-28T20:16:09.250475+0000","last_clean":"2024-08-28T20:16:09.250475+0000","last_became_active":"2024-08-28T20:15:53.079263+0000","last_became_peered":"2024-08-28T20:15:53.079263+0000","last_unstale":"2024-08-28T20:16:09.250475+0000","last_undegraded":"2024-08-28T20:16:09.250475+0000","last_fullsized":"2024-08-28T20:16:09.250475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:06:09.158005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255980+0000","last_change":"2024-08-28T20:15:50.032856+0000","last_active":"2024-08-28T20:16:09.255980+0000","last_peered":"2024-08-28T20:16:09.255980+0000","last_clean":"2024-08-28T20:16:09.255980+0000","last_became_active":"2024-08-28T20:15:50.032378+0000","last_became_peered":"2024-08-28T20:15:50.032378+0000","last_unstale":"2024-08-28T20:16:09.255980+0000","last_undegraded":"2024-08-28T20:16:09.255980+0000","last_fullsized":"2024-08-28T20:16:09.255980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:10:43.559574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.252851+0000","last_change":"2024-08-28T20:15:53.082998+0000","last_active":"2024-08-28T20:16:09.252851+0000","last_peered":"2024-08-28T20:16:09.252851+0000","last_clean":"2024-08-28T20:16:09.252851+0000","last_became_active":"2024-08-28T20:15:53.082579+0000","last_became_peered":"2024-08-28T20:15:53.082579+0000","last_unstale":"2024-08-28T20:16:09.252851+0000","last_undegraded":"2024-08-28T20:16:09.252851+0000","last_fullsized":"2024-08-28T20:16:09.252851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:56:31.892013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:17:11.365905+0000","last_change":"2024-08-28T20:15:50.195181+0000","last_active":"2024-08-28T20:17:11.365905+0000","last_peered":"2024-08-28T20:17:11.365905+0000","last_clean":"2024-08-28T20:17:11.365905+0000","last_became_active":"2024-08-28T20:15:50.194233+0000","last_became_peered":"2024-08-28T20:15:50.194233+0000","last_unstale":"2024-08-28T20:17:11.365905+0000","last_undegraded":"2024-08-28T20:17:11.365905+0000","last_fullsized":"2024-08-28T20:17:11.365905+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:10:18.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.251255+0000","last_change":"2024-08-28T20:15:53.065425+0000","last_active":"2024-08-28T20:16:09.251255+0000","last_peered":"2024-08-28T20:16:09.251255+0000","last_clean":"2024-08-28T20:16:09.251255+0000","last_became_active":"2024-08-28T20:15:53.065021+0000","last_became_peered":"2024-08-28T20:15:53.065021+0000","last_unstale":"2024-08-28T20:16:09.251255+0000","last_undegraded":"2024-08-28T20:16:09.251255+0000","last_fullsized":"2024-08-28T20:16:09.251255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:40.792120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256421+0000","last_change":"2024-08-28T20:15:50.038730+0000","last_active":"2024-08-28T20:16:09.256421+0000","last_peered":"2024-08-28T20:16:09.256421+0000","last_clean":"2024-08-28T20:16:09.256421+0000","last_became_active":"2024-08-28T20:15:50.036791+0000","last_became_peered":"2024-08-28T20:15:50.036791+0000","last_unstale":"2024-08-28T20:16:09.256421+0000","last_undegraded":"2024-08-28T20:16:09.256421+0000","last_fullsized":"2024-08-28T20:16:09.256421+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:18:51.484781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250942+0000","last_change":"2024-08-28T20:15:53.087092+0000","last_active":"2024-08-28T20:16:09.250942+0000","last_peered":"2024-08-28T20:16:09.250942+0000","last_clean":"2024-08-28T20:16:09.250942+0000","last_became_active":"2024-08-28T20:15:53.086614+0000","last_became_peered":"2024-08-28T20:15:53.086614+0000","last_unstale":"2024-08-28T20:16:09.250942+0000","last_undegraded":"2024-08-28T20:16:09.250942+0000","last_fullsized":"2024-08-28T20:16:09.250942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:47:00.962576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254705+0000","last_change":"2024-08-28T20:15:50.194838+0000","last_active":"2024-08-28T20:16:09.254705+0000","last_peered":"2024-08-28T20:16:09.254705+0000","last_clean":"2024-08-28T20:16:09.254705+0000","last_became_active":"2024-08-28T20:15:50.194378+0000","last_became_peered":"2024-08-28T20:15:50.194378+0000","last_unstale":"2024-08-28T20:16:09.254705+0000","last_undegraded":"2024-08-28T20:16:09.254705+0000","last_fullsized":"2024-08-28T20:16:09.254705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:53:56.395001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250871+0000","last_change":"2024-08-28T20:15:53.089721+0000","last_active":"2024-08-28T20:16:09.250871+0000","last_peered":"2024-08-28T20:16:09.250871+0000","last_clean":"2024-08-28T20:16:09.250871+0000","last_became_active":"2024-08-28T20:15:53.089240+0000","last_became_peered":"2024-08-28T20:15:53.089240+0000","last_unstale":"2024-08-28T20:16:09.250871+0000","last_undegraded":"2024-08-28T20:16:09.250871+0000","last_fullsized":"2024-08-28T20:16:09.250871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:55.859753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255661+0000","last_change":"2024-08-28T20:15:50.195290+0000","last_active":"2024-08-28T20:16:09.255661+0000","last_peered":"2024-08-28T20:16:09.255661+0000","last_clean":"2024-08-28T20:16:09.255661+0000","last_became_active":"2024-08-28T20:15:50.194487+0000","last_became_peered":"2024-08-28T20:15:50.194487+0000","last_unstale":"2024-08-28T20:16:09.255661+0000","last_undegraded":"2024-08-28T20:16:09.255661+0000","last_fullsized":"2024-08-28T20:16:09.255661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:44.915047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253801+0000","last_change":"2024-08-28T20:15:53.079572+0000","last_active":"2024-08-28T20:16:09.253801+0000","last_peered":"2024-08-28T20:16:09.253801+0000","last_clean":"2024-08-28T20:16:09.253801+0000","last_became_active":"2024-08-28T20:15:53.074745+0000","last_became_peered":"2024-08-28T20:15:53.074745+0000","last_unstale":"2024-08-28T20:16:09.253801+0000","last_undegraded":"2024-08-28T20:16:09.253801+0000","last_fullsized":"2024-08-28T20:16:09.253801+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:44.989383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'11","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:26.081068+0000","last_change":"2024-08-28T20:15:50.040420+0000","last_active":"2024-08-28T20:16:26.081068+0000","last_peered":"2024-08-28T20:16:26.081068+0000","last_clean":"2024-08-28T20:16:26.081068+0000","last_became_active":"2024-08-28T20:15:50.039932+0000","last_became_peered":"2024-08-28T20:15:50.039932+0000","last_unstale":"2024-08-28T20:16:26.081068+0000","last_undegraded":"2024-08-28T20:16:26.081068+0000","last_fullsized":"2024-08-28T20:16:26.081068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:13.062974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250922+0000","last_change":"2024-08-28T20:15:53.073177+0000","last_active":"2024-08-28T20:16:09.250922+0000","last_peered":"2024-08-28T20:16:09.250922+0000","last_clean":"2024-08-28T20:16:09.250922+0000","last_became_active":"2024-08-28T20:15:53.072323+0000","last_became_peered":"2024-08-28T20:15:53.072323+0000","last_unstale":"2024-08-28T20:16:09.250922+0000","last_undegraded":"2024-08-28T20:16:09.250922+0000","last_fullsized":"2024-08-28T20:16:09.250922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:18:43.672990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253954+0000","last_change":"2024-08-28T20:15:50.114223+0000","last_active":"2024-08-28T20:16:09.253954+0000","last_peered":"2024-08-28T20:16:09.253954+0000","last_clean":"2024-08-28T20:16:09.253954+0000","last_became_active":"2024-08-28T20:15:50.113798+0000","last_became_peered":"2024-08-28T20:15:50.113798+0000","last_unstale":"2024-08-28T20:16:09.253954+0000","last_undegraded":"2024-08-28T20:16:09.253954+0000","last_fullsized":"2024-08-28T20:16:09.253954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:24:56.354493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.261002+0000","last_change":"2024-08-28T20:15:53.097744+0000","last_active":"2024-08-28T20:16:09.261002+0000","last_peered":"2024-08-28T20:16:09.261002+0000","last_clean":"2024-08-28T20:16:09.261002+0000","last_became_active":"2024-08-28T20:15:53.096093+0000","last_became_peered":"2024-08-28T20:15:53.096093+0000","last_unstale":"2024-08-28T20:16:09.261002+0000","last_undegraded":"2024-08-28T20:16:09.261002+0000","last_fullsized":"2024-08-28T20:16:09.261002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:40:36.650309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254952+0000","last_change":"2024-08-28T20:15:50.194574+0000","last_active":"2024-08-28T20:16:09.254952+0000","last_peered":"2024-08-28T20:16:09.254952+0000","last_clean":"2024-08-28T20:16:09.254952+0000","last_became_active":"2024-08-28T20:15:50.194174+0000","last_became_peered":"2024-08-28T20:15:50.194174+0000","last_unstale":"2024-08-28T20:16:09.254952+0000","last_undegraded":"2024-08-28T20:16:09.254952+0000","last_fullsized":"2024-08-28T20:16:09.254952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:07:30.795200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253928+0000","last_change":"2024-08-28T20:15:53.074015+0000","last_active":"2024-08-28T20:16:09.253928+0000","last_peered":"2024-08-28T20:16:09.253928+0000","last_clean":"2024-08-28T20:16:09.253928+0000","last_became_active":"2024-08-28T20:15:53.073641+0000","last_became_peered":"2024-08-28T20:15:53.073641+0000","last_unstale":"2024-08-28T20:16:09.253928+0000","last_undegraded":"2024-08-28T20:16:09.253928+0000","last_fullsized":"2024-08-28T20:16:09.253928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:55.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250392+0000","last_change":"2024-08-28T20:15:50.038105+0000","last_active":"2024-08-28T20:16:09.250392+0000","last_peered":"2024-08-28T20:16:09.250392+0000","last_clean":"2024-08-28T20:16:09.250392+0000","last_became_active":"2024-08-28T20:15:50.037721+0000","last_became_peered":"2024-08-28T20:15:50.037721+0000","last_unstale":"2024-08-28T20:16:09.250392+0000","last_undegraded":"2024-08-28T20:16:09.250392+0000","last_fullsized":"2024-08-28T20:16:09.250392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:24:58.941095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.258053+0000","last_change":"2024-08-28T20:15:53.090160+0000","last_active":"2024-08-28T20:16:09.258053+0000","last_peered":"2024-08-28T20:16:09.258053+0000","last_clean":"2024-08-28T20:16:09.258053+0000","last_became_active":"2024-08-28T20:15:53.089739+0000","last_became_peered":"2024-08-28T20:15:53.089739+0000","last_unstale":"2024-08-28T20:16:09.258053+0000","last_undegraded":"2024-08-28T20:16:09.258053+0000","last_fullsized":"2024-08-28T20:16:09.258053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:51:32.384124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.253620+0000","last_change":"2024-08-28T20:15:50.036817+0000","last_active":"2024-08-28T20:16:09.253620+0000","last_peered":"2024-08-28T20:16:09.253620+0000","last_clean":"2024-08-28T20:16:09.253620+0000","last_became_active":"2024-08-28T20:15:50.036425+0000","last_became_peered":"2024-08-28T20:15:50.036425+0000","last_unstale":"2024-08-28T20:16:09.253620+0000","last_undegraded":"2024-08-28T20:16:09.253620+0000","last_fullsized":"2024-08-28T20:16:09.253620+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:16:59.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250559+0000","last_change":"2024-08-28T20:15:53.090616+0000","last_active":"2024-08-28T20:16:09.250559+0000","last_peered":"2024-08-28T20:16:09.250559+0000","last_clean":"2024-08-28T20:16:09.250559+0000","last_became_active":"2024-08-28T20:15:53.089204+0000","last_became_peered":"2024-08-28T20:15:53.089204+0000","last_unstale":"2024-08-28T20:16:09.250559+0000","last_undegraded":"2024-08-28T20:16:09.250559+0000","last_fullsized":"2024-08-28T20:16:09.250559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:24:39.423756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":45,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.269132+0000","last_change":"2024-08-28T20:16:09.268949+0000","last_active":"2024-08-28T20:16:09.269132+0000","last_peered":"2024-08-28T20:16:09.269132+0000","last_clean":"2024-08-28T20:16:09.269132+0000","last_became_active":"2024-08-28T20:16:09.258665+0000","last_became_peered":"2024-08-28T20:16:09.258665+0000","last_unstale":"2024-08-28T20:16:09.269132+0000","last_undegraded":"2024-08-28T20:16:09.269132+0000","last_fullsized":"2024-08-28T20:16:09.269132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:43:11.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.256137+0000","last_change":"2024-08-28T20:15:53.075853+0000","last_active":"2024-08-28T20:16:09.256137+0000","last_peered":"2024-08-28T20:16:09.256137+0000","last_clean":"2024-08-28T20:16:09.256137+0000","last_became_active":"2024-08-28T20:15:53.075429+0000","last_became_peered":"2024-08-28T20:15:53.075429+0000","last_unstale":"2024-08-28T20:16:09.256137+0000","last_undegraded":"2024-08-28T20:16:09.256137+0000","last_fullsized":"2024-08-28T20:16:09.256137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:09.301878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.257135+0000","last_change":"2024-08-28T20:16:09.256999+0000","last_active":"2024-08-28T20:16:09.257135+0000","last_peered":"2024-08-28T20:16:09.257135+0000","last_clean":"2024-08-28T20:16:09.257135+0000","last_became_active":"2024-08-28T20:16:09.256508+0000","last_became_peered":"2024-08-28T20:16:09.256508+0000","last_unstale":"2024-08-28T20:16:09.257135+0000","last_undegraded":"2024-08-28T20:16:09.257135+0000","last_fullsized":"2024-08-28T20:16:09.257135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T08:08:23.494703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.254657+0000","last_change":"2024-08-28T20:15:50.040047+0000","last_active":"2024-08-28T20:16:09.254657+0000","last_peered":"2024-08-28T20:16:09.254657+0000","last_clean":"2024-08-28T20:16:09.254657+0000","last_became_active":"2024-08-28T20:15:50.039656+0000","last_became_peered":"2024-08-28T20:15:50.039656+0000","last_unstale":"2024-08-28T20:16:09.254657+0000","last_undegraded":"2024-08-28T20:16:09.254657+0000","last_fullsized":"2024-08-28T20:16:09.254657+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:13:30.986352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255216+0000","last_change":"2024-08-28T20:15:53.076441+0000","last_active":"2024-08-28T20:16:09.255216+0000","last_peered":"2024-08-28T20:16:09.255216+0000","last_clean":"2024-08-28T20:16:09.255216+0000","last_became_active":"2024-08-28T20:15:53.076091+0000","last_became_peered":"2024-08-28T20:15:53.076091+0000","last_unstale":"2024-08-28T20:16:09.255216+0000","last_undegraded":"2024-08-28T20:16:09.255216+0000","last_fullsized":"2024-08-28T20:16:09.255216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:45:13.500267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255533+0000","last_change":"2024-08-28T20:15:50.034114+0000","last_active":"2024-08-28T20:16:09.255533+0000","last_peered":"2024-08-28T20:16:09.255533+0000","last_clean":"2024-08-28T20:16:09.255533+0000","last_became_active":"2024-08-28T20:15:50.033681+0000","last_became_peered":"2024-08-28T20:15:50.033681+0000","last_unstale":"2024-08-28T20:16:09.255533+0000","last_undegraded":"2024-08-28T20:16:09.255533+0000","last_fullsized":"2024-08-28T20:16:09.255533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:06:09.372632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.260281+0000","last_change":"2024-08-28T20:15:53.088870+0000","last_active":"2024-08-28T20:16:09.260281+0000","last_peered":"2024-08-28T20:16:09.260281+0000","last_clean":"2024-08-28T20:16:09.260281+0000","last_became_active":"2024-08-28T20:15:53.088536+0000","last_became_peered":"2024-08-28T20:15:53.088536+0000","last_unstale":"2024-08-28T20:16:09.260281+0000","last_undegraded":"2024-08-28T20:16:09.260281+0000","last_fullsized":"2024-08-28T20:16:09.260281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:20:28.927016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250862+0000","last_change":"2024-08-28T20:15:50.194803+0000","last_active":"2024-08-28T20:16:09.250862+0000","last_peered":"2024-08-28T20:16:09.250862+0000","last_clean":"2024-08-28T20:16:09.250862+0000","last_became_active":"2024-08-28T20:15:50.194351+0000","last_became_peered":"2024-08-28T20:15:50.194351+0000","last_unstale":"2024-08-28T20:16:09.250862+0000","last_undegraded":"2024-08-28T20:16:09.250862+0000","last_fullsized":"2024-08-28T20:16:09.250862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:44:14.751785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.250705+0000","last_change":"2024-08-28T20:15:53.083914+0000","last_active":"2024-08-28T20:16:09.250705+0000","last_peered":"2024-08-28T20:16:09.250705+0000","last_clean":"2024-08-28T20:16:09.250705+0000","last_became_active":"2024-08-28T20:15:53.081282+0000","last_became_peered":"2024-08-28T20:15:53.081282+0000","last_unstale":"2024-08-28T20:16:09.250705+0000","last_undegraded":"2024-08-28T20:16:09.250705+0000","last_fullsized":"2024-08-28T20:16:09.250705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:52.034938+0000","last_clean_scrub_stamp":"2024-08-28T20:15:52.034938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:21.373284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-28T20:16:09.255271+0000","last_change":"2024-08-28T20:15:50.034299+0000","last_active":"2024-08-28T20:16:09.255271+0000","last_peered":"2024-08-28T20:16:09.255271+0000","last_clean":"2024-08-28T20:16:09.255271+0000","last_became_active":"2024-08-28T20:15:50.033858+0000","last_became_peered":"2024-08-28T20:15:50.033858+0000","last_unstale":"2024-08-28T20:16:09.255271+0000","last_undegraded":"2024-08-28T20:16:09.255271+0000","last_fullsized":"2024-08-28T20:16:09.255271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T20:15:49.013287+0000","last_clean_scrub_stamp":"2024-08-28T20:15:49.013287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:38:41.264067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63601,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":417,"num_read_kb":276,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2312,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841566,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":405362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005092,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1055352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168617,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":404507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364845,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":404315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528370,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36748,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708404,"statfs":{"total":95995035648,"available":95957405696,"internally_reserved":0,"allocated":1437696,"data_stored":995769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659192,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":403896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855420,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":996041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":464045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":404207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":843776,"data_stored":405318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":462898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":405167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T20:17:17.107 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-28T20:17:17.107 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-28T20:17:17.107 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-28T20:17:17.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-28T20:17:17.486 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:17.944 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:17 smithi001 ceph-mon[20984]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:17.944 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:17 smithi001 ceph-mon[20984]: from='client.25003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 -- 172.21.15.1:0/287469289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d98104ec0 msgr2=0x7f8d9810d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 --2- 172.21.15.1:0/287469289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d98104ec0 0x7f8d9810d410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009900 tx=0x7f8d8402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 -- 172.21.15.1:0/287469289 shutdown_connections 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 --2- 172.21.15.1:0/287469289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d98104ec0 0x7f8d9810d410 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 --2- 172.21.15.1:0/287469289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d9810d9d0 0x7f8d9810fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 --2- 172.21.15.1:0/287469289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d98104570 0x7f8d98104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 -- 172.21.15.1:0/287469289 >> 172.21.15.1:0/287469289 conn(0x7f8d980fe070 msgr2=0x7f8d981004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 -- 172.21.15.1:0/287469289 shutdown_connections 2024-08-28T20:17:18.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.121+0000 7f8d97e00640 1 -- 172.21.15.1:0/287469289 wait complete. 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 Processor -- start 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 -- start start 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 0x7f8d981022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d98104ec0 0x7f8d981027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9810d9d0 0x7f8d98102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98113600 con 0x7f8d9810d9d0 2024-08-28T20:17:18.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98113480 con 0x7f8d98104570 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.122+0000 7f8d97e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98113780 con 0x7f8d98104ec0 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d97400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9810d9d0 0x7f8d98102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 0x7f8d981022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 0x7f8d981022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:50730/0 (socket says 172.21.15.1:50730) 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 -- 172.21.15.1:0/4204763351 learned_addr learned my addr 172.21.15.1:0/4204763351 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96000640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d98104ec0 0x7f8d981027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 -- 172.21.15.1:0/4204763351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d98104ec0 msgr2=0x7f8d981027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d98104ec0 0x7f8d981027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 -- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9810d9d0 msgr2=0x7f8d98102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9810d9d0 0x7f8d98102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 -- 172.21.15.1:0/4204763351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d981a8330 con 0x7f8d98104570 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.123+0000 7f8d96a00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 0x7f8d981022b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800d950 tx=0x7f8d8800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.124+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88017070 con 0x7f8d98104570 2024-08-28T20:17:18.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.124+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d88009c30 con 0x7f8d98104570 2024-08-28T20:17:18.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.124+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d981a8620 con 0x7f8d98104570 2024-08-28T20:17:18.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.124+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800f620 con 0x7f8d98104570 2024-08-28T20:17:18.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.124+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d981a8b30 con 0x7f8d98104570 2024-08-28T20:17:18.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.125+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d98104980 con 0x7f8d98104570 2024-08-28T20:17:18.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.127+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f8d88010460 con 0x7f8d98104570 2024-08-28T20:17:18.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.129+0000 7f8d8f400640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8d7c0b4bc0 0x7f8d7c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:18.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.129+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8d880e4ec0 con 0x7f8d98104570 2024-08-28T20:17:18.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.129+0000 7f8d96000640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8d7c0b4bc0 0x7f8d7c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:18.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.130+0000 7f8d96000640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8d7c0b4bc0 0x7f8d7c0b70d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009230 tx=0x7f8d84031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:18.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.131+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d88009de0 con 0x7f8d98104570 2024-08-28T20:17:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:17 smithi121 ceph-mon[25248]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:18.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:17 smithi121 ceph-mon[25248]: from='client.25003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:17:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:17 smithi007 ceph-mon[25357]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:17 smithi007 ceph-mon[25357]: from='client.25003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T20:17:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.371+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8d9802e430 con 0x7f8d98104570 2024-08-28T20:17:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.371+0000 7f8d8f400640 1 -- 172.21.15.1:0/4204763351 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8d880ab7d0 con 0x7f8d98104570 2024-08-28T20:17:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:18.373 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-28T20:17:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8d7c0b4bc0 msgr2=0x7f8d7c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8d7c0b4bc0 0x7f8d7c0b70d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009230 tx=0x7f8d84031400 comp rx=0 tx=0).stop 2024-08-28T20:17:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 msgr2=0x7f8d981022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 0x7f8d981022b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800d950 tx=0x7f8d8800de10 comp rx=0 tx=0).stop 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 shutdown_connections 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8d7c0b4bc0 0x7f8d7c0b70d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d9810d9d0 0x7f8d98102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d98104ec0 0x7f8d981027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 --2- 172.21.15.1:0/4204763351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d98104570 0x7f8d981022b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 >> 172.21.15.1:0/4204763351 conn(0x7f8d980fe070 msgr2=0x7f8d980fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 shutdown_connections 2024-08-28T20:17:18.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:18.374+0000 7f8d97e00640 1 -- 172.21.15.1:0/4204763351 wait complete. 2024-08-28T20:17:18.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:18 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/4204763351' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T20:17:19.203 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-28T20:17:19.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:17:19.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:18 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/4204763351' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T20:17:19.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:18 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/4204763351' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T20:17:19.580 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:19.975 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:19 smithi001 ceph-mon[20984]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:20.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 -- 172.21.15.1:0/2747058591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c1099e0 msgr2=0x7f984c110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:20.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 --2- 172.21.15.1:0/2747058591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c1099e0 0x7f984c110210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9844009ca0 tx=0x7f984402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 -- 172.21.15.1:0/2747058591 shutdown_connections 2024-08-28T20:17:20.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 --2- 172.21.15.1:0/2747058591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c1099e0 0x7f984c110210 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 --2- 172.21.15.1:0/2747058591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 0x7f984c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 --2- 172.21.15.1:0/2747058591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984c103750 0x7f984c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 -- 172.21.15.1:0/2747058591 >> 172.21.15.1:0/2747058591 conn(0x7f984c0ff1a0 msgr2=0x7f984c1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:20.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 -- 172.21.15.1:0/2747058591 shutdown_connections 2024-08-28T20:17:20.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.145+0000 7f9852e00640 1 -- 172.21.15.1:0/2747058591 wait complete. 2024-08-28T20:17:20.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.146+0000 7f9852e00640 1 Processor -- start 2024-08-28T20:17:20.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.146+0000 7f9852e00640 1 -- start start 2024-08-28T20:17:20.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 0x7f984c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:20.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 0x7f984c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984c1099e0 0x7f984c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f984c113690 con 0x7f984c103750 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f984c113510 con 0x7f984c109090 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f984c113810 con 0x7f984c1099e0 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9851a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 0x7f984c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9851000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 0x7f984c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9851a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 0x7f984c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37084/0 (socket says 172.21.15.1:37084) 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9851000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 0x7f984c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:50736/0 (socket says 172.21.15.1:50736) 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9851a00640 1 -- 172.21.15.1:0/874260289 learned_addr learned my addr 172.21.15.1:0/874260289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.147+0000 7f9852400640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984c1099e0 0x7f984c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9851a00640 1 -- 172.21.15.1:0/874260289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984c1099e0 msgr2=0x7f984c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:20.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9851a00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984c1099e0 0x7f984c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9851a00640 1 -- 172.21.15.1:0/874260289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 msgr2=0x7f984c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9851a00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 0x7f984c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9851a00640 1 -- 172.21.15.1:0/874260289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984c1a82a0 con 0x7f984c103750 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9851a00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 0x7f984c0754b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f984000e9f0 tx=0x7f984000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984000cd80 con 0x7f984c103750 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984c1a8590 con 0x7f984c103750 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98400108e0 con 0x7f984c103750 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840018980 con 0x7f984c103750 2024-08-28T20:17:20.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.148+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984c1a8ad0 con 0x7f984c103750 2024-08-28T20:17:20.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.149+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f984c103b60 con 0x7f984c103750 2024-08-28T20:17:20.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.152+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f9840010430 con 0x7f984c103750 2024-08-28T20:17:20.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.153+0000 7f984a000640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f98340b4bc0 0x7f98340b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:20.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.154+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f98400e5b10 con 0x7f984c103750 2024-08-28T20:17:20.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.154+0000 7f9851000640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f98340b4bc0 0x7f98340b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:20.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.154+0000 7f9851000640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f98340b4bc0 0x7f98340b70d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f984c1028a0 tx=0x7f9838005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.155+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f98400ac420 con 0x7f984c103750 2024-08-28T20:17:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:19 smithi121 ceph-mon[25248]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:20.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:19 smithi007 ceph-mon[25357]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:20.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.390+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f984c02e430 con 0x7f984c103750 2024-08-28T20:17:20.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.391+0000 7f984a000640 1 -- 172.21.15.1:0/874260289 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7f98400b0be0 con 0x7f984c103750 2024-08-28T20:17:20.392 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:20.393 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-08-28T20:16:11:262914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:16:10.320965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:17:20.393 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:17:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f98340b4bc0 msgr2=0x7f98340b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f98340b4bc0 0x7f98340b70d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f984c1028a0 tx=0x7f9838005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 msgr2=0x7f984c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:20.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 0x7f984c0754b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f984000e9f0 tx=0x7f984000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 shutdown_connections 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f98340b4bc0 0x7f98340b70d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984c1099e0 0x7f984c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f984c109090 0x7f984c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 --2- 172.21.15.1:0/874260289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c103750 0x7f984c0754b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 >> 172.21.15.1:0/874260289 conn(0x7f984c0ff1a0 msgr2=0x7f984c108700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 shutdown_connections 2024-08-28T20:17:20.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:20.394+0000 7f9852e00640 1 -- 172.21.15.1:0/874260289 wait complete. 2024-08-28T20:17:21.181 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:20 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/874260289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:21.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:17:21.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:20 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/874260289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:21.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:20 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/874260289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:21.595 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:22.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:21 smithi001 ceph-mon[20984]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 -- 172.21.15.1:0/3655194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97010fee0 msgr2=0x7fb970112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 --2- 172.21.15.1:0/3655194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97010fee0 0x7fb970112300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb968009ca0 tx=0x7fb96802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 -- 172.21.15.1:0/3655194 shutdown_connections 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 --2- 172.21.15.1:0/3655194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97010fee0 0x7fb970112300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 --2- 172.21.15.1:0/3655194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb970075e20 0x7fb97010f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 --2- 172.21.15.1:0/3655194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9700754d0 0x7fb9700758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 -- 172.21.15.1:0/3655194 >> 172.21.15.1:0/3655194 conn(0x7fb97007b5f0 msgr2=0x7fb97007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 -- 172.21.15.1:0/3655194 shutdown_connections 2024-08-28T20:17:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.179+0000 7fb977c00640 1 -- 172.21.15.1:0/3655194 wait complete. 2024-08-28T20:17:22.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.180+0000 7fb977c00640 1 Processor -- start 2024-08-28T20:17:22.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.180+0000 7fb977c00640 1 -- start start 2024-08-28T20:17:22.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.180+0000 7fb977c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9700754d0 0x7fb97019c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:22.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.180+0000 7fb977c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 0x7fb97019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:22.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb977c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb97010fee0 0x7fb9701a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb977c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb970115a20 con 0x7fb970075e20 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb977c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701158a0 con 0x7fb97010fee0 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb977c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb970115ba0 con 0x7fb9700754d0 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 0x7fb97019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb975200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9700754d0 0x7fb97019c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 0x7fb97019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37110/0 (socket says 172.21.15.1:37110) 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 -- 172.21.15.1:0/3235019661 learned_addr learned my addr 172.21.15.1:0/3235019661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:22.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb975c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb97010fee0 0x7fb9701a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 -- 172.21.15.1:0/3235019661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9700754d0 msgr2=0x7fb97019c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9700754d0 0x7fb97019c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 -- 172.21.15.1:0/3235019661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb97010fee0 msgr2=0x7fb9701a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb97010fee0 0x7fb9701a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.181+0000 7fb96fe00640 1 -- 172.21.15.1:0/3235019661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9701a22e0 con 0x7fb970075e20 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.182+0000 7fb96fe00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 0x7fb97019c910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00d950 tx=0x7fb95c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.182+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c017070 con 0x7fb970075e20 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.182+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb95c009c30 con 0x7fb970075e20 2024-08-28T20:17:22.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.182+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0047a0 con 0x7fb970075e20 2024-08-28T20:17:22.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.182+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9701a25d0 con 0x7fb970075e20 2024-08-28T20:17:22.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.182+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9701a8d30 con 0x7fb970075e20 2024-08-28T20:17:22.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.183+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9700758e0 con 0x7fb970075e20 2024-08-28T20:17:22.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.186+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fb95c004020 con 0x7fb970075e20 2024-08-28T20:17:22.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.188+0000 7fb96d600640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb9580b4c40 0x7fb9580b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:22.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.188+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb95c0e5240 con 0x7fb970075e20 2024-08-28T20:17:22.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.189+0000 7fb975200640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb9580b4c40 0x7fb9580b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:22.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.189+0000 7fb975200640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb9580b4c40 0x7fb9580b7150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb964005d00 tx=0x7fb96400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:22.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.190+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb95c020020 con 0x7fb970075e20 2024-08-28T20:17:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:21 smithi121 ceph-mon[25248]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:21 smithi007 ceph-mon[25357]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:22.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.424+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9701a8fc0 con 0x7fb970075e20 2024-08-28T20:17:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.425+0000 7fb96d600640 1 -- 172.21.15.1:0/3235019661 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7fb95c0ac220 con 0x7fb970075e20 2024-08-28T20:17:22.427 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:22.427 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-08-28T20:16:11:262914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:16:10.320965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:17:22.427 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:17:22.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb9580b4c40 msgr2=0x7fb9580b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:22.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb9580b4c40 0x7fb9580b7150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb964005d00 tx=0x7fb96400b410 comp rx=0 tx=0).stop 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 msgr2=0x7fb97019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 0x7fb97019c910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00d950 tx=0x7fb95c00de10 comp rx=0 tx=0).stop 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 shutdown_connections 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb9580b4c40 0x7fb9580b7150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb970075e20 0x7fb97019c910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb97010fee0 0x7fb9701a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 --2- 172.21.15.1:0/3235019661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9700754d0 0x7fb97019c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 >> 172.21.15.1:0/3235019661 conn(0x7fb97007b5f0 msgr2=0x7fb9701015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 shutdown_connections 2024-08-28T20:17:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:22.428+0000 7fb977c00640 1 -- 172.21.15.1:0/3235019661 wait complete. 2024-08-28T20:17:22.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:22 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3235019661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:23.073 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:22 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3235019661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:23.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:22 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3235019661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:23.339 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:17:23.726 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:24.185 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:23 smithi001 ceph-mon[20984]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:24.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:23 smithi121 ceph-mon[25248]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:23 smithi007 ceph-mon[25357]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 -- 172.21.15.1:0/4110141439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0105b20 msgr2=0x7f81c0105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 --2- 172.21.15.1:0/4110141439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0105b20 0x7f81c0105f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009860 tx=0x7f81b002a340 comp rx=0 tx=0).stop 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 -- 172.21.15.1:0/4110141439 shutdown_connections 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 --2- 172.21.15.1:0/4110141439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c010b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 --2- 172.21.15.1:0/4110141439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c010bdb0 0x7f81c01125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 --2- 172.21.15.1:0/4110141439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0105b20 0x7f81c0105f30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 -- 172.21.15.1:0/4110141439 >> 172.21.15.1:0/4110141439 conn(0x7f81c01015b0 msgr2=0x7f81c0103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 -- 172.21.15.1:0/4110141439 shutdown_connections 2024-08-28T20:17:24.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.364+0000 7f81c7200640 1 -- 172.21.15.1:0/4110141439 wait complete. 2024-08-28T20:17:24.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.365+0000 7f81c7200640 1 Processor -- start 2024-08-28T20:17:24.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 -- start start 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 0x7f81c007b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c00776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c010bdb0 0x7f81c0077de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0115a70 con 0x7f81c010b460 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01158f0 con 0x7f81c010bdb0 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81c7200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0115bf0 con 0x7f81c0105b20 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 0x7f81c007b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81bf400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c00776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 0x7f81c007b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40362/0 (socket says 172.21.15.1:40362) 2024-08-28T20:17:24.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81bf400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c00776c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37128/0 (socket says 172.21.15.1:37128) 2024-08-28T20:17:24.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.366+0000 7f81bfe00640 1 -- 172.21.15.1:0/462758342 learned_addr learned my addr 172.21.15.1:0/462758342 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:24.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81c5200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c010bdb0 0x7f81c0077de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:24.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bfe00640 1 -- 172.21.15.1:0/462758342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c010bdb0 msgr2=0x7f81c0077de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bfe00640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c010bdb0 0x7f81c0077de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bfe00640 1 -- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 msgr2=0x7f81c00776c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bfe00640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c00776c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bfe00640 1 -- 172.21.15.1:0/462758342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c01ac9b0 con 0x7f81c0105b20 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81c5200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c010bdb0 0x7f81c0077de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bf400640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c00776c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.367+0000 7f81bfe00640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 0x7f81c007b3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81b0035040 tx=0x7f81b0032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.368+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b0037040 con 0x7f81c0105b20 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.368+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c01acb80 con 0x7f81c0105b20 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.368+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c01ad0b0 con 0x7f81c0105b20 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.368+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b0041070 con 0x7f81c0105b20 2024-08-28T20:17:24.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.368+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00328f0 con 0x7f81c0105b20 2024-08-28T20:17:24.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.369+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a00052c0 con 0x7f81c0105b20 2024-08-28T20:17:24.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.371+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f81b0030450 con 0x7f81c0105b20 2024-08-28T20:17:24.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.373+0000 7f81bcc00640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81a40b4d60 0x7f81a40b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:24.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.373+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f81b0104ec0 con 0x7f81c0105b20 2024-08-28T20:17:24.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.373+0000 7f81bf400640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81a40b4d60 0x7f81a40b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:24.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.374+0000 7f81bf400640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81a40b4d60 0x7f81a40b7270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f81c010af50 tx=0x7f81ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:24.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.375+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f81b004c060 con 0x7f81c0105b20 2024-08-28T20:17:24.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.571+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81a0005880 con 0x7f81c0105b20 2024-08-28T20:17:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.573+0000 7f81bcc00640 1 -- 172.21.15.1:0/462758342 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7f81b00d2020 con 0x7f81c0105b20 2024-08-28T20:17:24.575 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:24.575 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:17:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.575+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81a40b4d60 msgr2=0x7f81a40b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.575+0000 7f81c7200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81a40b4d60 0x7f81a40b7270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f81c010af50 tx=0x7f81ac009260 comp rx=0 tx=0).stop 2024-08-28T20:17:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.575+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 msgr2=0x7f81c007b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.575+0000 7f81c7200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 0x7f81c007b3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81b0035040 tx=0x7f81b0032d50 comp rx=0 tx=0).stop 2024-08-28T20:17:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.575+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 shutdown_connections 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.575+0000 7f81c7200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f81a40b4d60 0x7f81a40b7270 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.576+0000 7f81c7200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81c010b460 0x7f81c00776c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.576+0000 7f81c7200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c010bdb0 0x7f81c0077de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.576+0000 7f81c7200640 1 --2- 172.21.15.1:0/462758342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81c0105b20 0x7f81c007b3e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.576+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 >> 172.21.15.1:0/462758342 conn(0x7f81c01015b0 msgr2=0x7f81c01039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.576+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 shutdown_connections 2024-08-28T20:17:24.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:24.576+0000 7f81c7200640 1 -- 172.21.15.1:0/462758342 wait complete. 2024-08-28T20:17:25.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:24 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/462758342' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:17:25.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:24 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/462758342' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:17:25.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:24 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/462758342' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:17:25.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:17:25.821 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:26.117 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:25 smithi001 ceph-mon[20984]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:25 smithi121 ceph-mon[25248]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:25 smithi007 ceph-mon[25357]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:26.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 -- 172.21.15.1:0/3478096576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c10bde0 msgr2=0x7fc91c112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:26.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 --2- 172.21.15.1:0/3478096576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c10bde0 0x7fc91c112610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc914009ca0 tx=0x7fc91402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 -- 172.21.15.1:0/3478096576 shutdown_connections 2024-08-28T20:17:26.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 --2- 172.21.15.1:0/3478096576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c10bde0 0x7fc91c112610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 --2- 172.21.15.1:0/3478096576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc91c10b490 0x7fc91c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 --2- 172.21.15.1:0/3478096576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c105b50 0x7fc91c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 -- 172.21.15.1:0/3478096576 >> 172.21.15.1:0/3478096576 conn(0x7fc91c101580 msgr2=0x7fc91c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:26.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.476+0000 7fc921c00640 1 -- 172.21.15.1:0/3478096576 shutdown_connections 2024-08-28T20:17:26.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.477+0000 7fc921c00640 1 -- 172.21.15.1:0/3478096576 wait complete. 2024-08-28T20:17:26.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.478+0000 7fc921c00640 1 Processor -- start 2024-08-28T20:17:26.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.478+0000 7fc921c00640 1 -- start start 2024-08-28T20:17:26.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc921c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c105b50 0x7fc91c19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:26.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc921c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc91c10b490 0x7fc91c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:26.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc921c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 0x7fc91c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc921c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c115aa0 con 0x7fc91c105b50 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc921c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c115920 con 0x7fc91c10bde0 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc921c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c115c20 con 0x7fc91c10b490 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 0x7fc91c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91aa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c105b50 0x7fc91c19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 0x7fc91c1a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:50792/0 (socket says 172.21.15.1:50792) 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 -- 172.21.15.1:0/859616110 learned_addr learned my addr 172.21.15.1:0/859616110 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:26.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc913e00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc91c10b490 0x7fc91c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:26.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 -- 172.21.15.1:0/859616110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc91c10b490 msgr2=0x7fc91c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc91c10b490 0x7fc91c19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 -- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c105b50 msgr2=0x7fc91c19c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c105b50 0x7fc91c19c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.479+0000 7fc91b400640 1 -- 172.21.15.1:0/859616110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c1a2380 con 0x7fc91c10bde0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.480+0000 7fc91b400640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 0x7fc91c1a1c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc9140098d0 tx=0x7fc9140317b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.480+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914003b70 con 0x7fc91c10bde0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.480+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c1a2610 con 0x7fc91c10bde0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.480+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc914003d10 con 0x7fc91c10bde0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.480+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91402fa20 con 0x7fc91c10bde0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.480+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c1a8dd0 con 0x7fc91c10bde0 2024-08-28T20:17:26.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.481+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91c105f60 con 0x7fc91c10bde0 2024-08-28T20:17:26.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.484+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fc91402fbe0 con 0x7fc91c10bde0 2024-08-28T20:17:26.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.485+0000 7fc913400640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc9000b4bc0 0x7fc9000b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:26.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.486+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc914106710 con 0x7fc91c10bde0 2024-08-28T20:17:26.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.486+0000 7fc91aa00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc9000b4bc0 0x7fc9000b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:26.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.486+0000 7fc91aa00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc9000b4bc0 0x7fc9000b70d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009bd0 tx=0x7fc90c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:26.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.487+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc9140cd670 con 0x7fc91c10bde0 2024-08-28T20:17:26.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.718+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc91c19d540 con 0x7fc91c10bde0 2024-08-28T20:17:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.719+0000 7fc913400640 1 -- 172.21.15.1:0/859616110 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7fc9140ccf70 con 0x7fc91c10bde0 2024-08-28T20:17:26.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:26.722 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-08-28T20:16:11:262914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:16:10.320965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:17:26.722 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:17:26.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc9000b4bc0 msgr2=0x7fc9000b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:26.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc9000b4bc0 0x7fc9000b70d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009bd0 tx=0x7fc90c005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:26.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 msgr2=0x7fc91c1a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:26.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 0x7fc91c1a1c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc9140098d0 tx=0x7fc9140317b0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 shutdown_connections 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc9000b4bc0 0x7fc9000b70d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc91c10bde0 0x7fc91c1a1c50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc91c10b490 0x7fc91c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 --2- 172.21.15.1:0/859616110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc91c105b50 0x7fc91c19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 >> 172.21.15.1:0/859616110 conn(0x7fc91c101580 msgr2=0x7fc91c108a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 shutdown_connections 2024-08-28T20:17:26.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:26.722+0000 7fc921c00640 1 -- 172.21.15.1:0/859616110 wait complete. 2024-08-28T20:17:26.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/859616110' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:27.216 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/859616110' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/859616110' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:27.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-28T20:15:54.165615+0000', 'modified': '2024-08-28T20:16:10.320965+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24701, 'mds_1': 24673, 'mds_2': 24667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24640': {'gid': 24640, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/179317583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 179317583}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 179317583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24646': {'gid': 24646, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/1661917289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 1661917289}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1661917289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/3668716781', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3668716781}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3668716781}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.121:6839/1704938195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 1704938195}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 1704938195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.1:6839/825690381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 825690381}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 825690381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24701': {'gid': 24701, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.7:6839/1672375051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 1672375051}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 1672375051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24701, 'qdb_cluster': [24701, 24673, 24667]} 2024-08-28T20:17:27.417 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-28T20:17:27.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-28T20:17:27.793 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:28.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:27 smithi001 ceph-mon[20984]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:28.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:27 smithi121 ceph-mon[25248]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:27 smithi007 ceph-mon[25357]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:28.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 -- 172.21.15.1:0/1491716249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc300105b20 msgr2=0x7fc300105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 --2- 172.21.15.1:0/1491716249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc300105b20 0x7fc300105f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009900 tx=0x7fc2f402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 -- 172.21.15.1:0/1491716249 shutdown_connections 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 --2- 172.21.15.1:0/1491716249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc30010bdb0 0x7fc3001125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 --2- 172.21.15.1:0/1491716249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc30010b460 0x7fc30010b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 --2- 172.21.15.1:0/1491716249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc300105b20 0x7fc300105f30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 -- 172.21.15.1:0/1491716249 >> 172.21.15.1:0/1491716249 conn(0x7fc300101570 msgr2=0x7fc3001039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 -- 172.21.15.1:0/1491716249 shutdown_connections 2024-08-28T20:17:28.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.461+0000 7fc307400640 1 -- 172.21.15.1:0/1491716249 wait complete. 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.462+0000 7fc307400640 1 Processor -- start 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.462+0000 7fc307400640 1 -- start start 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc307400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc300105b20 0x7fc30019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc307400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc30010b460 0x7fc30019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc307400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 0x7fc3001a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc307400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc300115ac0 con 0x7fc30010bdb0 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc307400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc300115940 con 0x7fc300105b20 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc307400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc300115c40 con 0x7fc30010b460 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc305400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 0x7fc3001a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc305400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 0x7fc3001a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48344/0 (socket says 172.21.15.1:48344) 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc305400640 1 -- 172.21.15.1:0/844300787 learned_addr learned my addr 172.21.15.1:0/844300787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:28.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc304a00640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc300105b20 0x7fc30019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.463+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc30010b460 0x7fc30019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc305400640 1 -- 172.21.15.1:0/844300787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc30010b460 msgr2=0x7fc30019cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc305400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc30010b460 0x7fc30019cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc305400640 1 -- 172.21.15.1:0/844300787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc300105b20 msgr2=0x7fc30019c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc305400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc300105b20 0x7fc30019c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc305400640 1 -- 172.21.15.1:0/844300787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3001a24a0 con 0x7fc30010bdb0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc304a00640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc300105b20 0x7fc30019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc305400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 0x7fc3001a1d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009fd0 tx=0x7fc2f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc2fd600640 1 -- 172.21.15.1:0/844300787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8017070 con 0x7fc30010bdb0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc2fd600640 1 -- 172.21.15.1:0/844300787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f8003e20 con 0x7fc30010bdb0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc2fd600640 1 -- 172.21.15.1:0/844300787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8010460 con 0x7fc30010bdb0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3001a2790 con 0x7fc30010bdb0 2024-08-28T20:17:28.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.464+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3001a8ef0 con 0x7fc30010bdb0 2024-08-28T20:17:28.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.468+0000 7fc30e055740 1 Processor -- start 2024-08-28T20:17:28.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.468+0000 7fc2fd600640 1 -- 172.21.15.1:0/844300787 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fc2f8003970 con 0x7fc30010bdb0 2024-08-28T20:17:28.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.468+0000 7fc30e055740 1 -- start start 2024-08-28T20:17:28.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.468+0000 7fc30e055740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dcbaf60 0x55f34e0608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.468+0000 7fc30e055740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dc920a0 0x55f34e060e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc30e055740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e061370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc30e055740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f34dfd7550 con 0x55f34dc9a280 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc30e055740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f34dfc6ae0 con 0x55f34dcbaf60 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc30e055740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f34dfcaa90 con 0x55f34dc920a0 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dcbaf60 0x55f34e0608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dcbaf60 0x55f34e0608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35986/0 (socket says 172.21.15.1:35986) 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc2ffe00640 1 -- 172.21.15.1:0/3510367057 learned_addr learned my addr 172.21.15.1:0/3510367057 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e061370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc304a00640 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dc920a0 0x55f34e060e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc304a00640 1 -- 172.21.15.1:0/3510367057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dcbaf60 msgr2=0x55f34e0608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc304a00640 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dcbaf60 0x55f34e0608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc304a00640 1 -- 172.21.15.1:0/3510367057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 msgr2=0x55f34e061370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc304a00640 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e061370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc304a00640 1 -- 172.21.15.1:0/3510367057 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34dd26540 con 0x55f34dc920a0 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.469+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.470+0000 7fc304a00640 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dc920a0 0x55f34e060e30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2f402a9e0 tx=0x7fc2f40045b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7d8bb470cb93c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.470+0000 7fc2f1c00640 1 -- 172.21.15.1:0/3510367057 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4035040 con 0x55f34dc920a0 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.470+0000 7fc2f1c00640 1 -- 172.21.15.1:0/3510367057 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f4005480 con 0x55f34dc920a0 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.470+0000 7fc2f1c00640 1 -- 172.21.15.1:0/3510367057 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40039f0 con 0x55f34dc920a0 2024-08-28T20:17:28.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.470+0000 7fc2fd600640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc2e80b4c40 0x7fc2e80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc2fd600640 1 -- 172.21.15.1:0/844300787 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc2f80e4f20 con 0x7fc30010bdb0 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc2e80b4c40 0x7fc2e80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 -- 172.21.15.1:0/3510367057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dc920a0 msgr2=0x55f34e060e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dc920a0 0x55f34e060e30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2f402a9e0 tx=0x7fc2f40045b0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 -- 172.21.15.1:0/3510367057 shutdown_connections 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dc920a0 0x55f34e060e30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc2e80b4c40 0x7fc2e80b7150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00bfd0 tx=0x7fc2ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 --2- 172.21.15.1:0/3510367057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dcbaf60 0x55f34e0608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 -- 172.21.15.1:0/3510367057 >> 172.21.15.1:0/3510367057 conn(0x55f34dcaf350 msgr2=0x55f34e05e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 -- 172.21.15.1:0/3510367057 shutdown_connections 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.471+0000 7fc30e055740 1 -- 172.21.15.1:0/3510367057 wait complete. 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.472+0000 7fc30e055740 1 -- start start 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.472+0000 7fc30e055740 1 Processor -- start 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e078360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f34de295f0 con 0x55f34dc9a280 2024-08-28T20:17:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f34df4dbd0 con 0x55f34dc920a0 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f34e06f070 con 0x55f34dcbaf60 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc30e055740 10 client.0 _ll_register_callbacks cb 0x55f34df73210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc305400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e078360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48356/0 (socket says 172.21.15.1:48356) 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc2ffe00640 1 -- 172.21.15.1:0/2276443701 learned_addr learned my addr 172.21.15.1:0/2276443701 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.473+0000 7fc304a00640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc305400640 1 -- 172.21.15.1:0/2276443701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 msgr2=0x55f34e06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc305400640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e06bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc305400640 1 -- 172.21.15.1:0/2276443701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 msgr2=0x55f34e06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc305400640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc305400640 1 -- 172.21.15.1:0/2276443701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34df8e650 con 0x55f34dcbaf60 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc304a00640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc305400640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e078360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80e2860 tx=0x7fc2f80e2ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e836cc4eaa66fa85 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc2e6000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc2e6000640 1 -- 172.21.15.1:0/2276443701 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8020040 con 0x55f34dcbaf60 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc2e6000640 1 -- 172.21.15.1:0/2276443701 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc2f80aaa90 con 0x55f34dcbaf60 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2f4005480 con 0x55f34dcbaf60 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.474+0000 7fc2e6000640 1 -- 172.21.15.1:0/2276443701 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc2f80ab340 con 0x55f34dcbaf60 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 10 client.25045 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:28.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f34e07ade0 con 0x55f34dcbaf60 2024-08-28T20:17:28.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc2e6000640 1 -- 172.21.15.1:0/2276443701 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f4005480 con 0x55f34dcbaf60 2024-08-28T20:17:28.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc2e6000640 1 -- 172.21.15.1:0/2276443701 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc2f80a71a0 con 0x55f34dcbaf60 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 10 client.25045 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 10 client.25045 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 20 client.25045 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc798e0 0x55f34e07e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 4 client.25045 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.475+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 --> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f34dfd94a0 con 0x55f34dc798e0 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.476+0000 7fc304a00640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc798e0 0x55f34e07e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.476+0000 7fc304a00640 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc798e0 0x55f34e07e830 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b87e7b990dd1cfa9 server_cookie=8bb25bf2269dc4ca in_seq=0 out_seq=0 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.476+0000 7fc2e6000640 10 client.25045 ms_handle_connect on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc2e6000640 1 -- 172.21.15.1:0/2276443701 <== mds.2 v2:172.21.15.121:6838/1704938195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f34dfd94a0 con 0x55f34dc798e0 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc2e6000640 10 client.25045 handle_command_reply: tid=0 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 client.25045 shutdown 2024-08-28T20:17:28.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 msgr2=0x55f34e078360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e078360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80e2860 tx=0x7fc2f80e2ce0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 shutdown_connections 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc798e0 0x55f34e07e830 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e078360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 --2- 172.21.15.1:0/2276443701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc2e6000640 0 client.25045 ms_handle_reset on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.477+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 >> 172.21.15.1:0/2276443701 conn(0x55f34dcaf350 msgr2=0x55f34e063ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.478+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 shutdown_connections 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.478+0000 7fc30e055740 1 -- 172.21.15.1:0/2276443701 wait complete. 2024-08-28T20:17:28.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.478+0000 7fc30e055740 20 client.25045 trim_cache size 0 max 16384 2024-08-28T20:17:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 Processor -- start 2024-08-28T20:17:28.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 -- start start 2024-08-28T20:17:28.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e0594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e06adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f34e07cb70 con 0x55f34dc9a280 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f34e07d240 con 0x55f34dc920a0 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc30e055740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f34e07d910 con 0x55f34dcbaf60 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.497+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48360/0 (socket says 172.21.15.1:48360) 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 -- 172.21.15.1:0/2378987658 learned_addr learned my addr 172.21.15.1:0/2378987658 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc304a00640 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e0594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc305400640 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e06adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 -- 172.21.15.1:0/2378987658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 msgr2=0x55f34e06adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e06adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 -- 172.21.15.1:0/2378987658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 msgr2=0x55f34e0594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e0594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 -- 172.21.15.1:0/2378987658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34e067b60 con 0x55f34dc9a280 2024-08-28T20:17:28.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc304a00640 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e0594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:28.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.498+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06a870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec012580 tx=0x7fc2ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c9f605d948a763 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:28.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.499+0000 7fc2f1200640 1 -- 172.21.15.1:0/2378987658 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec012cf0 con 0x55f34dc9a280 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.499+0000 7fc2f1200640 1 -- 172.21.15.1:0/2378987658 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec01e8e0 con 0x55f34dc9a280 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.499+0000 7fc2f1200640 1 -- 172.21.15.1:0/2378987658 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec010660 con 0x55f34dc9a280 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.499+0000 7fc30e055740 1 -- 172.21.15.1:0/2378987658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 msgr2=0x55f34e06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.499+0000 7fc30e055740 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06a870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec012580 tx=0x7fc2ec0046c0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 -- 172.21.15.1:0/2378987658 shutdown_connections 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e06a870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e06adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 --2- 172.21.15.1:0/2378987658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e0594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 -- 172.21.15.1:0/2378987658 >> 172.21.15.1:0/2378987658 conn(0x55f34dcaf350 msgr2=0x55f34e0784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 -- 172.21.15.1:0/2378987658 shutdown_connections 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 -- 172.21.15.1:0/2378987658 wait complete. 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 -- start start 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.500+0000 7fc30e055740 1 Processor -- start 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e082a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e082fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e083500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f34e07e6b0 con 0x55f34dc9a280 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f34e07dfe0 con 0x55f34dc920a0 2024-08-28T20:17:28.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f34e07ed80 con 0x55f34dcbaf60 2024-08-28T20:17:28.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc30e055740 10 client.0 _ll_register_callbacks cb 0x7fc2f80aafa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:28.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e082fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e082fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48366/0 (socket says 172.21.15.1:48366) 2024-08-28T20:17:28.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc2ffe00640 1 -- 172.21.15.1:0/3241495517 learned_addr learned my addr 172.21.15.1:0/3241495517 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:28.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc304a00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e082a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.501+0000 7fc305400640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e083500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc304a00640 1 -- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 msgr2=0x55f34e083500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc304a00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e083500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc304a00640 1 -- 172.21.15.1:0/3241495517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 msgr2=0x55f34e082fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc304a00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e082fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc304a00640 1 -- 172.21.15.1:0/3241495517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34e0e8d00 con 0x55f34dc920a0 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e082fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc304a00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e082a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55f34e05f240 tx=0x7fc2f4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5326ac6053649149 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc2e6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:17:28.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc2e6000640 1 -- 172.21.15.1:0/3241495517 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f405c060 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2ec01e8e0 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.502+0000 7fc2e6000640 1 -- 172.21.15.1:0/3241495517 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc2f40048e0 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.503+0000 7fc2e6000640 1 -- 172.21.15.1:0/3241495517 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc2f4035040 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.503+0000 7fc30e055740 10 client.25061 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.503+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f34e0e9f30 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.503+0000 7fc2e6000640 1 -- 172.21.15.1:0/3241495517 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec01e8e0 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc2e6000640 1 -- 172.21.15.1:0/3241495517 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc2f4003c90 con 0x55f34dc920a0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc30e055740 10 client.25061 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc30e055740 10 client.25061 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc30e055740 20 client.25061 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc30e055740 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc4ec90 0x55f34e0ed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc30e055740 4 client.25061 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 --> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] -- command(tid 0: {"prefix": "status"}) -- 0x55f34dfd4f40 con 0x55f34dc4ec90 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.504+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc4ec90 0x55f34e0ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:28.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc2ffe00640 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc4ec90 0x55f34e0ed400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=442787fbee05960 server_cookie=cab9b48da115f9d6 in_seq=0 out_seq=0 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc2e6000640 10 client.25061 ms_handle_connect on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc2e6000640 1 -- 172.21.15.1:0/3241495517 <== mds.2 v2:172.21.15.121:6838/1704938195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f34dfd4f40 con 0x55f34dc4ec90 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc2e6000640 10 client.25061 handle_command_reply: tid=0 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 client.25061 shutdown 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 msgr2=0x55f34e082a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e082a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55f34e05f240 tx=0x7fc2f4009260 comp rx=0 tx=0).stop 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 shutdown_connections 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x55f34dc4ec90 0x55f34e0ed400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f34dc9a280 0x55f34e082fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f34dcbaf60 0x55f34e083500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 --2- 172.21.15.1:0/3241495517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f34dc920a0 0x55f34e082a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc2e6000640 0 client.25061 ms_handle_reset on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 >> 172.21.15.1:0/3241495517 conn(0x55f34dcaf350 msgr2=0x55f34e0784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:28.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 shutdown_connections 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.505+0000 7fc30e055740 1 -- 172.21.15.1:0/3241495517 wait complete. 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc30e055740 20 client.25061 trim_cache size 0 max 16384 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24667, 2024-08-28T20:17:28.512 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 82.268505480000002, 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 76, 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 76, 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 118.392586712 2024-08-28T20:17:28.513 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc2e80b4c40 msgr2=0x7fc2e80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc2e80b4c40 0x7fc2e80b7150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00bfd0 tx=0x7fc2ec00b390 comp rx=0 tx=0).stop 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 msgr2=0x7fc3001a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 0x7fc3001a1d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009fd0 tx=0x7fc2f800b260 comp rx=0 tx=0).stop 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 shutdown_connections 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc2e80b4c40 0x7fc2e80b7150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc30010bdb0 0x7fc3001a1d70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc30010b460 0x7fc30019cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 --2- 172.21.15.1:0/844300787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc300105b20 0x7fc30019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:28.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 >> 172.21.15.1:0/844300787 conn(0x7fc300101570 msgr2=0x7fc300103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:28.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.506+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 shutdown_connections 2024-08-28T20:17:28.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:28.507+0000 7fc307400640 1 -- 172.21.15.1:0/844300787 wait complete. 2024-08-28T20:17:29.300 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell mds.g status 2024-08-28T20:17:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:30.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:29 smithi001 ceph-mon[20984]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:29 smithi121 ceph-mon[25248]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:30.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 -- 172.21.15.1:0/1314141630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198109240 msgr2=0x7f7198109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 --2- 172.21.15.1:0/1314141630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198109240 0x7f7198109650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7180009860 tx=0x7f718002a340 comp rx=0 tx=0).stop 2024-08-28T20:17:30.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 -- 172.21.15.1:0/1314141630 shutdown_connections 2024-08-28T20:17:30.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 --2- 172.21.15.1:0/1314141630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7198109b90 0x7f71981103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 --2- 172.21.15.1:0/1314141630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198109240 0x7f7198109650 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 --2- 172.21.15.1:0/1314141630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198103900 0x7f7198103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 -- 172.21.15.1:0/1314141630 >> 172.21.15.1:0/1314141630 conn(0x7f719807b5f0 msgr2=0x7f719807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 -- 172.21.15.1:0/1314141630 shutdown_connections 2024-08-28T20:17:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.285+0000 7f719fa00640 1 -- 172.21.15.1:0/1314141630 wait complete. 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.286+0000 7f719fa00640 1 Processor -- start 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 -- start start 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 0x7f719819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 0x7f719819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7198109b90 0x7f71981a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7198113850 con 0x7f7198109240 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71981136d0 con 0x7f7198103900 2024-08-28T20:17:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719fa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71981139d0 con 0x7f7198109b90 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f718fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 0x7f719819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 0x7f719819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f718fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 0x7f719819c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48372/0 (socket says 172.21.15.1:48372) 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 0x7f719819c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:36024/0 (socket says 172.21.15.1:36024) 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f718fe00640 1 -- 172.21.15.1:0/504326882 learned_addr learned my addr 172.21.15.1:0/504326882 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.287+0000 7f719da00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7198109b90 0x7f71981a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f718fe00640 1 -- 172.21.15.1:0/504326882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7198109b90 msgr2=0x7f71981a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f718fe00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7198109b90 0x7f71981a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f718fe00640 1 -- 172.21.15.1:0/504326882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 msgr2=0x7f719819c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f718fe00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 0x7f719819c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f718fe00640 1 -- 172.21.15.1:0/504326882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71981a2350 con 0x7f7198109240 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f719d000640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 0x7f719819c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f718fe00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 0x7f719819c980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7180035040 tx=0x7f7180032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f7196000640 1 -- 172.21.15.1:0/504326882 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180040020 con 0x7f7198109240 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71981a25e0 con 0x7f7198109240 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.288+0000 7f7196000640 1 -- 172.21.15.1:0/504326882 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7180030e10 con 0x7f7198109240 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.289+0000 7f7196000640 1 -- 172.21.15.1:0/504326882 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180037040 con 0x7f7198109240 2024-08-28T20:17:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.289+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71981a8da0 con 0x7f7198109240 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.292+0000 7f71a65e6740 1 Processor -- start 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.292+0000 7f71a65e6740 1 -- start start 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.292+0000 7f7196000640 1 -- 172.21.15.1:0/504326882 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f7180043020 con 0x7f7198109240 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.292+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aec538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.292+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8850a0 0x5573aec53e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.292+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec54370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f71a65e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5573aebca550 con 0x5573ae8adf60 2024-08-28T20:17:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f71a65e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573aebb9ae0 con 0x5573ae8850a0 2024-08-28T20:17:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f71a65e6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5573aebbda90 con 0x5573ae88d280 2024-08-28T20:17:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719da00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aec538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f718fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec54370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719da00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aec538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48380/0 (socket says 172.21.15.1:48380) 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719da00640 1 -- 172.21.15.1:0/2843373861 learned_addr learned my addr 172.21.15.1:0/2843373861 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719d000640 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8850a0 0x5573aec53e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719d000640 1 -- 172.21.15.1:0/2843373861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 msgr2=0x5573aec54370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719d000640 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec54370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719d000640 1 -- 172.21.15.1:0/2843373861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 msgr2=0x5573aec538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719d000640 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aec538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719d000640 1 -- 172.21.15.1:0/2843373861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae919540 con 0x5573ae8850a0 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f719da00640 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aec538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.293+0000 7f718fe00640 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec54370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.294+0000 7f719d000640 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8850a0 0x5573aec53e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7188005fd0 tx=0x7f71880118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=864da2fa8cd9a137 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.294+0000 7f718e000640 1 -- 172.21.15.1:0/2843373861 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188004020 con 0x5573ae8850a0 2024-08-28T20:17:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.294+0000 7f718e000640 1 -- 172.21.15.1:0/2843373861 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71880041c0 con 0x5573ae8850a0 2024-08-28T20:17:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.294+0000 7f718e000640 1 -- 172.21.15.1:0/2843373861 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718800f810 con 0x5573ae8850a0 2024-08-28T20:17:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.294+0000 7f7196000640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f717c0b4bc0 0x7f717c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f7196000640 1 -- 172.21.15.1:0/504326882 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7180104ea0 con 0x7f7198109240 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f719da00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f717c0b4bc0 0x7f717c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 -- 172.21.15.1:0/2843373861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8850a0 msgr2=0x5573aec53e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8850a0 0x5573aec53e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7188005fd0 tx=0x7f71880118d0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 -- 172.21.15.1:0/2843373861 shutdown_connections 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec54370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8850a0 0x5573aec53e30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 --2- 172.21.15.1:0/2843373861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aec538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 -- 172.21.15.1:0/2843373861 >> 172.21.15.1:0/2843373861 conn(0x5573ae8a2350 msgr2=0x5573aec517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 -- 172.21.15.1:0/2843373861 shutdown_connections 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f71a65e6740 1 -- 172.21.15.1:0/2843373861 wait complete. 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.295+0000 7f719da00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f717c0b4bc0 0x7f717c0b70d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71900117b0 tx=0x7f7190009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.296+0000 7f71a65e6740 1 -- start start 2024-08-28T20:17:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.296+0000 7f71a65e6740 1 Processor -- start 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec5f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 0x5573aec5f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec6b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5573aea1c5f0 con 0x5573ae88d280 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573aeb40bd0 con 0x5573ae8adf60 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5573aec620d0 con 0x5573ae8850a0 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f71a65e6740 10 client.0 _ll_register_callbacks cb 0x5573aeb66210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f718fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 0x5573aec5f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f719d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec5f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f718fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 0x5573aec5f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48388/0 (socket says 172.21.15.1:48388) 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f719da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec6b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.297+0000 7f718fe00640 1 -- 172.21.15.1:0/551133496 learned_addr learned my addr 172.21.15.1:0/551133496 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f719da00640 1 -- 172.21.15.1:0/551133496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 msgr2=0x5573aec5f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f719da00640 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec5f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f719da00640 1 -- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 msgr2=0x5573aec5f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f719da00640 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 0x5573aec5f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f719da00640 1 -- 172.21.15.1:0/551133496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573aeb81650 con 0x5573ae8adf60 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f718fe00640 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 0x5573aec5f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f719da00640 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec6b3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f719000f790 tx=0x7f7190004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711828310d8e6d6a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f7186a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f7186a00640 1 -- 172.21.15.1:0/551133496 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190004b20 con 0x5573ae8adf60 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71880041c0 con 0x5573ae8adf60 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f7186a00640 1 -- 172.21.15.1:0/551133496 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7190004cc0 con 0x5573ae8adf60 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f7186a00640 1 -- 172.21.15.1:0/551133496 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f71900043d0 con 0x5573ae8adf60 2024-08-28T20:17:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.298+0000 7f71a65e6740 10 client.25073 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5573aec6df20 con 0x5573ae8adf60 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f7186a00640 1 -- 172.21.15.1:0/551133496 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71880041c0 con 0x5573ae8adf60 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f7186a00640 1 -- 172.21.15.1:0/551133496 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7190030050 con 0x5573ae8adf60 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 10 client.25073 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 10 client.25073 resolve_mds: resolved name 'g' to daemon mds.g 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 20 client.25073 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae86c8e0 0x5573aec719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 4 client.25073 mds_command: new command op to 24673 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.299+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 --> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573aebcc4a0 con 0x5573ae86c8e0 2024-08-28T20:17:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.300+0000 7f719d000640 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae86c8e0 0x5573aec719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.300+0000 7f719d000640 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae86c8e0 0x5573aec719b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=562643e87bd0f9ac server_cookie=24bd240168199445 in_seq=0 out_seq=0 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.300+0000 7f7186a00640 10 client.25073 ms_handle_connect on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.301+0000 7f7186a00640 1 -- 172.21.15.1:0/551133496 <== mds.1 v2:172.21.15.1:6838/825690381 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5573aebcc4a0 con 0x5573ae86c8e0 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.301+0000 7f7186a00640 10 client.25073 handle_command_reply: tid=0 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.301+0000 7f71a65e6740 1 client.25073 shutdown 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.301+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 msgr2=0x5573aec6b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.301+0000 7f71a65e6740 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec6b3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f719000f790 tx=0x7f7190004ab0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 shutdown_connections 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae86c8e0 0x5573aec719b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae88d280 0x5573aec5f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec6b3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 --2- 172.21.15.1:0/551133496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec5f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f7186a00640 0 client.25073 ms_handle_reset on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 >> 172.21.15.1:0/551133496 conn(0x5573ae8a2350 msgr2=0x5573aec56ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 shutdown_connections 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 1 -- 172.21.15.1:0/551133496 wait complete. 2024-08-28T20:17:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.302+0000 7f71a65e6740 20 client.25073 trim_cache size 0 max 16384 2024-08-28T20:17:30.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:29 smithi007 ceph-mon[25357]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:30.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 Processor -- start 2024-08-28T20:17:30.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 -- start start 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 0x5573aec4c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec6f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec5d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5573aec6fcf0 con 0x5573ae8850a0 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573aec703c0 con 0x5573ae8adf60 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.321+0000 7f71a65e6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5573aec70a90 con 0x5573ae88d280 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 0x5573aec4c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 0x5573aec4c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48402/0 (socket says 172.21.15.1:48402) 2024-08-28T20:17:30.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 -- 172.21.15.1:0/1237946109 learned_addr learned my addr 172.21.15.1:0/1237946109 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:30.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f718fe00640 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec6f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719da00640 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec5d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 -- 172.21.15.1:0/1237946109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 msgr2=0x5573aec6f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec6f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 -- 172.21.15.1:0/1237946109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 msgr2=0x5573aec5d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec5d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 -- 172.21.15.1:0/1237946109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573aec5d5d0 con 0x5573ae8850a0 2024-08-28T20:17:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.322+0000 7f719d000640 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 0x5573aec4c4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7188003f40 tx=0x7f71880118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dca06e67df05f86 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.323+0000 7f718d600640 1 -- 172.21.15.1:0/1237946109 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188005040 con 0x5573ae8850a0 2024-08-28T20:17:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.323+0000 7f718d600640 1 -- 172.21.15.1:0/1237946109 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71880035f0 con 0x5573ae8850a0 2024-08-28T20:17:30.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.323+0000 7f718d600640 1 -- 172.21.15.1:0/1237946109 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880048a0 con 0x5573ae8850a0 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 -- 172.21.15.1:0/1237946109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 msgr2=0x5573aec4c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 0x5573aec4c4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7188003f40 tx=0x7f71880118d0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 -- 172.21.15.1:0/1237946109 shutdown_connections 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae8adf60 0x5573aec5d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae88d280 0x5573aec6f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 --2- 172.21.15.1:0/1237946109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8850a0 0x5573aec4c4c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 -- 172.21.15.1:0/1237946109 >> 172.21.15.1:0/1237946109 conn(0x5573ae8a2350 msgr2=0x5573aec6b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 -- 172.21.15.1:0/1237946109 shutdown_connections 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 -- 172.21.15.1:0/1237946109 wait complete. 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 -- start start 2024-08-28T20:17:30.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.324+0000 7f71a65e6740 1 Processor -- start 2024-08-28T20:17:30.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec74ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae88d280 0x5573aec75530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aecdae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5573aec71830 con 0x5573ae8adf60 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573aec71160 con 0x5573ae88d280 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5573aec71f00 con 0x5573ae8850a0 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f71a65e6740 10 client.0 _ll_register_callbacks cb 0x7f7190003a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f719d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec74ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f719da00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aecdae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f719d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec74ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37732/0 (socket says 172.21.15.1:37732) 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f719d000640 1 -- 172.21.15.1:0/85517275 learned_addr learned my addr 172.21.15.1:0/85517275 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.325+0000 7f718fe00640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae88d280 0x5573aec75530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f719d000640 1 -- 172.21.15.1:0/85517275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae88d280 msgr2=0x5573aec75530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f719d000640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae88d280 0x5573aec75530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f719d000640 1 -- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 msgr2=0x5573aecdae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f719d000640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aecdae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f719d000640 1 -- 172.21.15.1:0/85517275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573aec75dd0 con 0x5573ae8850a0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f718fe00640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae88d280 0x5573aec75530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f719d000640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec74ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7188005890 tx=0x7f7188004280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c14f78e18ea98d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f7186a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f7186a00640 1 -- 172.21.15.1:0/85517275 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188003bb0 con 0x5573ae8850a0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.326+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71880035f0 con 0x5573ae8850a0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f7186a00640 1 -- 172.21.15.1:0/85517275 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7188005040 con 0x5573ae8850a0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f7186a00640 1 -- 172.21.15.1:0/85517275 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7188005240 con 0x5573ae8850a0 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 10 client.25069 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5573aecdc400 con 0x5573ae8850a0 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f7186a00640 1 -- 172.21.15.1:0/85517275 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71880035f0 con 0x5573ae8850a0 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f7186a00640 1 -- 172.21.15.1:0/85517275 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f718800f4e0 con 0x5573ae8850a0 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 10 client.25069 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 10 client.25069 resolve_mds: resolved name 'g' to daemon mds.g 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 20 client.25069 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae841c90 0x5573aecdf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 4 client.25069 mds_command: new command op to 24673 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T20:17:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.327+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 --> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] -- command(tid 0: {"prefix": "status"}) -- 0x5573aebc7f40 con 0x5573ae841c90 2024-08-28T20:17:30.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.328+0000 7f718fe00640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae841c90 0x5573aecdf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:30.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.328+0000 7f718fe00640 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae841c90 0x5573aecdf600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15794fbcc8df1b50 server_cookie=d1b570b2f7219457 in_seq=0 out_seq=0 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.328+0000 7f7186a00640 10 client.25069 ms_handle_connect on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.328+0000 7f7186a00640 1 -- 172.21.15.1:0/85517275 <== mds.1 v2:172.21.15.1:6838/825690381 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5573aebc7f40 con 0x5573ae841c90 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.328+0000 7f7186a00640 10 client.25069 handle_command_reply: tid=0 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.328+0000 7f71a65e6740 1 client.25069 shutdown 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 msgr2=0x5573aec74ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec74ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7188005890 tx=0x7f7188004280 comp rx=0 tx=0).stop 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 shutdown_connections 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5573ae841c90 0x5573aecdf600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5573ae8adf60 0x5573aecdae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573ae88d280 0x5573aec75530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 --2- 172.21.15.1:0/85517275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5573ae8850a0 0x5573aec74ff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f7186a00640 0 client.25069 ms_handle_reset on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 >> 172.21.15.1:0/85517275 conn(0x5573ae8a2350 msgr2=0x5573aec4c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 shutdown_connections 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 1 -- 172.21.15.1:0/85517275 wait complete. 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.329+0000 7f71a65e6740 20 client.25069 trim_cache size 0 max 16384 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24673, 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-08-28T20:17:30.335 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 85.101490169000002, 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 76, 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 76, 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 116.70654136 2024-08-28T20:17:30.336 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f717c0b4bc0 msgr2=0x7f717c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f717c0b4bc0 0x7f717c0b70d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71900117b0 tx=0x7f7190009500 comp rx=0 tx=0).stop 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 msgr2=0x7f719819c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 0x7f719819c980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7180035040 tx=0x7f7180032d50 comp rx=0 tx=0).stop 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 shutdown_connections 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f717c0b4bc0 0x7f717c0b70d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7198109240 0x7f719819c980 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7198109b90 0x7f71981a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 --2- 172.21.15.1:0/504326882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7198103900 0x7f719819c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:30.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 >> 172.21.15.1:0/504326882 conn(0x7f719807b5f0 msgr2=0x7f7198107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:30.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 shutdown_connections 2024-08-28T20:17:30.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:30.330+0000 7f719fa00640 1 -- 172.21.15.1:0/504326882 wait complete. 2024-08-28T20:17:31.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-28T20:17:31.665 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:32.144 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:31 smithi001 ceph-mon[20984]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:31 smithi121 ceph-mon[25248]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:31 smithi007 ceph-mon[25357]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 -- 172.21.15.1:0/1649953363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 msgr2=0x7f31741103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 --2- 172.21.15.1:0/1649953363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f31741103c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f316c009ca0 tx=0x7f316c02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 -- 172.21.15.1:0/1649953363 shutdown_connections 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 --2- 172.21.15.1:0/1649953363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f31741103c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 --2- 172.21.15.1:0/1649953363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3174109240 0x7f3174109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 --2- 172.21.15.1:0/1649953363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f3174103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.322+0000 7f317a400640 1 -- 172.21.15.1:0/1649953363 >> 172.21.15.1:0/1649953363 conn(0x7f317407b5f0 msgr2=0x7f317407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:32.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.323+0000 7f317a400640 1 -- 172.21.15.1:0/1649953363 shutdown_connections 2024-08-28T20:17:32.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.323+0000 7f317a400640 1 -- 172.21.15.1:0/1649953363 wait complete. 2024-08-28T20:17:32.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 Processor -- start 2024-08-28T20:17:32.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 -- start start 2024-08-28T20:17:32.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f31740754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3174109240 0x7f31740759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f3174075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31741138a0 con 0x7f3174109b90 2024-08-28T20:17:32.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113720 con 0x7f3174109240 2024-08-28T20:17:32.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.324+0000 7f317a400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113a20 con 0x7f3174103900 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f3174075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f31740754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f31740754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37754/0 (socket says 172.21.15.1:37754) 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f3174075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48434/0 (socket says 172.21.15.1:48434) 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 -- 172.21.15.1:0/262666857 learned_addr learned my addr 172.21.15.1:0/262666857 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f316be00640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3174109240 0x7f31740759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 -- 172.21.15.1:0/262666857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3174109240 msgr2=0x7f31740759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3174109240 0x7f31740759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 -- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 msgr2=0x7f3174075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f3174075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 -- 172.21.15.1:0/262666857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a84b0 con 0x7f3174103900 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.325+0000 7f3173400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f31740754b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f316400e9f0 tx=0x7f316400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.326+0000 7f3170c00640 1 -- 172.21.15.1:0/262666857 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316400cd80 con 0x7f3174103900 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.326+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a87a0 con 0x7f3174103900 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.326+0000 7f3170c00640 1 -- 172.21.15.1:0/262666857 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31640054d0 con 0x7f3174103900 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.326+0000 7f3170c00640 1 -- 172.21.15.1:0/262666857 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164010690 con 0x7f3174103900 2024-08-28T20:17:32.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.326+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a8c90 con 0x7f3174103900 2024-08-28T20:17:32.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 Processor -- start 2024-08-28T20:17:32.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 -- start start 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e2648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e264e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de9e280 0x555b9e265370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555b9e1db550 con 0x555b9de960a0 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555b9e1caae0 con 0x555b9debef60 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.329+0000 7f3181064740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555b9e1cea90 con 0x555b9de9e280 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f3173e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e2648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f3173e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e2648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:36088/0 (socket says 172.21.15.1:36088) 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de9e280 0x555b9e265370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f3173e00640 1 -- 172.21.15.1:0/2128436817 learned_addr learned my addr 172.21.15.1:0/2128436817 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:32.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f3170c00640 1 -- 172.21.15.1:0/262666857 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f3164004e90 con 0x7f3174103900 2024-08-28T20:17:32.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 -- 172.21.15.1:0/2128436817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 msgr2=0x555b9e2648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e2648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 -- 172.21.15.1:0/2128436817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 msgr2=0x555b9e264e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e264e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 -- 172.21.15.1:0/2128436817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9df2a540 con 0x555b9de9e280 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f316be00640 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de9e280 0x555b9e265370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f317406c500 tx=0x7f315c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29d684cb5df7338a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.330+0000 7f3168c00640 1 -- 172.21.15.1:0/2128436817 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c004050 con 0x555b9de9e280 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3168c00640 1 -- 172.21.15.1:0/2128436817 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f315c0054d0 con 0x555b9de9e280 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3168c00640 1 -- 172.21.15.1:0/2128436817 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c004ba0 con 0x555b9de9e280 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 -- 172.21.15.1:0/2128436817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de9e280 msgr2=0x555b9e265370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de9e280 0x555b9e265370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f317406c500 tx=0x7f315c011810 comp rx=0 tx=0).stop 2024-08-28T20:17:32.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 -- 172.21.15.1:0/2128436817 shutdown_connections 2024-08-28T20:17:32.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e264e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de9e280 0x555b9e265370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 --2- 172.21.15.1:0/2128436817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e2648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.331+0000 7f3181064740 1 -- 172.21.15.1:0/2128436817 >> 172.21.15.1:0/2128436817 conn(0x555b9deb3350 msgr2=0x555b9e2627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.332+0000 7f3181064740 1 -- 172.21.15.1:0/2128436817 shutdown_connections 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.332+0000 7f3181064740 1 -- 172.21.15.1:0/2128436817 wait complete. 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.332+0000 7f3170c00640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31580b4ad0 0x7f31580b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.332+0000 7f3170c00640 1 -- 172.21.15.1:0/262666857 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f31640e5720 con 0x7f3174103900 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.332+0000 7f316be00640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31580b4ad0 0x7f31580b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.332+0000 7f3181064740 1 -- start start 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 Processor -- start 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f316be00640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31580b4ad0 0x7f31580b6fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f315c0057c0 tx=0x7f315c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:32.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e2700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e2705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9debef60 0x555b9e27c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555b9e02d5f0 con 0x555b9de960a0 2024-08-28T20:17:32.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555b9e151bd0 con 0x555b9de9e280 2024-08-28T20:17:32.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555b9e2730d0 con 0x555b9debef60 2024-08-28T20:17:32.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3181064740 10 client.0 _ll_register_callbacks cb 0x555b9e177210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.333+0000 7f3173400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e2700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e2700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48450/0 (socket says 172.21.15.1:48450) 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 -- 172.21.15.1:0/697938112 learned_addr learned my addr 172.21.15.1:0/697938112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173e00640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9debef60 0x555b9e27c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f316be00640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e2705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 -- 172.21.15.1:0/697938112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9debef60 msgr2=0x555b9e27c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9debef60 0x555b9e27c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 -- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 msgr2=0x555b9e2705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e2705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 -- 172.21.15.1:0/697938112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9e192650 con 0x555b9de960a0 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3173400640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e2700a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31640e30f0 tx=0x7f31640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d222015826a905 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:32.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3161600640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.334+0000 7f3161600640 1 -- 172.21.15.1:0/697938112 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640abfe0 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3161600640 1 -- 172.21.15.1:0/697938112 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f31640b4e70 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f315c0054d0 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3161600640 1 -- 172.21.15.1:0/697938112 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f31640b0850 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3181064740 10 client.15057 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555b9e27eeb0 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3161600640 1 -- 172.21.15.1:0/697938112 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f315c0054d0 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3161600640 1 -- 172.21.15.1:0/697938112 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f31640b0430 con 0x555b9de960a0 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3181064740 10 client.15057 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3181064740 10 client.15057 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.335+0000 7f3181064740 20 client.15057 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.336+0000 7f3181064740 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de7d8e0 0x555b9e2828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.336+0000 7f3181064740 4 client.15057 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:17:32.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.336+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b9e1dd4a0 con 0x555b9de7d8e0 2024-08-28T20:17:32.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.336+0000 7f316be00640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de7d8e0 0x555b9e2828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.337+0000 7f316be00640 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de7d8e0 0x555b9e2828d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0a20f5adcb77836 server_cookie=bc1aaad60523b1ff in_seq=0 out_seq=0 2024-08-28T20:17:32.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.337+0000 7f3161600640 10 client.15057 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.337+0000 7f3161600640 1 -- 172.21.15.1:0/697938112 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b9e1dd4a0 con 0x555b9de7d8e0 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.337+0000 7f3161600640 10 client.15057 handle_command_reply: tid=0 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.337+0000 7f3181064740 1 client.15057 shutdown 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 msgr2=0x555b9e2700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e2700a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31640e30f0 tx=0x7f31640048f0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 shutdown_connections 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de7d8e0 0x555b9e2828d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9debef60 0x555b9e27c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e2705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 --2- 172.21.15.1:0/697938112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de960a0 0x555b9e2700a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3161600640 0 client.15057 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:32.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 >> 172.21.15.1:0/697938112 conn(0x555b9deb3350 msgr2=0x555b9e267a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:32.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 shutdown_connections 2024-08-28T20:17:32.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 1 -- 172.21.15.1:0/697938112 wait complete. 2024-08-28T20:17:32.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.338+0000 7f3181064740 20 client.15057 trim_cache size 0 max 16384 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 Processor -- start 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 -- start start 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e262850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e27c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 0x555b9e2679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555b9e280c10 con 0x555b9debef60 2024-08-28T20:17:32.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555b9e2812e0 con 0x555b9de9e280 2024-08-28T20:17:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.357+0000 7f3181064740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555b9e2819b0 con 0x555b9de960a0 2024-08-28T20:17:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 0x555b9e2679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e262850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 0x555b9e2679f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48458/0 (socket says 172.21.15.1:48458) 2024-08-28T20:17:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 -- 172.21.15.1:0/883643737 learned_addr learned my addr 172.21.15.1:0/883643737 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:32.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f316be00640 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e27c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 -- 172.21.15.1:0/883643737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 msgr2=0x555b9e262850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e262850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 -- 172.21.15.1:0/883643737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 msgr2=0x555b9e27c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e27c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.358+0000 7f3173e00640 1 -- 172.21.15.1:0/883643737 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9e271360 con 0x555b9debef60 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.359+0000 7f3173e00640 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 0x555b9e2679f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f316c035000 tx=0x7f316c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1121edb95074f759 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.359+0000 7f3163e00640 1 -- 172.21.15.1:0/883643737 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c031cf0 con 0x555b9debef60 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.359+0000 7f3163e00640 1 -- 172.21.15.1:0/883643737 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c036070 con 0x555b9debef60 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.359+0000 7f3163e00640 1 -- 172.21.15.1:0/883643737 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c0042a0 con 0x555b9debef60 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 -- 172.21.15.1:0/883643737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 msgr2=0x555b9e2679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 0x555b9e2679f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f316c035000 tx=0x7f316c005d80 comp rx=0 tx=0).stop 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 -- 172.21.15.1:0/883643737 shutdown_connections 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9debef60 0x555b9e2679f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9de9e280 0x555b9e27c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 --2- 172.21.15.1:0/883643737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e262850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 -- 172.21.15.1:0/883643737 >> 172.21.15.1:0/883643737 conn(0x555b9deb3350 msgr2=0x555b9e262140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 -- 172.21.15.1:0/883643737 shutdown_connections 2024-08-28T20:17:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 -- 172.21.15.1:0/883643737 wait complete. 2024-08-28T20:17:32.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.360+0000 7f3181064740 1 -- start start 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 Processor -- start 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e284f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 0x555b9e285550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e28a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555b9e282750 con 0x555b9de9e280 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555b9e282080 con 0x555b9debef60 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555b9e282e20 con 0x555b9de960a0 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3181064740 10 client.0 _ll_register_callbacks cb 0x7f31640ab930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f316be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 0x555b9e285550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f316be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 0x555b9e285550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48466/0 (socket says 172.21.15.1:48466) 2024-08-28T20:17:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f316be00640 1 -- 172.21.15.1:0/2245097479 learned_addr learned my addr 172.21.15.1:0/2245097479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3173400640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e284f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.361+0000 7f3173e00640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e28a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f316be00640 1 -- 172.21.15.1:0/2245097479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 msgr2=0x555b9e284f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f316be00640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e284f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f316be00640 1 -- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 msgr2=0x555b9e28a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f316be00640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e28a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f316be00640 1 -- 172.21.15.1:0/2245097479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9e28ac60 con 0x555b9de9e280 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f316be00640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 0x555b9e285550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f315c009730 tx=0x7f315c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf44f0859140689 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f3161600640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f3161600640 1 -- 172.21.15.1:0/2245097479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c01d040 con 0x555b9de9e280 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f3161600640 1 -- 172.21.15.1:0/2245097479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f315c019630 con 0x555b9de9e280 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.362+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f316c036070 con 0x555b9de9e280 2024-08-28T20:17:32.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3161600640 1 -- 172.21.15.1:0/2245097479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f315c048050 con 0x555b9de9e280 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 10 client.15063 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555b9e2ee480 con 0x555b9de9e280 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3161600640 1 -- 172.21.15.1:0/2245097479 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c036070 con 0x555b9de9e280 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3161600640 1 -- 172.21.15.1:0/2245097479 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f315c031700 con 0x555b9de9e280 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 10 client.15063 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 10 client.15063 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 20 client.15063 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de52c90 0x555b9e2f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 4 client.15063 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.363+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "status"}) -- 0x555b9e1d8f40 con 0x555b9de52c90 2024-08-28T20:17:32.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.364+0000 7f3173400640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de52c90 0x555b9e2f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:32.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.364+0000 7f3173400640 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de52c90 0x555b9e2f1ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a68f4087752c18 server_cookie=cd5d370b101fed52 in_seq=0 out_seq=0 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.364+0000 7f3161600640 10 client.15063 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3161600640 1 -- 172.21.15.1:0/2245097479 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555b9e1d8f40 con 0x555b9de52c90 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3161600640 10 client.15063 handle_command_reply: tid=0 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 client.15063 shutdown 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 msgr2=0x555b9e285550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 0x555b9e285550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f315c009730 tx=0x7f315c023000 comp rx=0 tx=0).stop 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 shutdown_connections 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555b9de52c90 0x555b9e2f1ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555b9de9e280 0x555b9e285550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555b9debef60 0x555b9e28a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 --2- 172.21.15.1:0/2245097479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b9de960a0 0x555b9e284f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 >> 172.21.15.1:0/2245097479 conn(0x555b9deb3350 msgr2=0x555b9e26fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:32.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3161600640 0 client.15063 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 shutdown_connections 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 1 -- 172.21.15.1:0/2245097479 wait complete. 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.365+0000 7f3181064740 20 client.15063 trim_cache size 0 max 16384 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24701, 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-08-28T20:17:32.371 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 97.295675736999996, 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 76, 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 76, 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 112.007252166 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:17:32.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31580b4ad0 msgr2=0x7f31580b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31580b4ad0 0x7f31580b6fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f315c0057c0 tx=0x7f315c009680 comp rx=0 tx=0).stop 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 msgr2=0x7f31740754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f31740754b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f316400e9f0 tx=0x7f316400edf0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 shutdown_connections 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f31580b4ad0 0x7f31580b6fe0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3174109b90 0x7f3174075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3174109240 0x7f31740759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 --2- 172.21.15.1:0/262666857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103900 0x7f31740754b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 >> 172.21.15.1:0/262666857 conn(0x7f317407b5f0 msgr2=0x7f31741051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 shutdown_connections 2024-08-28T20:17:32.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:32.366+0000 7f317a400640 1 -- 172.21.15.1:0/262666857 wait complete. 2024-08-28T20:17:33.425 INFO:tasks.cephadm:Setup complete, yielding 2024-08-28T20:17:33.425 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-28T20:17:33.434 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:17:33.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-28T20:17:33.816 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:34.137 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:33 smithi001 ceph-mon[20984]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:33 smithi121 ceph-mon[25248]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:33 smithi007 ceph-mon[25357]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:17:34.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 -- 172.21.15.1:0/4182580131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 msgr2=0x7f68741059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 --2- 172.21.15.1:0/4182580131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f68741059a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6864009900 tx=0x7f686402a480 comp rx=0 tx=0).stop 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 -- 172.21.15.1:0/4182580131 shutdown_connections 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 --2- 172.21.15.1:0/4182580131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6874106f60 0x7f687410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 --2- 172.21.15.1:0/4182580131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68741065c0 0x7f68741069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 --2- 172.21.15.1:0/4182580131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f68741059a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 -- 172.21.15.1:0/4182580131 >> 172.21.15.1:0/4182580131 conn(0x7f6874100ea0 msgr2=0x7f6874103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 -- 172.21.15.1:0/4182580131 shutdown_connections 2024-08-28T20:17:34.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.581+0000 7f6873200640 1 -- 172.21.15.1:0/4182580131 wait complete. 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 Processor -- start 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 -- start start 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f687419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68741065c0 0x7f687419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6874106f60 0x7f687419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6874111180 con 0x7f6874105530 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6874111000 con 0x7f68741065c0 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.582+0000 7f6873200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6874111300 con 0x7f6874106f60 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f687419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:34.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f687419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48486/0 (socket says 172.21.15.1:48486) 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6872800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6874106f60 0x7f687419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 -- 172.21.15.1:0/265478466 learned_addr learned my addr 172.21.15.1:0/265478466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f686be00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68741065c0 0x7f687419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 -- 172.21.15.1:0/265478466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6874106f60 msgr2=0x7f687419cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6874106f60 0x7f687419cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 -- 172.21.15.1:0/265478466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68741065c0 msgr2=0x7f687419c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68741065c0 0x7f687419c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6871e00640 1 -- 172.21.15.1:0/265478466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687419d810 con 0x7f6874105530 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f6872800640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6874106f60 0x7f687419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.583+0000 7f686be00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68741065c0 0x7f687419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.584+0000 7f6871e00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f687419bde0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6864006010 tx=0x7f68640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:34.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.584+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686403f030 con 0x7f6874105530 2024-08-28T20:17:34.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.584+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6864031910 con 0x7f6874105530 2024-08-28T20:17:34.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.584+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687419daa0 con 0x7f6874105530 2024-08-28T20:17:34.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.584+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864035070 con 0x7f6874105530 2024-08-28T20:17:34.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.584+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68741a4030 con 0x7f6874105530 2024-08-28T20:17:34.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.585+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f687410c710 con 0x7f6874105530 2024-08-28T20:17:34.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.589+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f6864042030 con 0x7f6874105530 2024-08-28T20:17:34.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.591+0000 7f686aa00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68580b4bc0 0x7f68580b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:34.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.591+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f6864105e80 con 0x7f6874105530 2024-08-28T20:17:34.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.591+0000 7f686be00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68580b4bc0 0x7f68580b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:34.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.591+0000 7f686be00640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68580b4bc0 0x7f68580b70d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f685c009fc0 tx=0x7f685c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:34.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.593+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f68640cc790 con 0x7f6874105530 2024-08-28T20:17:34.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.806+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f68740635a0 con 0x7f68580b4bc0 2024-08-28T20:17:34.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.807+0000 7f686aa00640 1 -- 172.21.15.1:0/265478466 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f68740635a0 con 0x7f68580b4bc0 2024-08-28T20:17:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-08-28T20:17:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-08-28T20:17:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68580b4bc0 msgr2=0x7f68580b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68580b4bc0 0x7f68580b70d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f685c009fc0 tx=0x7f685c005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 msgr2=0x7f687419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f687419bde0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6864006010 tx=0x7f68640042f0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 shutdown_connections 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f68580b4bc0 0x7f68580b70d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6874106f60 0x7f687419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68741065c0 0x7f687419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 --2- 172.21.15.1:0/265478466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874105530 0x7f687419bde0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 >> 172.21.15.1:0/265478466 conn(0x7f6874100ea0 msgr2=0x7f68741098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 shutdown_connections 2024-08-28T20:17:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:34.809+0000 7f6873200640 1 -- 172.21.15.1:0/265478466 wait complete. 2024-08-28T20:17:35.655 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-28T20:17:36.041 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:36.179 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:35 smithi001 ceph-mon[20984]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:36.179 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:35 smithi001 ceph-mon[20984]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:35 smithi121 ceph-mon[25248]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:35 smithi121 ceph-mon[25248]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:35 smithi007 ceph-mon[25357]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:17:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:35 smithi007 ceph-mon[25357]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:36.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 -- 172.21.15.1:0/2146744697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428105530 msgr2=0x7f84281059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 --2- 172.21.15.1:0/2146744697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428105530 0x7f84281059a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8418009900 tx=0x7f841802a480 comp rx=0 tx=0).stop 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 -- 172.21.15.1:0/2146744697 shutdown_connections 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 --2- 172.21.15.1:0/2146744697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 0x7f842810d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 --2- 172.21.15.1:0/2146744697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84281065c0 0x7f84281069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 --2- 172.21.15.1:0/2146744697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428105530 0x7f84281059a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 -- 172.21.15.1:0/2146744697 >> 172.21.15.1:0/2146744697 conn(0x7f8428100ea0 msgr2=0x7f8428103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 -- 172.21.15.1:0/2146744697 shutdown_connections 2024-08-28T20:17:36.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.671+0000 7f8427200640 1 -- 172.21.15.1:0/2146744697 wait complete. 2024-08-28T20:17:36.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 Processor -- start 2024-08-28T20:17:36.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 -- start start 2024-08-28T20:17:36.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8428105530 0x7f842819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:36.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84281065c0 0x7f842819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 0x7f842819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84281111d0 con 0x7f84281065c0 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8428111050 con 0x7f8428105530 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8427200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8428111350 con 0x7f8428106f60 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8425400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84281065c0 0x7f842819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.672+0000 7f8426800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 0x7f842819cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8425400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84281065c0 0x7f842819c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48514/0 (socket says 172.21.15.1:48514) 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8425400640 1 -- 172.21.15.1:0/2534778061 learned_addr learned my addr 172.21.15.1:0/2534778061 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8425e00640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8428105530 0x7f842819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8426800640 1 -- 172.21.15.1:0/2534778061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8428105530 msgr2=0x7f842819bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8426800640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8428105530 0x7f842819bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8426800640 1 -- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84281065c0 msgr2=0x7f842819c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:36.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8426800640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84281065c0 0x7f842819c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8426800640 1 -- 172.21.15.1:0/2534778061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842819d7f0 con 0x7f8428106f60 2024-08-28T20:17:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.673+0000 7f8426800640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 0x7f842819cfd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8420009fd0 tx=0x7f842000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.674+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000ce20 con 0x7f8428106f60 2024-08-28T20:17:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.674+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842819dae0 con 0x7f8428106f60 2024-08-28T20:17:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.674+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84281a41e0 con 0x7f8428106f60 2024-08-28T20:17:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.674+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8420010430 con 0x7f8428106f60 2024-08-28T20:17:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.674+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000f620 con 0x7f8428106f60 2024-08-28T20:17:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.675+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84080052c0 con 0x7f8428106f60 2024-08-28T20:17:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.678+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f8420004a40 con 0x7f8428106f60 2024-08-28T20:17:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.679+0000 7f841ea00640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f840c0b4c40 0x7f840c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.679+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f84200e5940 con 0x7f8428106f60 2024-08-28T20:17:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.679+0000 7f8425e00640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f840c0b4c40 0x7f840c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:36.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.680+0000 7f8425e00640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f840c0b4c40 0x7f840c0b7150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8418004770 tx=0x7f84180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:36.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.681+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f84200ac8a0 con 0x7f8428106f60 2024-08-28T20:17:36.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.887+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8408000bf0 con 0x7f840c0b4c40 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.900+0000 7f841ea00640 1 -- 172.21.15.1:0/2534778061 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f8408000bf0 con 0x7f840c0b4c40 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (119s) 23s ago 119s 80.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 d5e24778eeee 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi007 running (116s) 47s ago 116s 93.1M - 19.3.0-4560-gd19e6118 79f4cde5e369 82c9b2cc7275 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi121 running (2m) 47s ago 2m 86.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 d0d7bb423f76 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (2m) 23s ago 2m 80.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 a77034e07edd 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi007 running (2m) 47s ago 2m 81.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 03c9553a31e9 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi121 running (2m) 47s ago 2m 86.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 f44e044acf3e 2024-08-28T20:17:36.903 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (2m) 23s ago 2m 84.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 890e06dc62ac 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi007 running (2m) 47s ago 2m 87.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 e8d292d41c0a 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi121 running (2m) 47s ago 2m 88.1M - 19.3.0-4560-gd19e6118 79f4cde5e369 63312ff05b75 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (2m) 23s ago 2m 80.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 2b418594d4b1 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi007 running (2m) 47s ago 2m 82.0M - 19.3.0-4560-gd19e6118 79f4cde5e369 845cb1f731c4 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi121 running (2m) 47s ago 2m 81.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 f3f7312b5c50 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (10m) 23s ago 10m 590M - 19.3.0-4560-gd19e6118 79f4cde5e369 05838921b52c 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi007 *:8443,8765 running (8m) 47s ago 8m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 afb5a5926749 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi121 *:8443,8765 running (8m) 47s ago 8m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 c2c58cce5686 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (10m) 23s ago 10m 116M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 e8a1e11853d3 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi007 running (8m) 47s ago 8m 111M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 ac8898ed341a 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi121 running (8m) 47s ago 8m 116M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 eaf4fc6c2799 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (7m) 23s ago 7m 114M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 ca444131b08d 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi007 running (7m) 47s ago 7m 115M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 9cbd9ed9d38d 2024-08-28T20:17:36.904 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi121 running (6m) 47s ago 6m 127M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 3aa5208f2d78 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (6m) 23s ago 6m 119M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 56b3a0cb4c8b 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi007 running (5m) 47s ago 5m 120M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 26c6d8e3a925 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi121 running (5m) 47s ago 5m 113M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 813b4da93a07 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (4m) 23s ago 4m 115M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 8458efcef957 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi007 running (4m) 47s ago 4m 121M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 d4b3933e0449 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi121 running (4m) 47s ago 4m 112M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 73fc6c2e40af 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 23s ago 3m 110M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 cb906268744c 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi007 running (3m) 47s ago 3m 114M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 ab57f51104bd 2024-08-28T20:17:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi121 running (2m) 47s ago 2m 115M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 734dd2a67f87 2024-08-28T20:17:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f840c0b4c40 msgr2=0x7f840c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f840c0b4c40 0x7f840c0b7150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8418004770 tx=0x7f84180314a0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 msgr2=0x7f842819cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 0x7f842819cfd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8420009fd0 tx=0x7f842000ef10 comp rx=0 tx=0).stop 2024-08-28T20:17:36.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 shutdown_connections 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f840c0b4c40 0x7f840c0b7150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84281065c0 0x7f842819c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8428106f60 0x7f842819cfd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 --2- 172.21.15.1:0/2534778061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8428105530 0x7f842819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 >> 172.21.15.1:0/2534778061 conn(0x7f8428100ea0 msgr2=0x7f84281098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.903+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 shutdown_connections 2024-08-28T20:17:36.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:36.904+0000 7f8427200640 1 -- 172.21.15.1:0/2534778061 wait complete. 2024-08-28T20:17:37.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-28T20:17:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:37 smithi001 ceph-mon[20984]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:37 smithi001 ceph-mon[20984]: from='client.25099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:38.094 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:37 smithi121 ceph-mon[25248]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:38.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:37 smithi121 ceph-mon[25248]: from='client.25099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:37 smithi007 ceph-mon[25357]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:17:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:37 smithi007 ceph-mon[25357]: from='client.25099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:38.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.753+0000 7f13ea400640 1 -- 172.21.15.1:0/3066595480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e41067b0 msgr2=0x7f13e4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:38.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.753+0000 7f13ea400640 1 --2- 172.21.15.1:0/3066595480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e41067b0 0x7f13e4106bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009900 tx=0x7f13d002a480 comp rx=0 tx=0).stop 2024-08-28T20:17:38.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.754+0000 7f13ea400640 1 -- 172.21.15.1:0/3066595480 shutdown_connections 2024-08-28T20:17:38.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.754+0000 7f13ea400640 1 --2- 172.21.15.1:0/3066595480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e41067b0 0x7f13e4106bc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.754+0000 7f13ea400640 1 --2- 172.21.15.1:0/3066595480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e4107150 0x7f13e410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.754+0000 7f13ea400640 1 --2- 172.21.15.1:0/3066595480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13e4105720 0x7f13e4105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.754+0000 7f13ea400640 1 -- 172.21.15.1:0/3066595480 >> 172.21.15.1:0/3066595480 conn(0x7f13e4101090 msgr2=0x7f13e4103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:38.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.754+0000 7f13ea400640 1 -- 172.21.15.1:0/3066595480 shutdown_connections 2024-08-28T20:17:38.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.755+0000 7f13ea400640 1 -- 172.21.15.1:0/3066595480 wait complete. 2024-08-28T20:17:38.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 Processor -- start 2024-08-28T20:17:38.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 -- start start 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 0x7f13e419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e41067b0 0x7f13e419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13e4107150 0x7f13e419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4111370 con 0x7f13e4105720 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41111f0 con 0x7f13e41067b0 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.756+0000 7f13ea400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41114f0 con 0x7f13e4107150 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 0x7f13e419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:38.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 0x7f13e419c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59118/0 (socket says 172.21.15.1:59118) 2024-08-28T20:17:38.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 -- 172.21.15.1:0/3093271114 learned_addr learned my addr 172.21.15.1:0/3093271114 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:38.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e2a00640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e41067b0 0x7f13e419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:38.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3e00640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13e4107150 0x7f13e419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:38.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 -- 172.21.15.1:0/3093271114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13e4107150 msgr2=0x7f13e419d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13e4107150 0x7f13e419d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 -- 172.21.15.1:0/3093271114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e41067b0 msgr2=0x7f13e419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e41067b0 0x7f13e419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 -- 172.21.15.1:0/3093271114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e419da50 con 0x7f13e4105720 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.757+0000 7f13e3400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 0x7f13e419c020 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13d400e9f0 tx=0x7f13d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.758+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d400cd80 con 0x7f13e4105720 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.758+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d40054d0 con 0x7f13e4105720 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.758+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4010690 con 0x7f13e4105720 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.758+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e419dd40 con 0x7f13e4105720 2024-08-28T20:17:38.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.758+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a4440 con 0x7f13e4105720 2024-08-28T20:17:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.759+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e410c900 con 0x7f13e4105720 2024-08-28T20:17:38.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.763+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7f13d4004e50 con 0x7f13e4105720 2024-08-28T20:17:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.765+0000 7f13dbe00640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f13c80b4bc0 0x7f13c80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.765+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f13d40e5970 con 0x7f13e4105720 2024-08-28T20:17:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.765+0000 7f13e2a00640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f13c80b4bc0 0x7f13c80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:38.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.766+0000 7f13e2a00640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f13c80b4bc0 0x7f13c80b70d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13d0000c00 tx=0x7f13d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.767+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13d40ac8d0 con 0x7f13e4105720 2024-08-28T20:17:38.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.972+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f13e40635a0 con 0x7f13c80b4bc0 2024-08-28T20:17:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.979+0000 7f13dbe00640 1 -- 172.21.15.1:0/3093271114 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f13e40635a0 con 0x7f13c80b4bc0 2024-08-28T20:17:38.981 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-28T20:17:38.981 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 49s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi007=b;smithi007=e;smithi007=h;smithi007=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-08-28T20:17:38.982 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 49s ago 8m smithi001=x;smithi007=y;smithi121=z;count:3 2024-08-28T20:17:38.982 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 49s ago 8m smithi001:172.21.15.1=a;smithi007:172.21.15.7=b;smithi121:172.21.15.121=c;count:3 2024-08-28T20:17:38.982 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 49s ago - 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f13c80b4bc0 msgr2=0x7f13c80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f13c80b4bc0 0x7f13c80b70d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13d0000c00 tx=0x7f13d0031400 comp rx=0 tx=0).stop 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 msgr2=0x7f13e419c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 0x7f13e419c020 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13d400e9f0 tx=0x7f13d400edf0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 shutdown_connections 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f13c80b4bc0 0x7f13c80b70d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13e4107150 0x7f13e419d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13e41067b0 0x7f13e419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 --2- 172.21.15.1:0/3093271114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e4105720 0x7f13e419c020 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 >> 172.21.15.1:0/3093271114 conn(0x7f13e4101090 msgr2=0x7f13e4109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:38.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 shutdown_connections 2024-08-28T20:17:38.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:38.981+0000 7f13ea400640 1 -- 172.21.15.1:0/3093271114 wait complete. 2024-08-28T20:17:39.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-28T20:17:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:39 smithi001 ceph-mon[20984]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:39 smithi121 ceph-mon[25248]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:40.238 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:39 smithi007 ceph-mon[25357]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.817+0000 7fb91d600640 1 -- 172.21.15.1:0/265738319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104f20 msgr2=0x7fb91810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.817+0000 7fb91d600640 1 --2- 172.21.15.1:0/265738319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104f20 0x7fb91810b8c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb910009ca0 tx=0x7fb91002a950 comp rx=0 tx=0).stop 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 -- 172.21.15.1:0/265738319 shutdown_connections 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 --2- 172.21.15.1:0/265738319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104f20 0x7fb91810b8c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 --2- 172.21.15.1:0/265738319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb918104580 0x7fb918104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 --2- 172.21.15.1:0/265738319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9181034f0 0x7fb918103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 -- 172.21.15.1:0/265738319 >> 172.21.15.1:0/265738319 conn(0x7fb9180fee60 msgr2=0x7fb918101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:40.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 -- 172.21.15.1:0/265738319 shutdown_connections 2024-08-28T20:17:40.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.818+0000 7fb91d600640 1 -- 172.21.15.1:0/265738319 wait complete. 2024-08-28T20:17:40.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.819+0000 7fb91d600640 1 Processor -- start 2024-08-28T20:17:40.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.819+0000 7fb91d600640 1 -- start start 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb91d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 0x7fb91819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb91d600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104580 0x7fb91819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb91d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104f20 0x7fb91819d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb91d600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810f130 con 0x7fb918104580 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb91d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810efb0 con 0x7fb918104f20 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb91d600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810f2b0 con 0x7fb9181034f0 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb90e000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104580 0x7fb91819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb916a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 0x7fb91819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb917400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104f20 0x7fb91819d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb916a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 0x7fb91819bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47888/0 (socket says 172.21.15.1:47888) 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.820+0000 7fb916a00640 1 -- 172.21.15.1:0/1914654203 learned_addr learned my addr 172.21.15.1:0/1914654203 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb916a00640 1 -- 172.21.15.1:0/1914654203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104f20 msgr2=0x7fb91819d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb916a00640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104f20 0x7fb91819d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb916a00640 1 -- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104580 msgr2=0x7fb91819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb916a00640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104580 0x7fb91819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb916a00640 1 -- 172.21.15.1:0/1914654203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91819d940 con 0x7fb9181034f0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb916a00640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 0x7fb91819bf10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb90800e9f0 tx=0x7fb90800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90800cd80 con 0x7fb9181034f0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9080108e0 con 0x7fb9181034f0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908018980 con 0x7fb9181034f0 2024-08-28T20:17:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91819dc30 con 0x7fb9181034f0 2024-08-28T20:17:40.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.821+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9181a4330 con 0x7fb9181034f0 2024-08-28T20:17:40.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.822+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb918103960 con 0x7fb9181034f0 2024-08-28T20:17:40.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.825+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 152627+0+0 (secure 0 0 0) 0x7fb908010430 con 0x7fb9181034f0 2024-08-28T20:17:40.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.826+0000 7fb90fe00640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb8fc0b4bc0 0x7fb8fc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:40.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.827+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb9080e5b20 con 0x7fb9181034f0 2024-08-28T20:17:40.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.827+0000 7fb90e000640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb8fc0b4bc0 0x7fb8fc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:40.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.827+0000 7fb90e000640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb8fc0b4bc0 0x7fb8fc0b70d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb900009bd0 tx=0x7fb900005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:40.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.828+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb9080ac430 con 0x7fb9181034f0 2024-08-28T20:17:40.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:40.904+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fb9080a86c0 con 0x7fb9181034f0 2024-08-28T20:17:41.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.038+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb918076ab0 con 0x7fb8fc0b4bc0 2024-08-28T20:17:41.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.040+0000 7fb90fe00640 1 -- 172.21.15.1:0/1914654203 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fb918076ab0 con 0x7fb8fc0b4bc0 2024-08-28T20:17:41.042 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-08-28T20:17:41.042 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-08-28T20:17:41.042 INFO:teuthology.orchestra.run.smithi001.stdout:smithi007 172.21.15.7 2024-08-28T20:17:41.043 INFO:teuthology.orchestra.run.smithi001.stdout:smithi121 172.21.15.121 2024-08-28T20:17:41.043 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-08-28T20:17:41.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb8fc0b4bc0 msgr2=0x7fb8fc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb8fc0b4bc0 0x7fb8fc0b70d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb900009bd0 tx=0x7fb900005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 msgr2=0x7fb91819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 0x7fb91819bf10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb90800e9f0 tx=0x7fb90800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 shutdown_connections 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb8fc0b4bc0 0x7fb8fc0b70d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb918104580 0x7fb91819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104f20 0x7fb91819d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 --2- 172.21.15.1:0/1914654203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9181034f0 0x7fb91819bf10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 >> 172.21.15.1:0/1914654203 conn(0x7fb9180fee60 msgr2=0x7fb918075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 shutdown_connections 2024-08-28T20:17:41.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:41.042+0000 7fb91d600640 1 -- 172.21.15.1:0/1914654203 wait complete. 2024-08-28T20:17:41.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:40 smithi001 ceph-mon[20984]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:41.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:40 smithi121 ceph-mon[25248]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:41.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:40 smithi007 ceph-mon[25357]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:41.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-28T20:17:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:41 smithi001 ceph-mon[20984]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-28T20:17:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:41 smithi001 ceph-mon[20984]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-28T20:17:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:41 smithi121 ceph-mon[25248]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-28T20:17:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:41 smithi121 ceph-mon[25248]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-28T20:17:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:42.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:41 smithi007 ceph-mon[25357]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-28T20:17:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:41 smithi007 ceph-mon[25357]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-28T20:17:42.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.879+0000 7f10c3200640 1 -- 172.21.15.1:0/1632770043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc105530 msgr2=0x7f10bc1059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:42.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.879+0000 7f10c3200640 1 --2- 172.21.15.1:0/1632770043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc105530 0x7f10bc1059a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009900 tx=0x7f10b002a480 comp rx=0 tx=0).stop 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 -- 172.21.15.1:0/1632770043 shutdown_connections 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 --2- 172.21.15.1:0/1632770043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc106f60 0x7f10bc10d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 --2- 172.21.15.1:0/1632770043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10bc1065c0 0x7f10bc1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 --2- 172.21.15.1:0/1632770043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc105530 0x7f10bc1059a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 -- 172.21.15.1:0/1632770043 >> 172.21.15.1:0/1632770043 conn(0x7f10bc100e80 msgr2=0x7f10bc103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 -- 172.21.15.1:0/1632770043 shutdown_connections 2024-08-28T20:17:42.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.880+0000 7f10c3200640 1 -- 172.21.15.1:0/1632770043 wait complete. 2024-08-28T20:17:42.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 Processor -- start 2024-08-28T20:17:42.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 -- start start 2024-08-28T20:17:42.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10bc105530 0x7f10bc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:42.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc1065c0 0x7f10bc19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:42.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 0x7f10bc19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:42.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1111d0 con 0x7f10bc106f60 2024-08-28T20:17:42.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc111050 con 0x7f10bc105530 2024-08-28T20:17:42.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc111350 con 0x7f10bc1065c0 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 0x7f10bc19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.882+0000 7f10c1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc1065c0 0x7f10bc19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 0x7f10bc19cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59148/0 (socket says 172.21.15.1:59148) 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c2800640 1 -- 172.21.15.1:0/1788722350 learned_addr learned my addr 172.21.15.1:0/1788722350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1e00640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10bc105530 0x7f10bc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1400640 1 -- 172.21.15.1:0/1788722350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10bc105530 msgr2=0x7f10bc19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1400640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10bc105530 0x7f10bc19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1400640 1 -- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 msgr2=0x7f10bc19cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1400640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 0x7f10bc19cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1400640 1 -- 172.21.15.1:0/1788722350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc19d7a0 con 0x7f10bc1065c0 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c2800640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 0x7f10bc19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:42.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.883+0000 7f10c1400640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc1065c0 0x7f10bc19c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005fd0 tx=0x7f10ac00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:42.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.884+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac009c30 con 0x7f10bc1065c0 2024-08-28T20:17:42.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.884+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10ac009dd0 con 0x7f10bc1065c0 2024-08-28T20:17:42.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.884+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10bc19da90 con 0x7f10bc1065c0 2024-08-28T20:17:42.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.884+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac010460 con 0x7f10bc1065c0 2024-08-28T20:17:42.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.884+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10bc1a4190 con 0x7f10bc1065c0 2024-08-28T20:17:42.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.885+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10bc1059a0 con 0x7f10bc1065c0 2024-08-28T20:17:42.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.887+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f10ac003e80 con 0x7f10bc1065c0 2024-08-28T20:17:42.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.889+0000 7f10b6a00640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10a40b4b30 0x7f10a40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:42.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.889+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f10ac0e50b0 con 0x7f10bc1065c0 2024-08-28T20:17:42.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.889+0000 7f10c1e00640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10a40b4b30 0x7f10a40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:42.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.890+0000 7f10c1e00640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10a40b4b30 0x7f10a40b7040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10b0004770 tx=0x7f10b00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:42.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:42.890+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f10ac017020 con 0x7f10bc1065c0 2024-08-28T20:17:42.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:42 smithi001 ceph-mon[20984]: from='client.25111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.096+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 --> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f10bc02e810 con 0x7f10a40b4b30 2024-08-28T20:17:43.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.098+0000 7f10b6a00640 1 -- 172.21.15.1:0/1788722350 <== mgr.14150 v2:172.21.15.1:6800/25450820 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f10bc02e810 con 0x7f10a40b4b30 2024-08-28T20:17:43.100 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-28T20:17:43.100 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-28T20:17:43.100 INFO:teuthology.orchestra.run.smithi001.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-28T20:17:43.100 INFO:teuthology.orchestra.run.smithi001.stdout:smithi121 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-28T20:17:43.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.100+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10a40b4b30 msgr2=0x7f10a40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:43.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.100+0000 7f10c3200640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10a40b4b30 0x7f10a40b7040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10b0004770 tx=0x7f10b00314a0 comp rx=0 tx=0).stop 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc1065c0 msgr2=0x7f10bc19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc1065c0 0x7f10bc19c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005fd0 tx=0x7f10ac00dde0 comp rx=0 tx=0).stop 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 shutdown_connections 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f10a40b4b30 0x7f10a40b7040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10bc106f60 0x7f10bc19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10bc1065c0 0x7f10bc19c3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 --2- 172.21.15.1:0/1788722350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10bc105530 0x7f10bc19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 >> 172.21.15.1:0/1788722350 conn(0x7f10bc100e80 msgr2=0x7f10bc1098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 shutdown_connections 2024-08-28T20:17:43.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:43.101+0000 7f10c3200640 1 -- 172.21.15.1:0/1788722350 wait complete. 2024-08-28T20:17:43.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:42 smithi121 ceph-mon[25248]: from='client.25111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:43.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:42 smithi007 ceph-mon[25357]: from='client.25111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:43.987 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-28T20:17:43.996 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:17:43.997 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-28T20:17:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:43 smithi001 ceph-mon[20984]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-28T20:17:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:43 smithi121 ceph-mon[25248]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-28T20:17:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:43 smithi007 ceph-mon[25357]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-28T20:17:44.374 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 -- 172.21.15.1:0/204552613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32841067b0 msgr2=0x7f3284106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 --2- 172.21.15.1:0/204552613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32841067b0 0x7f3284106bc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3270009900 tx=0x7f327002a480 comp rx=0 tx=0).stop 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 -- 172.21.15.1:0/204552613 shutdown_connections 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 --2- 172.21.15.1:0/204552613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32841067b0 0x7f3284106bc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 --2- 172.21.15.1:0/204552613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3284107150 0x7f328410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 --2- 172.21.15.1:0/204552613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284105720 0x7f3284105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 -- 172.21.15.1:0/204552613 >> 172.21.15.1:0/204552613 conn(0x7f3284101090 msgr2=0x7f3284103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 -- 172.21.15.1:0/204552613 shutdown_connections 2024-08-28T20:17:44.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.982+0000 7f328ae00640 1 -- 172.21.15.1:0/204552613 wait complete. 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.983+0000 7f328ae00640 1 Processor -- start 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.983+0000 7f328ae00640 1 -- start start 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f328ae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3284105720 0x7f328419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f328ae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32841067b0 0x7f328419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f328ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284107150 0x7f328419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f328ae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3284111370 con 0x7f3284105720 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f328ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32841111f0 con 0x7f3284107150 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f328ae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32841114f0 con 0x7f32841067b0 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f3283e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3284105720 0x7f328419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f3283e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3284105720 0x7f328419bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59174/0 (socket says 172.21.15.1:59174) 2024-08-28T20:17:44.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f3283e00640 1 -- 172.21.15.1:0/1467452 learned_addr learned my addr 172.21.15.1:0/1467452 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f3288e00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284107150 0x7f328419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.984+0000 7f3283400640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32841067b0 0x7f328419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3288e00640 1 -- 172.21.15.1:0/1467452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32841067b0 msgr2=0x7f328419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3288e00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32841067b0 0x7f328419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3288e00640 1 -- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3284105720 msgr2=0x7f328419bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3288e00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3284105720 0x7f328419bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:44.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3288e00640 1 -- 172.21.15.1:0/1467452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328419d9c0 con 0x7f3284107150 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3288e00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284107150 0x7f328419d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f327c009fd0 tx=0x7f327c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c00ce20 con 0x7f3284107150 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328419dcb0 con 0x7f3284107150 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f327c005020 con 0x7f3284107150 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c010690 con 0x7f3284107150 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.985+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32841a43b0 con 0x7f3284107150 2024-08-28T20:17:44.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.986+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328410c8e0 con 0x7f3284107150 2024-08-28T20:17:44.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.989+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f327c0054d0 con 0x7f3284107150 2024-08-28T20:17:44.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.990+0000 7f3280c00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32680b4b30 0x7f32680b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:44.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.990+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f327c0e5820 con 0x7f3284107150 2024-08-28T20:17:44.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.990+0000 7f3283e00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32680b4b30 0x7f32680b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:44.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.991+0000 7f3283e00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32680b4b30 0x7f32680b7040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32740095f0 tx=0x7f3274005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:44.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:44.992+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f327c0ac8e0 con 0x7f3284107150 2024-08-28T20:17:45.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:44 smithi001 ceph-mon[20984]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:45.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:44 smithi121 ceph-mon[25248]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.231+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f328402e430 con 0x7f3284107150 2024-08-28T20:17:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.232+0000 7f3280c00640 1 -- 172.21.15.1:0/1467452 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3067 (secure 0 0 0) 0x7f327c0ac1e0 con 0x7f3284107150 2024-08-28T20:17:45.234 INFO:teuthology.orchestra.run.smithi001.stdout:e25 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-08-28T20:16:11:262914+0000 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 25 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-08-28T20:15:54.165615+0000 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-08-28T20:16:10.320965+0000 2024-08-28T20:17:45.235 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 3 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:in 0,1,2 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24701,1=24673,2=24667} 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-08-28T20:17:45.236 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3] 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24701 members: 24701,24673,24667 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{0:24701} state up:active seq 5 addr [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{0:24659} state up:standby-replay seq 1 addr [v2:172.21.15.7:6836/3668716781,v1:172.21.15.7:6837/3668716781] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{1:24673} state up:active seq 9 addr [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{1:24646} state up:standby-replay seq 1 addr [v2:172.21.15.121:6836/1661917289,v1:172.21.15.121:6837/1661917289] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{2:24667} state up:active seq 11 addr [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.237 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{2:24640} state up:standby-replay seq 1 addr [v2:172.21.15.121:6834/179317583,v1:172.21.15.121:6835/179317583] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14610} state up:standby seq 1 addr [v2:172.21.15.1:6836/3430910515,v1:172.21.15.1:6837/3430910515] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{-1:14661} state up:standby seq 1 addr [v2:172.21.15.1:6840/508380082,v1:172.21.15.1:6841/508380082] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{-1:24592} state up:standby seq 1 addr [v2:172.21.15.121:6832/2034298209,v1:172.21.15.121:6833/2034298209] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{-1:24602} state up:standby seq 1 addr [v2:172.21.15.7:6832/3463409516,v1:172.21.15.7:6833/3463409516] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:24614} state up:standby seq 1 addr [v2:172.21.15.1:6834/2494570830,v1:172.21.15.1:6835/2494570830] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.238 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{-1:24632} state up:standby seq 1 addr [v2:172.21.15.7:6834/2627425818,v1:172.21.15.7:6835/2627425818] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.235+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32680b4b30 msgr2=0x7f32680b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.235+0000 7f328ae00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32680b4b30 0x7f32680b7040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32740095f0 tx=0x7f3274005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.235+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284107150 msgr2=0x7f328419d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.235+0000 7f328ae00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284107150 0x7f328419d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f327c009fd0 tx=0x7f327c00ef10 comp rx=0 tx=0).stop 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 shutdown_connections 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32680b4b30 0x7f32680b7040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3284107150 0x7f328419d1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:45.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32841067b0 0x7f328419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 --2- 172.21.15.1:0/1467452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3284105720 0x7f328419bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 >> 172.21.15.1:0/1467452 conn(0x7f3284101090 msgr2=0x7f3284109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 shutdown_connections 2024-08-28T20:17:45.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:45.236+0000 7f328ae00640 1 -- 172.21.15.1:0/1467452 wait complete. 2024-08-28T20:17:45.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:44 smithi007 ceph-mon[25357]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T20:17:46.015 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-28T20:17:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:45 smithi001 ceph-mon[20984]: pgmap v354: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:45 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1467452' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-28T20:17:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:45 smithi121 ceph-mon[25248]: pgmap v354: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:45 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1467452' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-28T20:17:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:45 smithi007 ceph-mon[25357]: pgmap v354: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:45 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1467452' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-28T20:17:46.390 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:47.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 -- 172.21.15.1:0/2569760033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104f20 msgr2=0x7fd6d010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:47.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 --2- 172.21.15.1:0/2569760033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104f20 0x7fd6d010b8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009ca0 tx=0x7fd6c802a950 comp rx=0 tx=0).stop 2024-08-28T20:17:47.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 -- 172.21.15.1:0/2569760033 shutdown_connections 2024-08-28T20:17:47.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 --2- 172.21.15.1:0/2569760033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104f20 0x7fd6d010b8c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 --2- 172.21.15.1:0/2569760033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d0104580 0x7fd6d0104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 --2- 172.21.15.1:0/2569760033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d01034f0 0x7fd6d0103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.000+0000 7fd6d7800640 1 -- 172.21.15.1:0/2569760033 >> 172.21.15.1:0/2569760033 conn(0x7fd6d00fee60 msgr2=0x7fd6d0101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.001+0000 7fd6d7800640 1 -- 172.21.15.1:0/2569760033 shutdown_connections 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.001+0000 7fd6d7800640 1 -- 172.21.15.1:0/2569760033 wait complete. 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.002+0000 7fd6d7800640 1 Processor -- start 2024-08-28T20:17:47.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.002+0000 7fd6d7800640 1 -- start start 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d7800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d01034f0 0x7fd6d0199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d7800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 0x7fd6d019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d7800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d0104f20 0x7fd6d019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d7800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d010f190 con 0x7fd6d0104580 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d7800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d010f010 con 0x7fd6d0104f20 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d7800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d010f310 con 0x7fd6d01034f0 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 0x7fd6d019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 0x7fd6d019a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58568/0 (socket says 172.21.15.1:58568) 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 -- 172.21.15.1:0/258577884 learned_addr learned my addr 172.21.15.1:0/258577884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d5800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d0104f20 0x7fd6d019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d4e00640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d01034f0 0x7fd6d0199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 -- 172.21.15.1:0/258577884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d01034f0 msgr2=0x7fd6d0199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d01034f0 0x7fd6d0199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 -- 172.21.15.1:0/258577884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d0104f20 msgr2=0x7fd6d019af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d0104f20 0x7fd6d019af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6c7e00640 1 -- 172.21.15.1:0/258577884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d019b730 con 0x7fd6d0104580 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.003+0000 7fd6d5800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d0104f20 0x7fd6d019af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.004+0000 7fd6c7e00640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 0x7fd6d019a370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800e9f0 tx=0x7fd6b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:47.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.004+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800cd80 con 0x7fd6d0104580 2024-08-28T20:17:47.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.004+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6b80054d0 con 0x7fd6d0104580 2024-08-28T20:17:47.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.004+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8010690 con 0x7fd6d0104580 2024-08-28T20:17:47.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.004+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d019ba20 con 0x7fd6d0104580 2024-08-28T20:17:47.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.004+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d01a2120 con 0x7fd6d0104580 2024-08-28T20:17:47.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.005+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d0103960 con 0x7fd6d0104580 2024-08-28T20:17:47.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.007+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fd6b8004e90 con 0x7fd6d0104580 2024-08-28T20:17:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.009+0000 7fd6ce000640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd6b40b4bb0 0x7fd6b40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.009+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fd6b80e5540 con 0x7fd6d0104580 2024-08-28T20:17:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.009+0000 7fd6d4e00640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd6b40b4bb0 0x7fd6b40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.010+0000 7fd6d4e00640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd6b40b4bb0 0x7fd6b40b70c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009bd0 tx=0x7fd6c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:47.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.013+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd6b80ac600 con 0x7fd6d0104580 2024-08-28T20:17:47.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.210+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd6d002e7e0 con 0x7fd6d0104580 2024-08-28T20:17:47.213 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:46 smithi001 ceph-mon[20984]: pgmap v355: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:47.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.212+0000 7fd6ce000640 1 -- 172.21.15.1:0/258577884 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v76) ==== 56+0+5247 (secure 0 0 0) 0x7fd6d002e7e0 con 0x7fd6d0104580 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 76 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:fsid f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-08-28T20:07:12.748179+0000 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-08-28T20:16:09.246336+0000 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 26 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-08-28T20:17:47.215 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/62453617,v1:172.21.15.1:6803/62453617] [v2:172.21.15.1:6804/62453617,v1:172.21.15.1:6805/62453617] exists,up c1b3b5c1-9a16-483f-944f-6e8e933cd76a 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 13 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6800/512270550,v1:172.21.15.7:6801/512270550] [v2:172.21.15.7:6802/512270550,v1:172.21.15.7:6803/512270550] exists,up e8587b29-15e2-45cc-8929-361b1068c099 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 18 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/1023461840,v1:172.21.15.121:6801/1023461840] [v2:172.21.15.121:6802/1023461840,v1:172.21.15.121:6803/1023461840] exists,up 294c27ff-a326-428f-8084-139bf4bf7cad 2024-08-28T20:17:47.216 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 24 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/3058293665,v1:172.21.15.1:6811/3058293665] [v2:172.21.15.1:6812/3058293665,v1:172.21.15.1:6813/3058293665] exists,up 71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 30 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6808/1548276367,v1:172.21.15.7:6809/1548276367] [v2:172.21.15.7:6810/1548276367,v1:172.21.15.7:6811/1548276367] exists,up dc09afde-7028-48d3-b258-e7a52e67317e 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 35 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6808/506146623,v1:172.21.15.121:6809/506146623] [v2:172.21.15.121:6810/506146623,v1:172.21.15.121:6811/506146623] exists,up 024ef980-246c-45ae-9b35-2ec8c5a58dbd 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 41 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/4096512062,v1:172.21.15.1:6819/4096512062] [v2:172.21.15.1:6820/4096512062,v1:172.21.15.1:6821/4096512062] exists,up 38aa1326-0c57-4925-a4c6-706fa7eb6c40 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 45 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6816/1084781736,v1:172.21.15.7:6817/1084781736] [v2:172.21.15.7:6818/1084781736,v1:172.21.15.7:6819/1084781736] exists,up 8cfe4d05-a623-481c-9463-e8571c13f7d7 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 50 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6816/989579690,v1:172.21.15.121:6817/989579690] [v2:172.21.15.121:6818/989579690,v1:172.21.15.121:6819/989579690] exists,up 817fb875-66b9-428f-abcd-cd62e49c6f81 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 56 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/3838494531,v1:172.21.15.1:6827/3838494531] [v2:172.21.15.1:6828/3838494531,v1:172.21.15.1:6829/3838494531] exists,up 9a163d6f-2558-4097-a93e-0714aa8ff4b3 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 61 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6824/407515474,v1:172.21.15.7:6825/407515474] [v2:172.21.15.7:6826/407515474,v1:172.21.15.7:6827/407515474] exists,up 284360f9-662f-43ab-924b-7820d7e7042f 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 66 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6824/1879105040,v1:172.21.15.121:6825/1879105040] [v2:172.21.15.121:6826/1879105040,v1:172.21.15.121:6827/1879105040] exists,up e7656a4e-5f9c-4081-a1ef-7ea7c74028e2 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.b [2,6] 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.10 [2,4,8,11] 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.11 [7,11] 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.14 [2,4] 2024-08-28T20:17:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1a [8,1] 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.11 [5,9] 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.13 [4,9] 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1d [4,8] 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.36 [4,9] 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2589583493 expires 2024-08-29T20:08:08.057916+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/1152565265 expires 2024-08-29T20:08:08.057916+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2571286405 expires 2024-08-29T20:07:38.468473+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2902108707 expires 2024-08-29T20:08:08.057916+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/1152565265 expires 2024-08-29T20:08:08.057916+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2047796715 expires 2024-08-29T20:07:38.468473+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1825727919 expires 2024-08-29T20:07:38.468473+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/2106947194 expires 2024-08-29T20:07:38.468473+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1421728777 expires 2024-08-29T20:08:08.057916+0000 2024-08-28T20:17:47.218 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/2106947194 expires 2024-08-29T20:07:38.468473+0000 2024-08-28T20:17:47.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd6b40b4bb0 msgr2=0x7fd6b40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:47.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd6b40b4bb0 0x7fd6b40b70c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009bd0 tx=0x7fd6c0005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:47.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 msgr2=0x7fd6d019a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 0x7fd6d019a370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800e9f0 tx=0x7fd6b800edf0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 shutdown_connections 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd6b40b4bb0 0x7fd6b40b70c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d0104580 0x7fd6d019a370 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6d0104f20 0x7fd6d019af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 --2- 172.21.15.1:0/258577884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d01034f0 0x7fd6d0199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 >> 172.21.15.1:0/258577884 conn(0x7fd6d00fee60 msgr2=0x7fd6d0107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.214+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 shutdown_connections 2024-08-28T20:17:47.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:47.215+0000 7fd6d7800640 1 -- 172.21.15.1:0/258577884 wait complete. 2024-08-28T20:17:47.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:46 smithi121 ceph-mon[25248]: pgmap v355: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:47.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:46 smithi007 ceph-mon[25357]: pgmap v355: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:48.020 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-28T20:17:48.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:17:48.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:47 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/258577884' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-28T20:17:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:47 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/258577884' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-28T20:17:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:47 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/258577884' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-28T20:17:48.406 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:49.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 -- 172.21.15.1:0/340150068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810b460 msgr2=0x7f89f810b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:49.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 --2- 172.21.15.1:0/340150068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810b460 0x7f89f810b870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009ca0 tx=0x7f89e002a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 -- 172.21.15.1:0/340150068 shutdown_connections 2024-08-28T20:17:49.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 --2- 172.21.15.1:0/340150068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810b460 0x7f89f810b870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 --2- 172.21.15.1:0/340150068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89f810bdb0 0x7f89f81125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 --2- 172.21.15.1:0/340150068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f8105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 -- 172.21.15.1:0/340150068 >> 172.21.15.1:0/340150068 conn(0x7f89f81015b0 msgr2=0x7f89f8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 -- 172.21.15.1:0/340150068 shutdown_connections 2024-08-28T20:17:49.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.020+0000 7f89fd400640 1 -- 172.21.15.1:0/340150068 wait complete. 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.021+0000 7f89fd400640 1 Processor -- start 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 -- start start 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89f810b460 0x7f89f819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810bdb0 0x7f89f81a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f89f8115ac0 con 0x7f89f810bdb0 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89f8115940 con 0x7f89f8105b20 2024-08-28T20:17:49.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.022+0000 7f89fd400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89f8115c40 con 0x7f89f810b460 2024-08-28T20:17:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810bdb0 0x7f89f81a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89f810b460 0x7f89f819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810bdb0 0x7f89f81a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58588/0 (socket says 172.21.15.1:58588) 2024-08-28T20:17:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40760/0 (socket says 172.21.15.1:40760) 2024-08-28T20:17:49.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f7200640 1 -- 172.21.15.1:0/316384375 learned_addr learned my addr 172.21.15.1:0/316384375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 -- 172.21.15.1:0/316384375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89f810b460 msgr2=0x7f89f819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89f810b460 0x7f89f819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 -- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810bdb0 msgr2=0x7f89f81a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810bdb0 0x7f89f81a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.023+0000 7f89f6800640 1 -- 172.21.15.1:0/316384375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f81a23e0 con 0x7f89f8105b20 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.024+0000 7f89f6800640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f819c470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89e800e9f0 tx=0x7f89e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.024+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e800ccc0 con 0x7f89f8105b20 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.024+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e80108e0 con 0x7f89f8105b20 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.024+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8018880 con 0x7f89f8105b20 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.024+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f81a26d0 con 0x7f89f8105b20 2024-08-28T20:17:49.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.024+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f81a8e30 con 0x7f89f8105b20 2024-08-28T20:17:49.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.025+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f8105f30 con 0x7f89f8105b20 2024-08-28T20:17:49.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.027+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f89e8010430 con 0x7f89f8105b20 2024-08-28T20:17:49.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.029+0000 7f89efe00640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f89dc0b4bb0 0x7f89dc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:49.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.029+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f89e80e5420 con 0x7f89f8105b20 2024-08-28T20:17:49.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.029+0000 7f89ede00640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f89dc0b4bb0 0x7f89dc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:49.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.030+0000 7f89ede00640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f89dc0b4bb0 0x7f89dc0b70c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000f80 tx=0x7f89e0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:49.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.031+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f89e80abe90 con 0x7f89f8105b20 2024-08-28T20:17:49.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:48 smithi001 ceph-mon[20984]: pgmap v356: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-28T20:17:49.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:48 smithi121 ceph-mon[25248]: pgmap v356: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-28T20:17:49.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.265+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89f802e430 con 0x7f89f8105b20 2024-08-28T20:17:49.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.266+0000 7f89efe00640 1 -- 172.21.15.1:0/316384375 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7f89e80b0650 con 0x7f89f8105b20 2024-08-28T20:17:49.269 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:49.269 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-08-28T20:16:11:262914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:16:10.320965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:17:49.269 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:17:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.268+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f89dc0b4bb0 msgr2=0x7f89dc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.268+0000 7f89fd400640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f89dc0b4bb0 0x7f89dc0b70c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000f80 tx=0x7f89e0005fd0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.268+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 msgr2=0x7f89f819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.268+0000 7f89fd400640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f819c470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89e800e9f0 tx=0x7f89e800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 shutdown_connections 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f89dc0b4bb0 0x7f89dc0b70c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89f810bdb0 0x7f89f81a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89f810b460 0x7f89f819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 --2- 172.21.15.1:0/316384375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8105b20 0x7f89f819c470 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 >> 172.21.15.1:0/316384375 conn(0x7f89f81015b0 msgr2=0x7f89f810aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 shutdown_connections 2024-08-28T20:17:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:49.269+0000 7f89fd400640 1 -- 172.21.15.1:0/316384375 wait complete. 2024-08-28T20:17:49.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:48 smithi007 ceph-mon[25357]: pgmap v356: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-28T20:17:50.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:17:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:49 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/316384375' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:49 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/316384375' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:50.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:49 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/316384375' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:50.488 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 -- 172.21.15.1:0/319564450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 msgr2=0x7fe108075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 --2- 172.21.15.1:0/319564450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe108075550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009900 tx=0x7fe0f802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 -- 172.21.15.1:0/319564450 shutdown_connections 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 --2- 172.21.15.1:0/319564450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108114020 0x7fe1081164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 --2- 172.21.15.1:0/319564450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe108075b70 0x7fe108075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 --2- 172.21.15.1:0/319564450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe108075550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 -- 172.21.15.1:0/319564450 >> 172.21.15.1:0/319564450 conn(0x7fe1080ff1e0 msgr2=0x7fe108101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 -- 172.21.15.1:0/319564450 shutdown_connections 2024-08-28T20:17:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.110+0000 7fe107e00640 1 -- 172.21.15.1:0/319564450 wait complete. 2024-08-28T20:17:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.111+0000 7fe107e00640 1 Processor -- start 2024-08-28T20:17:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.111+0000 7fe107e00640 1 -- start start 2024-08-28T20:17:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 0x7fe1081a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe1081a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe108114020 0x7fe1081a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe108119cb0 con 0x7fe108077120 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe108119b30 con 0x7fe108075b70 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe108119e30 con 0x7fe108114020 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe106000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe1081a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe106a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 0x7fe1081a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe106a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 0x7fe1081a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40772/0 (socket says 172.21.15.1:40772) 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe106a00640 1 -- 172.21.15.1:0/2439766499 learned_addr learned my addr 172.21.15.1:0/2439766499 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe106000640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe1081a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58604/0 (socket says 172.21.15.1:58604) 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.112+0000 7fe107400640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe108114020 0x7fe1081a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe106a00640 1 -- 172.21.15.1:0/2439766499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe108114020 msgr2=0x7fe1081a5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe106a00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe108114020 0x7fe1081a5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe106a00640 1 -- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 msgr2=0x7fe1081a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe106a00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe1081a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe106a00640 1 -- 172.21.15.1:0/2439766499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1081a65f0 con 0x7fe108075b70 2024-08-28T20:17:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe106a00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 0x7fe1081a0680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8005ab0 tx=0x7fe0f8003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:51.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f803f070 con 0x7fe108075b70 2024-08-28T20:17:51.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0f8031d60 con 0x7fe108075b70 2024-08-28T20:17:51.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1081a6880 con 0x7fe108075b70 2024-08-28T20:17:51.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.113+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8035030 con 0x7fe108075b70 2024-08-28T20:17:51.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.114+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1081ad040 con 0x7fe108075b70 2024-08-28T20:17:51.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.114+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe108075f80 con 0x7fe108075b70 2024-08-28T20:17:51.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.117+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fe0f8042070 con 0x7fe108075b70 2024-08-28T20:17:51.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.118+0000 7fe0ff400640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0ec0b4b30 0x7fe0ec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:51.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.118+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe0f8105f50 con 0x7fe108075b70 2024-08-28T20:17:51.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.119+0000 7fe106000640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0ec0b4b30 0x7fe0ec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:51.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.119+0000 7fe106000640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0ec0b4b30 0x7fe0ec0b7040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe108115ff0 tx=0x7fe0f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:51.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.121+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe0f80cc9c0 con 0x7fe108075b70 2024-08-28T20:17:51.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:50 smithi001 ceph-mon[20984]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:51.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:50 smithi121 ceph-mon[25248]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:51.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:50 smithi007 ceph-mon[25357]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-28T20:17:51.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.353+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1081a17b0 con 0x7fe108075b70 2024-08-28T20:17:51.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.354+0000 7fe0ff400640 1 -- 172.21.15.1:0/2439766499 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7fe0f80d1180 con 0x7fe108075b70 2024-08-28T20:17:51.356 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:51.356 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-08-28T20:16:11:262914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:16:10.320965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:17:51.357 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0ec0b4b30 msgr2=0x7fe0ec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0ec0b4b30 0x7fe0ec0b7040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe108115ff0 tx=0x7fe0f400b390 comp rx=0 tx=0).stop 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 msgr2=0x7fe1081a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 0x7fe1081a0680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8005ab0 tx=0x7fe0f8003c80 comp rx=0 tx=0).stop 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 shutdown_connections 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe0ec0b4b30 0x7fe0ec0b7040 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108077120 0x7fe1081a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe108114020 0x7fe1081a5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 --2- 172.21.15.1:0/2439766499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108075b70 0x7fe1081a0680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:51.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.356+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 >> 172.21.15.1:0/2439766499 conn(0x7fe1080ff1e0 msgr2=0x7fe10810ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.357+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 shutdown_connections 2024-08-28T20:17:51.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:51.357+0000 7fe107e00640 1 -- 172.21.15.1:0/2439766499 wait complete. 2024-08-28T20:17:52.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:51 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2439766499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:51 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2439766499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:52.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:17:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:51 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2439766499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:17:52.681 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:52.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:52 smithi001 ceph-mon[20984]: pgmap v358: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-28T20:17:53.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:52 smithi121 ceph-mon[25248]: pgmap v358: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-28T20:17:53.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:52 smithi007 ceph-mon[25357]: pgmap v358: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 -- 172.21.15.1:0/2930308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 msgr2=0x7f08a4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 --2- 172.21.15.1:0/2930308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a4109650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f088c009900 tx=0x7f088c02a410 comp rx=0 tx=0).stop 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 -- 172.21.15.1:0/2930308514 shutdown_connections 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 --2- 172.21.15.1:0/2930308514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a4109650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 --2- 172.21.15.1:0/2930308514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4109b90 0x7f08a41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 --2- 172.21.15.1:0/2930308514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4103900 0x7f08a4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 -- 172.21.15.1:0/2930308514 >> 172.21.15.1:0/2930308514 conn(0x7f08a407b5f0 msgr2=0x7f08a407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 -- 172.21.15.1:0/2930308514 shutdown_connections 2024-08-28T20:17:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.346+0000 7f08aa200640 1 -- 172.21.15.1:0/2930308514 wait complete. 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.347+0000 7f08aa200640 1 Processor -- start 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.347+0000 7f08aa200640 1 -- start start 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08aa200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 0x7f08a40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08aa200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08aa200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4109b90 0x7f08a4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08aa200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4113850 con 0x7f08a4109240 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08aa200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08a41136d0 con 0x7f08a4103900 2024-08-28T20:17:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08aa200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08a41139d0 con 0x7f08a4109b90 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f089be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08a3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4109b90 0x7f08a4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08a3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 0x7f08a40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f089be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58626/0 (socket says 172.21.15.1:58626) 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08a3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4109b90 0x7f08a4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49208/0 (socket says 172.21.15.1:49208) 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f089be00640 1 -- 172.21.15.1:0/3307469481 learned_addr learned my addr 172.21.15.1:0/3307469481 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.348+0000 7f08a3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 0x7f08a40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40786/0 (socket says 172.21.15.1:40786) 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a3400640 1 -- 172.21.15.1:0/3307469481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4109b90 msgr2=0x7f08a4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a3400640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4109b90 0x7f08a4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a3400640 1 -- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 msgr2=0x7f08a40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a3400640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a3400640 1 -- 172.21.15.1:0/3307469481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a41a8500 con 0x7f08a4103900 2024-08-28T20:17:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a3400640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 0x7f08a40754b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f089400e9f0 tx=0x7f089400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089400ccc0 con 0x7f08a4103900 2024-08-28T20:17:53.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0894005020 con 0x7f08a4103900 2024-08-28T20:17:53.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.349+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a41a87f0 con 0x7f08a4103900 2024-08-28T20:17:53.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.350+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894004a00 con 0x7f08a4103900 2024-08-28T20:17:53.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.350+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a41a8d30 con 0x7f08a4103900 2024-08-28T20:17:53.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.351+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a4103d10 con 0x7f08a4103900 2024-08-28T20:17:53.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.353+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f0894004ba0 con 0x7f08a4103900 2024-08-28T20:17:53.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.355+0000 7f08a0c00640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f08880b4bb0 0x7f08880b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:53.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.355+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f08940e5130 con 0x7f08a4103900 2024-08-28T20:17:53.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.355+0000 7f089be00640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f08880b4bb0 0x7f08880b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:53.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.356+0000 7f089be00640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f08880b4bb0 0x7f08880b70c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f08a4109010 tx=0x7f088c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:53.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.356+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f08940ac280 con 0x7f08a4103900 2024-08-28T20:17:53.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.551+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08a40767b0 con 0x7f08a4103900 2024-08-28T20:17:53.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.553+0000 7f08a0c00640 1 -- 172.21.15.1:0/3307469481 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7f08940abb80 con 0x7f08a4103900 2024-08-28T20:17:53.556 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:17:53.556 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f08880b4bb0 msgr2=0x7f08880b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f08880b4bb0 0x7f08880b70c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f08a4109010 tx=0x7f088c009560 comp rx=0 tx=0).stop 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 msgr2=0x7f08a40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 0x7f08a40754b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f089400e9f0 tx=0x7f089400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 shutdown_connections 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f08880b4bb0 0x7f08880b70c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08a4109240 0x7f08a40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08a4109b90 0x7f08a4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 --2- 172.21.15.1:0/3307469481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08a4103900 0x7f08a40754b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 >> 172.21.15.1:0/3307469481 conn(0x7f08a407b5f0 msgr2=0x7f08a4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:53.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 shutdown_connections 2024-08-28T20:17:53.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:53.556+0000 7f08aa200640 1 -- 172.21.15.1:0/3307469481 wait complete. 2024-08-28T20:17:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:53 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3307469481' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:17:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:53 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3307469481' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:17:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:53 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3307469481' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:17:54.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-28T20:15:54.165615+0000', 'modified': '2024-08-28T20:16:10.320965+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24701, 'mds_1': 24673, 'mds_2': 24667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24640': {'gid': 24640, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/179317583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 179317583}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 179317583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24646': {'gid': 24646, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/1661917289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 1661917289}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1661917289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/3668716781', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3668716781}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3668716781}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.121:6839/1704938195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 1704938195}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 1704938195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.1:6839/825690381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 825690381}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 825690381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24701': {'gid': 24701, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.7:6839/1672375051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 1672375051}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 1672375051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24701, 'qdb_cluster': [24701, 24673, 24667]} 2024-08-28T20:17:54.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-28T20:17:54.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-28T20:17:54.698 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:54 smithi001 ceph-mon[20984]: pgmap v359: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-28T20:17:55.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:54 smithi121 ceph-mon[25248]: pgmap v359: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-28T20:17:55.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 -- 172.21.15.1:0/1183362451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 msgr2=0x7fa370110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 --2- 172.21.15.1:0/1183362451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 0x7fa370110210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa368009ca0 tx=0x7fa36802a8b0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 -- 172.21.15.1:0/1183362451 shutdown_connections 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 --2- 172.21.15.1:0/1183362451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa3701094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 --2- 172.21.15.1:0/1183362451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 0x7fa370110210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 --2- 172.21.15.1:0/1183362451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103750 0x7fa370103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.304+0000 7fa375e00640 1 -- 172.21.15.1:0/1183362451 >> 172.21.15.1:0/1183362451 conn(0x7fa3700ff1e0 msgr2=0x7fa370101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.305+0000 7fa375e00640 1 -- 172.21.15.1:0/1183362451 shutdown_connections 2024-08-28T20:17:55.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.305+0000 7fa375e00640 1 -- 172.21.15.1:0/1183362451 wait complete. 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 Processor -- start 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 -- start start 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103750 0x7fa37019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa37019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 0x7fa3701a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa370113690 con 0x7fa370109090 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa370113510 con 0x7fa370103750 2024-08-28T20:17:55.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa375e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa370113810 con 0x7fa3701099e0 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.306+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa37019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa37019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58656/0 (socket says 172.21.15.1:58656) 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 -- 172.21.15.1:0/1036987021 learned_addr learned my addr 172.21.15.1:0/1036987021 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa374a00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103750 0x7fa37019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa375400640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 0x7fa3701a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 -- 172.21.15.1:0/1036987021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 msgr2=0x7fa3701a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 0x7fa3701a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 -- 172.21.15.1:0/1036987021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103750 msgr2=0x7fa37019c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103750 0x7fa37019c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 -- 172.21.15.1:0/1036987021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3701a21d0 con 0x7fa370109090 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.307+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa37019c800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00e970 tx=0x7fa35c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.308+0000 7fa36d600640 1 -- 172.21.15.1:0/1036987021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00cd80 con 0x7fa370109090 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.308+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3701a24c0 con 0x7fa370109090 2024-08-28T20:17:55.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.308+0000 7fa36d600640 1 -- 172.21.15.1:0/1036987021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa35c0035f0 con 0x7fa370109090 2024-08-28T20:17:55.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.308+0000 7fa36d600640 1 -- 172.21.15.1:0/1036987021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c010690 con 0x7fa370109090 2024-08-28T20:17:55.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.308+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3701a8c20 con 0x7fa370109090 2024-08-28T20:17:55.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 Processor -- start 2024-08-28T20:17:55.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 -- start start 2024-08-28T20:17:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f4117daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f4117dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40db7280 0x559f4117e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f410f4550 con 0x559f40dd7f60 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f410e3ae0 con 0x559f40db7280 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.311+0000 7fa37e01f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559f410e7a90 con 0x559f40daf0a0 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f4117daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa374a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f4117dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f4117daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58660/0 (socket says 172.21.15.1:58660) 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 -- 172.21.15.1:0/1420950788 learned_addr learned my addr 172.21.15.1:0/1420950788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa36d600640 1 -- 172.21.15.1:0/1036987021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fa35c003aa0 con 0x7fa370109090 2024-08-28T20:17:55.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:54 smithi007 ceph-mon[25357]: pgmap v359: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-28T20:17:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40db7280 0x559f4117e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 -- 172.21.15.1:0/1420950788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 msgr2=0x559f4117dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f4117dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 -- 172.21.15.1:0/1420950788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40db7280 msgr2=0x559f4117e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40db7280 0x559f4117e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.312+0000 7fa375400640 1 -- 172.21.15.1:0/1420950788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f40e43540 con 0x559f40dd7f60 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.313+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40db7280 0x559f4117e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.313+0000 7fa375400640 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f4117daa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa368005cc0 tx=0x7fa368009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b298cc43d0cb2d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.313+0000 7fa361c00640 1 -- 172.21.15.1:0/1420950788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680305a0 con 0x559f40dd7f60 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.313+0000 7fa361c00640 1 -- 172.21.15.1:0/1420950788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa368036040 con 0x559f40dd7f60 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.313+0000 7fa361c00640 1 -- 172.21.15.1:0/1420950788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680042a0 con 0x559f40dd7f60 2024-08-28T20:17:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa36d600640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa3580b4b30 0x7fa3580b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 -- 172.21.15.1:0/1420950788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 msgr2=0x559f4117daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f4117daa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa368005cc0 tx=0x7fa368009800 comp rx=0 tx=0).stop 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa36d600640 1 -- 172.21.15.1:0/1036987021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa35c0e5480 con 0x7fa370109090 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa374a00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa3580b4b30 0x7fa3580b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 -- 172.21.15.1:0/1420950788 shutdown_connections 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40db7280 0x559f4117e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f4117dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1420950788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f4117daa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.314+0000 7fa37e01f740 1 -- 172.21.15.1:0/1420950788 >> 172.21.15.1:0/1420950788 conn(0x559f40dcc350 msgr2=0x559f4117b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.315+0000 7fa37e01f740 1 -- 172.21.15.1:0/1420950788 shutdown_connections 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.315+0000 7fa37e01f740 1 -- 172.21.15.1:0/1420950788 wait complete. 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.315+0000 7fa374a00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa3580b4b30 0x7fa3580b7040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x559f4117c720 tx=0x7fa364005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:55.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.315+0000 7fa37e01f740 1 -- start start 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 Processor -- start 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40db7280 0x559f411896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f41195540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f40f465f0 con 0x559f40dd7f60 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f4106abd0 con 0x559f40daf0a0 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559f4118c220 con 0x559f40db7280 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa37e01f740 10 client.0 _ll_register_callbacks cb 0x559f41090210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:55.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa375400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f41195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40db7280 0x559f411896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa375400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f41195540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58670/0 (socket says 172.21.15.1:58670) 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.316+0000 7fa375400640 1 -- 172.21.15.1:0/407116644 learned_addr learned my addr 172.21.15.1:0/407116644 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa374a00640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411891b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa36fe00640 1 -- 172.21.15.1:0/407116644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 msgr2=0x559f411891b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa36fe00640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411891b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa36fe00640 1 -- 172.21.15.1:0/407116644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 msgr2=0x559f41195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa36fe00640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f41195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa36fe00640 1 -- 172.21.15.1:0/407116644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f410ab650 con 0x559f40db7280 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa375400640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f41195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa36fe00640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40db7280 0x559f411896f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0abb40 tx=0x7fa35c0ab670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b9833ea5c9165d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa356000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:17:55.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa356000640 1 -- 172.21.15.1:0/407116644 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0ae030 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa368036040 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.317+0000 7fa356000640 1 -- 172.21.15.1:0/407116644 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa35c0a8430 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa356000640 1 -- 172.21.15.1:0/407116644 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa35c0932f0 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 10 client.25159 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f41197f80 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa356000640 1 -- 172.21.15.1:0/407116644 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa368036040 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa356000640 1 -- 172.21.15.1:0/407116644 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa35c0b4cd0 con 0x559f40db7280 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 10 client.25159 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 10 client.25159 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 20 client.25159 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d968e0 0x559f4119b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 4 client.25159 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.318+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 --> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f410f64a0 con 0x559f40d968e0 2024-08-28T20:17:55.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.319+0000 7fa374a00640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d968e0 0x559f4119b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.319+0000 7fa374a00640 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d968e0 0x559f4119b990 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc624c6a818808d5 server_cookie=3d8e005cf53c7452 in_seq=0 out_seq=0 2024-08-28T20:17:55.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.319+0000 7fa356000640 10 client.25159 ms_handle_connect on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.320+0000 7fa356000640 1 -- 172.21.15.1:0/407116644 <== mds.2 v2:172.21.15.121:6838/1704938195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f410f64a0 con 0x559f40d968e0 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.320+0000 7fa356000640 10 client.25159 handle_command_reply: tid=0 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.320+0000 7fa37e01f740 1 client.25159 shutdown 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40db7280 msgr2=0x559f411896f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40db7280 0x559f411896f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0abb40 tx=0x7fa35c0ab670 comp rx=0 tx=0).stop 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 shutdown_connections 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d968e0 0x559f4119b990 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40dd7f60 0x559f41195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40db7280 0x559f411896f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 --2- 172.21.15.1:0/407116644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa356000640 0 client.25159 ms_handle_reset on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 >> 172.21.15.1:0/407116644 conn(0x559f40dcc350 msgr2=0x559f41180c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 shutdown_connections 2024-08-28T20:17:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 1 -- 172.21.15.1:0/407116644 wait complete. 2024-08-28T20:17:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.321+0000 7fa37e01f740 20 client.25159 trim_cache size 0 max 16384 2024-08-28T20:17:55.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.340+0000 7fa37e01f740 1 Processor -- start 2024-08-28T20:17:55.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.340+0000 7fa37e01f740 1 -- start start 2024-08-28T20:17:55.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f411954b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f41187a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40dd7f60 0x559f41187f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa37e01f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f41199cd0 con 0x559f40db7280 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa37e01f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f4119a3a0 con 0x559f40dd7f60 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa37e01f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559f4119aa70 con 0x559f40daf0a0 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f41187a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f41187a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58686/0 (socket says 172.21.15.1:58686) 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 -- 172.21.15.1:0/2968050327 learned_addr learned my addr 172.21.15.1:0/2968050327 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa374a00640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f411954b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa375400640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40dd7f60 0x559f41187f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 -- 172.21.15.1:0/2968050327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 msgr2=0x559f411954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f411954b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 -- 172.21.15.1:0/2968050327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40dd7f60 msgr2=0x559f41187f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40dd7f60 0x559f41187f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa36fe00640 1 -- 172.21.15.1:0/2968050327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f41199b00 con 0x559f40db7280 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa374a00640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f411954b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.341+0000 7fa375400640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40dd7f60 0x559f41187f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.342+0000 7fa36fe00640 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f41187a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c880 tx=0x7fa35c0ac680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b928cfbd689309 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.342+0000 7fa361200640 1 -- 172.21.15.1:0/2968050327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0ae020 con 0x559f40db7280 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.342+0000 7fa361200640 1 -- 172.21.15.1:0/2968050327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa35c0971a0 con 0x559f40db7280 2024-08-28T20:17:55.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.342+0000 7fa361200640 1 -- 172.21.15.1:0/2968050327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0a7990 con 0x559f40db7280 2024-08-28T20:17:55.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 -- 172.21.15.1:0/2968050327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 msgr2=0x559f41187a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f41187a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c880 tx=0x7fa35c0ac680 comp rx=0 tx=0).stop 2024-08-28T20:17:55.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 -- 172.21.15.1:0/2968050327 shutdown_connections 2024-08-28T20:17:55.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f41187a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40dd7f60 0x559f41187f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 --2- 172.21.15.1:0/2968050327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40daf0a0 0x559f411954b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 -- 172.21.15.1:0/2968050327 >> 172.21.15.1:0/2968050327 conn(0x559f40dcc350 msgr2=0x559f411993f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 -- 172.21.15.1:0/2968050327 shutdown_connections 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 -- 172.21.15.1:0/2968050327 wait complete. 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.343+0000 7fa37e01f740 1 -- start start 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 Processor -- start 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f411a4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40dd7f60 0x559f4119d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f4119b810 con 0x559f40db7280 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f4119b140 con 0x559f40daf0a0 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559f4119bee0 con 0x559f40dd7f60 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa37e01f740 10 client.0 _ll_register_callbacks cb 0x7fa35c0ab790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:55.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f411a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f411a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58690/0 (socket says 172.21.15.1:58690) 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.344+0000 7fa36fe00640 1 -- 172.21.15.1:0/1890581093 learned_addr learned my addr 172.21.15.1:0/1890581093 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa374a00640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa375400640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40dd7f60 0x559f4119d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa36fe00640 1 -- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40dd7f60 msgr2=0x559f4119d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40dd7f60 0x559f4119d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa36fe00640 1 -- 172.21.15.1:0/1890581093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 msgr2=0x559f411a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa36fe00640 1 -- 172.21.15.1:0/1890581093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f4119d9e0 con 0x559f40db7280 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa36fe00640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f411a4420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0a83e0 tx=0x7fa35c0abf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d60ce62e7c22c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa356000640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa356000640 1 -- 172.21.15.1:0/1890581093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0ae070 con 0x559f40db7280 2024-08-28T20:17:55.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa356000640 1 -- 172.21.15.1:0/1890581093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa35c0a7ad0 con 0x559f40db7280 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.345+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa35c0971a0 con 0x559f40db7280 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa356000640 1 -- 172.21.15.1:0/1890581093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa35c0b5160 con 0x559f40db7280 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 10 client.15141 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f411a33e0 con 0x559f40db7280 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa356000640 1 -- 172.21.15.1:0/1890581093 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa35c0971a0 con 0x559f40db7280 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa356000640 1 -- 172.21.15.1:0/1890581093 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa35c0b3a30 con 0x559f40db7280 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 10 client.15141 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 10 client.15141 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 20 client.15141 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d6bc90 0x559f41209c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 4 client.15141 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T20:17:55.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.346+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 --> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] -- command(tid 0: {"prefix": "status"}) -- 0x559f410f1f40 con 0x559f40d6bc90 2024-08-28T20:17:55.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.347+0000 7fa374a00640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d6bc90 0x559f41209c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.347+0000 7fa374a00640 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d6bc90 0x559f41209c40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6cae83f137f82e63 server_cookie=47524c163aba901d in_seq=0 out_seq=0 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.347+0000 7fa356000640 10 client.15141 ms_handle_connect on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa356000640 1 -- 172.21.15.1:0/1890581093 <== mds.2 v2:172.21.15.121:6838/1704938195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559f410f1f40 con 0x559f40d6bc90 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa356000640 10 client.15141 handle_command_reply: tid=0 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 client.15141 shutdown 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 msgr2=0x559f411a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f411a4420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0a83e0 tx=0x7fa35c0abf00 comp rx=0 tx=0).stop 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 shutdown_connections 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:6838/1704938195,v1:172.21.15.121:6839/1704938195] conn(0x559f40d6bc90 0x559f41209c40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f40db7280 0x559f411a4420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa356000640 0 client.15141 ms_handle_reset on v2:172.21.15.121:6838/1704938195 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559f40dd7f60 0x559f4119d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 --2- 172.21.15.1:0/1890581093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f40daf0a0 0x559f411a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 >> 172.21.15.1:0/1890581093 conn(0x559f40dcc350 msgr2=0x559f411993f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 shutdown_connections 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 1 -- 172.21.15.1:0/1890581093 wait complete. 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.348+0000 7fa37e01f740 20 client.15141 trim_cache size 0 max 16384 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-08-28T20:17:55.355 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24667, 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 109.111161478, 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 76, 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 76, 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 145.23524272200001 2024-08-28T20:17:55.356 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa3580b4b30 msgr2=0x7fa3580b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa3580b4b30 0x7fa3580b7040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x559f4117c720 tx=0x7fa364005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 msgr2=0x7fa37019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa37019c800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00e970 tx=0x7fa35c00ee30 comp rx=0 tx=0).stop 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 shutdown_connections 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa3580b4b30 0x7fa3580b7040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa370109090 0x7fa37019c800 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3701099e0 0x7fa3701a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 --2- 172.21.15.1:0/1036987021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103750 0x7fa37019c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:55.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 >> 172.21.15.1:0/1036987021 conn(0x7fa3700ff1e0 msgr2=0x7fa3701076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:55.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 shutdown_connections 2024-08-28T20:17:55.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:55.349+0000 7fa375e00640 1 -- 172.21.15.1:0/1036987021 wait complete. 2024-08-28T20:17:56.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell mds.g status 2024-08-28T20:17:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 -- 172.21.15.1:0/2504054090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 msgr2=0x7fade41164f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 --2- 172.21.15.1:0/2504054090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41164f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faddc009ca0 tx=0x7faddc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 -- 172.21.15.1:0/2504054090 shutdown_connections 2024-08-28T20:17:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 --2- 172.21.15.1:0/2504054090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41164f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 --2- 172.21.15.1:0/2504054090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4075b70 0x7fade4075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 --2- 172.21.15.1:0/2504054090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade4077120 0x7fade4075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 -- 172.21.15.1:0/2504054090 >> 172.21.15.1:0/2504054090 conn(0x7fade40ff1e0 msgr2=0x7fade4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:57.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 -- 172.21.15.1:0/2504054090 shutdown_connections 2024-08-28T20:17:57.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 -- 172.21.15.1:0/2504054090 wait complete. 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.254+0000 7fade3200640 1 Processor -- start 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 -- start start 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade4075b70 0x7fade41a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4077120 0x7fade41a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fade4119cb0 con 0x7fade4114020 2024-08-28T20:17:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fade4119b30 con 0x7fade4075b70 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fade4119e30 con 0x7fade4077120 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4077120 0x7fade41a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade4075b70 0x7fade41a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53298/0 (socket says 172.21.15.1:53298) 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.255+0000 7fade2800640 1 -- 172.21.15.1:0/4154540770 learned_addr learned my addr 172.21.15.1:0/4154540770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.256+0000 7fade2800640 1 -- 172.21.15.1:0/4154540770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4077120 msgr2=0x7fade41a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.256+0000 7fade2800640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4077120 0x7fade41a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.256+0000 7fade2800640 1 -- 172.21.15.1:0/4154540770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade4075b70 msgr2=0x7fade41a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.256+0000 7fade2800640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade4075b70 0x7fade41a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.256+0000 7fade2800640 1 -- 172.21.15.1:0/4154540770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade41a6570 con 0x7fade4114020 2024-08-28T20:17:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.256+0000 7fade2800640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41a5e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faddc02f540 tx=0x7faddc0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.257+0000 7faddaa00640 1 -- 172.21.15.1:0/4154540770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc003b70 con 0x7fade4114020 2024-08-28T20:17:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.257+0000 7faddaa00640 1 -- 172.21.15.1:0/4154540770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faddc003d10 con 0x7fade4114020 2024-08-28T20:17:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.257+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade41a6800 con 0x7fade4114020 2024-08-28T20:17:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.257+0000 7faddaa00640 1 -- 172.21.15.1:0/4154540770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc02f990 con 0x7fade4114020 2024-08-28T20:17:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.257+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41acfc0 con 0x7fade4114020 2024-08-28T20:17:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.261+0000 7fadef5f1740 1 Processor -- start 2024-08-28T20:17:57.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.261+0000 7faddaa00640 1 -- 172.21.15.1:0/4154540770 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7faddc02fb30 con 0x7fade4114020 2024-08-28T20:17:57.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 -- start start 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c48aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c48fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559391882280 0x559391c49520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559391bbf550 con 0x559391882280 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559391baeae0 con 0x55939187a0a0 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fadef5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559391bb2a90 con 0x5593918a2f60 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fade1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c48aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fade1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c48aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47326/0 (socket says 172.21.15.1:47326) 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fade1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c48fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fade1400640 1 -- 172.21.15.1:0/4117740665 learned_addr learned my addr 172.21.15.1:0/4117740665 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:57.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.262+0000 7fade1400640 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559391882280 0x559391c49520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fade1e00640 1 -- 172.21.15.1:0/4117740665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 msgr2=0x559391c48aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fade1e00640 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c48aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fade1e00640 1 -- 172.21.15.1:0/4117740665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559391882280 msgr2=0x559391c49520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fade1e00640 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559391882280 0x559391c49520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fade1e00640 1 -- 172.21.15.1:0/4117740665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939190e540 con 0x55939187a0a0 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fade1e00640 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c48fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009c20 tx=0x7fadd4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8ed7010d537020 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fadcf000640 1 -- 172.21.15.1:0/4117740665 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4004050 con 0x55939187a0a0 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fadcf000640 1 -- 172.21.15.1:0/4117740665 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd40054d0 con 0x55939187a0a0 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.263+0000 7fadcf000640 1 -- 172.21.15.1:0/4117740665 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4004c80 con 0x55939187a0a0 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7faddaa00640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fadc80b4b30 0x7fadc80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7faddaa00640 1 -- 172.21.15.1:0/4154540770 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7faddc106340 con 0x7fade4114020 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fade1400640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fadc80b4b30 0x7fadc80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 -- 172.21.15.1:0/4117740665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 msgr2=0x559391c48fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c48fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009c20 tx=0x7fadd4011810 comp rx=0 tx=0).stop 2024-08-28T20:17:57.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 -- 172.21.15.1:0/4117740665 shutdown_connections 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559391882280 0x559391c49520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c48fe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 --2- 172.21.15.1:0/4117740665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c48aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 -- 172.21.15.1:0/4117740665 >> 172.21.15.1:0/4117740665 conn(0x559391897350 msgr2=0x559391c46990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 -- 172.21.15.1:0/4117740665 shutdown_connections 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 -- 172.21.15.1:0/4117740665 wait complete. 2024-08-28T20:17:57.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fade1400640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fadc80b4b30 0x7fadc80b7040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009fd0 tx=0x7fadd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:57.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.265+0000 7fadef5f1740 1 -- start start 2024-08-28T20:17:57.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 Processor -- start 2024-08-28T20:17:57.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c54180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559391882280 0x559391c546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 0x559391c605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559391a115f0 con 0x5593918a2f60 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559391b35bd0 con 0x55939187a0a0 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559391c57280 con 0x559391882280 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fadef5f1740 10 client.0 _ll_register_callbacks cb 0x559391b5b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fade1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559391882280 0x559391c546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.266+0000 7fade2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 0x559391c605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c54180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559391882280 0x559391c546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47342/0 (socket says 172.21.15.1:47342) 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 0x559391c605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53314/0 (socket says 172.21.15.1:53314) 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1400640 1 -- 172.21.15.1:0/3395723200 learned_addr learned my addr 172.21.15.1:0/3395723200 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 -- 172.21.15.1:0/3395723200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559391882280 msgr2=0x559391c546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559391882280 0x559391c546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 -- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 msgr2=0x559391c605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 0x559391c605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 -- 172.21.15.1:0/3395723200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559391b76650 con 0x55939187a0a0 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade2800640 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 0x559391c605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fade1e00640 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c54180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fadd4000c00 tx=0x7fadd4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e10be991a5fab189 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.267+0000 7fadc3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadc3400640 1 -- 172.21.15.1:0/3395723200 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4029070 con 0x55939187a0a0 2024-08-28T20:17:57.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd40054d0 con 0x55939187a0a0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadc3400640 1 -- 172.21.15.1:0/3395723200 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fadd4003a00 con 0x55939187a0a0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadc3400640 1 -- 172.21.15.1:0/3395723200 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadd4035050 con 0x55939187a0a0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadef5f1740 10 client.25184 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559391c63020 con 0x55939187a0a0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.268+0000 7fadc3400640 1 -- 172.21.15.1:0/3395723200 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd40054d0 con 0x55939187a0a0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadc3400640 1 -- 172.21.15.1:0/3395723200 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fadd4004f70 con 0x55939187a0a0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadef5f1740 10 client.25184 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadef5f1740 10 client.25184 resolve_mds: resolved name 'g' to daemon mds.g 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadef5f1740 20 client.25184 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5593918618e0 0x559391c667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadef5f1740 4 client.25184 mds_command: new command op to 24673 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 --> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559391bc14a0 con 0x5593918618e0 2024-08-28T20:17:57.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.269+0000 7fade1400640 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5593918618e0 0x559391c667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.270+0000 7fadc3400640 10 client.25184 ms_handle_connect on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.270+0000 7fade1400640 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5593918618e0 0x559391c667c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=513aa4457d046682 server_cookie=50e3509cb3f6bc4e in_seq=0 out_seq=0 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.270+0000 7fadc3400640 1 -- 172.21.15.1:0/3395723200 <== mds.1 v2:172.21.15.1:6838/825690381 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559391bc14a0 con 0x5593918618e0 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.270+0000 7fadc3400640 10 client.25184 handle_command_reply: tid=0 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.270+0000 7fadef5f1740 1 client.25184 shutdown 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 msgr2=0x559391c54180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c54180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fadd4000c00 tx=0x7fadd4004730 comp rx=0 tx=0).stop 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 shutdown_connections 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x5593918618e0 0x559391c667c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5593918a2f60 0x559391c605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559391882280 0x559391c546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3395723200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55939187a0a0 0x559391c54180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 >> 172.21.15.1:0/3395723200 conn(0x559391897350 msgr2=0x559391c4bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:57.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadc3400640 0 client.25184 ms_handle_reset on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:57.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 shutdown_connections 2024-08-28T20:17:57.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 1 -- 172.21.15.1:0/3395723200 wait complete. 2024-08-28T20:17:57.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.271+0000 7fadef5f1740 20 client.25184 trim_cache size 0 max 16384 2024-08-28T20:17:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.290+0000 7fadef5f1740 1 Processor -- start 2024-08-28T20:17:57.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.290+0000 7fadef5f1740 1 -- start start 2024-08-28T20:17:57.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c60540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c46540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fadef5f1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559391c64b00 con 0x55939187a0a0 2024-08-28T20:17:57.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fadef5f1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559391c651d0 con 0x559391882280 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fadef5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559391c658a0 con 0x5593918a2f60 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c60540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c60540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53316/0 (socket says 172.21.15.1:53316) 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 -- 172.21.15.1:0/236091372 learned_addr learned my addr 172.21.15.1:0/236091372 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1400640 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade2800640 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c46540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 -- 172.21.15.1:0/236091372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 msgr2=0x559391c46540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c46540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 -- 172.21.15.1:0/236091372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 msgr2=0x559391c46000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c46000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade1e00640 1 -- 172.21.15.1:0/236091372 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559391c4ed90 con 0x55939187a0a0 2024-08-28T20:17:57.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.291+0000 7fade2800640 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c46540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:17:57.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.292+0000 7fade1e00640 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c60540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fadd4005370 tx=0x7fadd4023810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6509bc4530296ad4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:57.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.292+0000 7fadce600640 1 -- 172.21.15.1:0/236091372 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4029070 con 0x55939187a0a0 2024-08-28T20:17:57.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.292+0000 7fadce600640 1 -- 172.21.15.1:0/236091372 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd4023e50 con 0x55939187a0a0 2024-08-28T20:17:57.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.292+0000 7fadce600640 1 -- 172.21.15.1:0/236091372 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4003b40 con 0x55939187a0a0 2024-08-28T20:17:57.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 -- 172.21.15.1:0/236091372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 msgr2=0x559391c60540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c60540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fadd4005370 tx=0x7fadd4023810 comp rx=0 tx=0).stop 2024-08-28T20:17:57.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 -- 172.21.15.1:0/236091372 shutdown_connections 2024-08-28T20:17:57.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c46540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c46000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 --2- 172.21.15.1:0/236091372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c60540 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 -- 172.21.15.1:0/236091372 >> 172.21.15.1:0/236091372 conn(0x559391897350 msgr2=0x559391c52a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 -- 172.21.15.1:0/236091372 shutdown_connections 2024-08-28T20:17:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 -- 172.21.15.1:0/236091372 wait complete. 2024-08-28T20:17:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.293+0000 7fadef5f1740 1 -- start start 2024-08-28T20:17:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 Processor -- start 2024-08-28T20:17:57.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c6f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c68820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c68ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559391c66640 con 0x55939187a0a0 2024-08-28T20:17:57.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559391c65f70 con 0x559391882280 2024-08-28T20:17:57.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559391c66d10 con 0x5593918a2f60 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fadef5f1740 10 client.0 _ll_register_callbacks cb 0x7fadd4009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fade2800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c68ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fade1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c68820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fade1e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c6f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fade2800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c68ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47368/0 (socket says 172.21.15.1:47368) 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.294+0000 7fade2800640 1 -- 172.21.15.1:0/3069829674 learned_addr learned my addr 172.21.15.1:0/3069829674 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:57.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1400640 1 -- 172.21.15.1:0/3069829674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 msgr2=0x559391c68ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1400640 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c68ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1400640 1 -- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 msgr2=0x559391c6f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1400640 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c6f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1400640 1 -- 172.21.15.1:0/3069829674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559391c69630 con 0x559391882280 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1e00640 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c6f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fade1400640 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c68820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x559391c551f0 tx=0x7fadd0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=728e58e574a4e097 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:57.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.295+0000 7fadc3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadc3400640 1 -- 172.21.15.1:0/3069829674 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0037070 con 0x559391882280 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd4023e50 con 0x559391882280 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadc3400640 1 -- 172.21.15.1:0/3069829674 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fadd001a050 con 0x559391882280 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadc3400640 1 -- 172.21.15.1:0/3069829674 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadd0005020 con 0x559391882280 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadef5f1740 10 client.25190 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559391cd1d50 con 0x559391882280 2024-08-28T20:17:57.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadc3400640 1 -- 172.21.15.1:0/3069829674 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd4023e50 con 0x559391882280 2024-08-28T20:17:57.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadc3400640 1 -- 172.21.15.1:0/3069829674 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fadd003a030 con 0x559391882280 2024-08-28T20:17:57.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.296+0000 7fadef5f1740 10 client.25190 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:57.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fadef5f1740 10 client.25190 resolve_mds: resolved name 'g' to daemon mds.g 2024-08-28T20:17:57.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fadef5f1740 20 client.25190 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:57.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x559391836c90 0x559391cd55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:57.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fadef5f1740 4 client.25190 mds_command: new command op to 24673 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T20:17:57.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 --> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] -- command(tid 0: {"prefix": "status"}) -- 0x559391bbcf40 con 0x559391836c90 2024-08-28T20:17:57.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fade1e00640 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x559391836c90 0x559391cd55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:57.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fade1e00640 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x559391836c90 0x559391cd55d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd4283f45ec2e05 server_cookie=646a9ba614789f3b in_seq=0 out_seq=0 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.297+0000 7fadc3400640 10 client.25190 ms_handle_connect on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadc3400640 1 -- 172.21.15.1:0/3069829674 <== mds.1 v2:172.21.15.1:6838/825690381 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559391bbcf40 con 0x559391836c90 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadc3400640 10 client.25190 handle_command_reply: tid=0 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 client.25190 shutdown 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 msgr2=0x559391c68820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c68820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x559391c551f0 tx=0x7fadd0004730 comp rx=0 tx=0).stop 2024-08-28T20:17:57.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 shutdown_connections 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:6838/825690381,v1:172.21.15.1:6839/825690381] conn(0x559391836c90 0x559391cd55d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5593918a2f60 0x559391c68ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559391882280 0x559391c68820 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 --2- 172.21.15.1:0/3069829674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55939187a0a0 0x559391c6f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadc3400640 0 client.25190 ms_handle_reset on v2:172.21.15.1:6838/825690381 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 >> 172.21.15.1:0/3069829674 conn(0x559391897350 msgr2=0x559391c53f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:57.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 shutdown_connections 2024-08-28T20:17:57.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 1 -- 172.21.15.1:0/3069829674 wait complete. 2024-08-28T20:17:57.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.298+0000 7fadef5f1740 20 client.25190 trim_cache size 0 max 16384 2024-08-28T20:17:57.312 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:17:57.312 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:17:57.312 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-08-28T20:17:57.312 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24673, 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 112.070689229, 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 76, 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 76, 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 143.675740279 2024-08-28T20:17:57.313 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:17:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fadc80b4b30 msgr2=0x7fadc80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fadc80b4b30 0x7fadc80b7040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009fd0 tx=0x7fadd0005f90 comp rx=0 tx=0).stop 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 msgr2=0x7fade41a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41a5e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faddc02f540 tx=0x7faddc0316f0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 shutdown_connections 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fadc80b4b30 0x7fadc80b7040 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fade4114020 0x7fade41a5e40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4077120 0x7fade41a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 --2- 172.21.15.1:0/4154540770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fade4075b70 0x7fade41a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 >> 172.21.15.1:0/4154540770 conn(0x7fade40ff1e0 msgr2=0x7fade410ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 shutdown_connections 2024-08-28T20:17:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:57.299+0000 7fade3200640 1 -- 172.21.15.1:0/4154540770 wait complete. 2024-08-28T20:17:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:57 smithi001 ceph-mon[20984]: pgmap v360: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-08-28T20:17:57.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:57 smithi007 ceph-mon[25357]: pgmap v360: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-08-28T20:17:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:57 smithi121 ceph-mon[25248]: pgmap v360: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-08-28T20:17:58.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-28T20:17:58.469 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:17:59.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 -- 172.21.15.1:0/1654494880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 msgr2=0x7f9354109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 --2- 172.21.15.1:0/1654494880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f9354109480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9340009900 tx=0x7f934002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 -- 172.21.15.1:0/1654494880 shutdown_connections 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 --2- 172.21.15.1:0/1654494880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f9354109480 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 --2- 172.21.15.1:0/1654494880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93541099c0 0x7f93541101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 --2- 172.21.15.1:0/1654494880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 0x7f9354103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 -- 172.21.15.1:0/1654494880 >> 172.21.15.1:0/1654494880 conn(0x7f93540ff180 msgr2=0x7f93541015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 -- 172.21.15.1:0/1654494880 shutdown_connections 2024-08-28T20:17:59.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.085+0000 7f9358c00640 1 -- 172.21.15.1:0/1654494880 wait complete. 2024-08-28T20:17:59.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 Processor -- start 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 -- start start 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 0x7f935419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f935419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93541099c0 0x7f935419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9354113650 con 0x7f9354109070 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f93541134d0 con 0x7f93541099c0 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9358c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f93541137d0 con 0x7f9354103730 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.087+0000 7f9352a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f935419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 0x7f935419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9352a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f935419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53328/0 (socket says 172.21.15.1:53328) 2024-08-28T20:17:59.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9352a00640 1 -- 172.21.15.1:0/3399886622 learned_addr learned my addr 172.21.15.1:0/3399886622 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353e00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93541099c0 0x7f935419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 -- 172.21.15.1:0/3399886622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93541099c0 msgr2=0x7f935419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93541099c0 0x7f935419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 -- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 msgr2=0x7f935419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f935419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 -- 172.21.15.1:0/3399886622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935419fff0 con 0x7f9354103730 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9352a00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f935419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:59.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.088+0000 7f9353400640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 0x7f935419a080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f934400d720 tx=0x7f934400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:59.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.089+0000 7f934be00640 1 -- 172.21.15.1:0/3399886622 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344017070 con 0x7f9354103730 2024-08-28T20:17:59.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.089+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93541a02e0 con 0x7f9354103730 2024-08-28T20:17:59.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.089+0000 7f934be00640 1 -- 172.21.15.1:0/3399886622 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934400de30 con 0x7f9354103730 2024-08-28T20:17:59.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.089+0000 7f934be00640 1 -- 172.21.15.1:0/3399886622 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440047a0 con 0x7f9354103730 2024-08-28T20:17:59.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.089+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93541a6a40 con 0x7f9354103730 2024-08-28T20:17:59.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 Processor -- start 2024-08-28T20:17:59.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 -- start start 2024-08-28T20:17:59.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e6daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e6dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f166de4550 con 0x55f166ac7f60 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f166dd3ae0 con 0x55f166aa7280 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.092+0000 7f9360fe3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f166dd7a90 con 0x55f166a9f0a0 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9353e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e6daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9353e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e6daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53342/0 (socket says 172.21.15.1:53342) 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9353e00640 1 -- 172.21.15.1:0/1026806678 learned_addr learned my addr 172.21.15.1:0/1026806678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9352a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f934be00640 1 -- 172.21.15.1:0/3399886622 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f93440099d0 con 0x7f9354103730 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9352a00640 1 -- 172.21.15.1:0/1026806678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 msgr2=0x55f166e6dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9352a00640 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e6dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9352a00640 1 -- 172.21.15.1:0/1026806678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 msgr2=0x55f166e6daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9352a00640 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e6daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.093+0000 7f9352a00640 1 -- 172.21.15.1:0/1026806678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f166b33540 con 0x55f166aa7280 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.094+0000 7f9352a00640 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e6e520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9340031440 tx=0x7f9340005ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b7dcb93f1a780a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.094+0000 7f933fe00640 1 -- 172.21.15.1:0/1026806678 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340035040 con 0x55f166aa7280 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.094+0000 7f933fe00640 1 -- 172.21.15.1:0/1026806678 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9340031820 con 0x55f166aa7280 2024-08-28T20:17:59.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.094+0000 7f933fe00640 1 -- 172.21.15.1:0/1026806678 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340004a00 con 0x55f166aa7280 2024-08-28T20:17:59.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f934be00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93380b4b30 0x7f93380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 -- 172.21.15.1:0/1026806678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 msgr2=0x55f166e6e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e6e520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9340031440 tx=0x7f9340005ed0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 -- 172.21.15.1:0/1026806678 shutdown_connections 2024-08-28T20:17:59.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e6e520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e6dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1026806678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e6daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 -- 172.21.15.1:0/1026806678 >> 172.21.15.1:0/1026806678 conn(0x55f166abc350 msgr2=0x55f166e6b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f934be00640 1 -- 172.21.15.1:0/3399886622 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f93440e4da0 con 0x7f9354103730 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9353e00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93380b4b30 0x7f93380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 -- 172.21.15.1:0/1026806678 shutdown_connections 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.095+0000 7f9360fe3740 1 -- 172.21.15.1:0/1026806678 wait complete. 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.096+0000 7f9353e00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93380b4b30 0x7f93380b7040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f934c005fd0 tx=0x7f934c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.096+0000 7f9360fe3740 1 -- start start 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.096+0000 7f9360fe3740 1 Processor -- start 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166a9f0a0 0x55f166e791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 0x55f166e79720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e85510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f166c365f0 con 0x55f166aa7280 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f166d5abd0 con 0x55f166a9f0a0 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f166e7c220 con 0x55f166ac7f60 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9360fe3740 10 client.0 _ll_register_callbacks cb 0x55f166d80210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9352a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 0x55f166e79720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166a9f0a0 0x55f166e791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9352a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 0x55f166e79720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53346/0 (socket says 172.21.15.1:53346) 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9352a00640 1 -- 172.21.15.1:0/2065350643 learned_addr learned my addr 172.21.15.1:0/2065350643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353e00640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e85510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353400640 1 -- 172.21.15.1:0/2065350643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 msgr2=0x55f166e85510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353400640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e85510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353400640 1 -- 172.21.15.1:0/2065350643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 msgr2=0x55f166e79720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353400640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 0x55f166e79720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9353400640 1 -- 172.21.15.1:0/2065350643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f166d9b650 con 0x55f166a9f0a0 2024-08-28T20:17:59.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.097+0000 7f9352a00640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 0x55f166e79720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f9353400640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166a9f0a0 0x55f166e791e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f166e6c720 tx=0x7f93440ab650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3b66630493509 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f933cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f933cc00640 1 -- 172.21.15.1:0/2065350643 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440ab270 con 0x55f166a9f0a0 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f933cc00640 1 -- 172.21.15.1:0/2065350643 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f93440a79f0 con 0x55f166a9f0a0 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9340031820 con 0x55f166a9f0a0 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f933cc00640 1 -- 172.21.15.1:0/2065350643 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f93440abe60 con 0x55f166a9f0a0 2024-08-28T20:17:59.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f9360fe3740 10 client.25202 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f166e88000 con 0x55f166a9f0a0 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.098+0000 7f933cc00640 1 -- 172.21.15.1:0/2065350643 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9340031820 con 0x55f166a9f0a0 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f933cc00640 1 -- 172.21.15.1:0/2065350643 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93440d21a0 con 0x55f166a9f0a0 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9360fe3740 10 client.25202 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9360fe3740 10 client.25202 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9360fe3740 20 client.25202 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9360fe3740 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a868e0 0x55f166e8b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9360fe3740 4 client.25202 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:17:59.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f166de64a0 con 0x55f166a868e0 2024-08-28T20:17:59.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.099+0000 7f9352a00640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a868e0 0x55f166e8b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.100+0000 7f9352a00640 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a868e0 0x55f166e8b9d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=333c6cbabb1bd6e9 server_cookie=9617a72efd65c616 in_seq=0 out_seq=0 2024-08-28T20:17:59.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.100+0000 7f933cc00640 10 client.25202 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:59.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.100+0000 7f933cc00640 1 -- 172.21.15.1:0/2065350643 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f166de64a0 con 0x55f166a868e0 2024-08-28T20:17:59.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.100+0000 7f933cc00640 10 client.25202 handle_command_reply: tid=0 2024-08-28T20:17:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 client.25202 shutdown 2024-08-28T20:17:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166a9f0a0 msgr2=0x55f166e791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166a9f0a0 0x55f166e791e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f166e6c720 tx=0x7f93440ab650 comp rx=0 tx=0).stop 2024-08-28T20:17:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 shutdown_connections 2024-08-28T20:17:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a868e0 0x55f166e8b9d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166aa7280 0x55f166e79720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e85510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f933cc00640 0 client.25202 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 --2- 172.21.15.1:0/2065350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166a9f0a0 0x55f166e791e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 >> 172.21.15.1:0/2065350643 conn(0x55f166abc350 msgr2=0x55f166e70c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 shutdown_connections 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 1 -- 172.21.15.1:0/2065350643 wait complete. 2024-08-28T20:17:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.101+0000 7f9360fe3740 20 client.25202 trim_cache size 0 max 16384 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.120+0000 7f9360fe3740 1 Processor -- start 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.120+0000 7f9360fe3740 1 -- start start 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 0x55f166e85480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e74320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e74860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9360fe3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f166e89d10 con 0x55f166a9f0a0 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9360fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f166e8a3e0 con 0x55f166aa7280 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9360fe3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f166e8aab0 con 0x55f166ac7f60 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 0x55f166e85480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 0x55f166e85480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53348/0 (socket says 172.21.15.1:53348) 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 -- 172.21.15.1:0/1351168146 learned_addr learned my addr 172.21.15.1:0/1351168146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9352a00640 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e74320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353e00640 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e74860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 -- 172.21.15.1:0/1351168146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 msgr2=0x55f166e74860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e74860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 -- 172.21.15.1:0/1351168146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 msgr2=0x55f166e74320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e74320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.121+0000 7f9353400640 1 -- 172.21.15.1:0/1351168146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f166e7a280 con 0x55f166a9f0a0 2024-08-28T20:17:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.122+0000 7f9353400640 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 0x55f166e85480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f93440ab460 tx=0x7f9344005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd082909d15fd0a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.122+0000 7f933f400640 1 -- 172.21.15.1:0/1351168146 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440ab760 con 0x55f166a9f0a0 2024-08-28T20:17:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.122+0000 7f933f400640 1 -- 172.21.15.1:0/1351168146 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934405b070 con 0x55f166a9f0a0 2024-08-28T20:17:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.122+0000 7f933f400640 1 -- 172.21.15.1:0/1351168146 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440b4a80 con 0x55f166a9f0a0 2024-08-28T20:17:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 -- 172.21.15.1:0/1351168146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 msgr2=0x55f166e85480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 0x55f166e85480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f93440ab460 tx=0x7f9344005c10 comp rx=0 tx=0).stop 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 -- 172.21.15.1:0/1351168146 shutdown_connections 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166ac7f60 0x55f166e74860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e74320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1351168146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166a9f0a0 0x55f166e85480 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 -- 172.21.15.1:0/1351168146 >> 172.21.15.1:0/1351168146 conn(0x55f166abc350 msgr2=0x55f166e89470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 -- 172.21.15.1:0/1351168146 shutdown_connections 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 -- 172.21.15.1:0/1351168146 wait complete. 2024-08-28T20:17:59.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.123+0000 7f9360fe3740 1 -- start start 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 Processor -- start 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e94080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e8d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f166e8b850 con 0x55f166ac7f60 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f166e8b180 con 0x55f166aa7280 2024-08-28T20:17:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f166e8bf20 con 0x55f166a9f0a0 2024-08-28T20:17:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.124+0000 7f9360fe3740 10 client.0 _ll_register_callbacks cb 0x7f93440ab0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:17:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e8d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e8d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53364/0 (socket says 172.21.15.1:53364) 2024-08-28T20:17:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 -- 172.21.15.1:0/1593309339 learned_addr learned my addr 172.21.15.1:0/1593309339 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:17:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353400640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e94080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9352a00640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e94660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 -- 172.21.15.1:0/1593309339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 msgr2=0x55f166e94080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e94080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 -- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 msgr2=0x55f166e94660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e94660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353e00640 1 -- 172.21.15.1:0/1593309339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f166e8de20 con 0x55f166ac7f60 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9353400640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e94080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:59.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.125+0000 7f9352a00640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:17:59.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f9353e00640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e8d690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f934c0042e0 tx=0x7f934c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d25b0129633c14 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:17:59.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f933cc00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:17:59.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f933cc00640 1 -- 172.21.15.1:0/1593309339 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c004860 con 0x55f166ac7f60 2024-08-28T20:17:59.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f934405b070 con 0x55f166ac7f60 2024-08-28T20:17:59.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f933cc00640 1 -- 172.21.15.1:0/1593309339 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f934c00fc70 con 0x55f166ac7f60 2024-08-28T20:17:59.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f933cc00640 1 -- 172.21.15.1:0/1593309339 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f934c011020 con 0x55f166ac7f60 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f9360fe3740 10 client.15177 fetch_fsmap learned FSMap version 25 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f166e93900 con 0x55f166ac7f60 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.126+0000 7f933cc00640 1 -- 172.21.15.1:0/1593309339 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934405b070 con 0x55f166ac7f60 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f933cc00640 1 -- 172.21.15.1:0/1593309339 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f934c028420 con 0x55f166ac7f60 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9360fe3740 10 client.15177 fetch_fsmap finished waiting for FSMap version 25 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9360fe3740 10 client.15177 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T20:17:59.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9360fe3740 20 client.15177 populate_metadata read hostname 'smithi001' 2024-08-28T20:17:59.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a5bc90 0x55f166efa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:17:59.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9360fe3740 4 client.15177 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T20:17:59.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "status"}) -- 0x55f166de1f40 con 0x55f166a5bc90 2024-08-28T20:17:59.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.127+0000 7f9353400640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a5bc90 0x55f166efa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:17:59.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9353400640 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a5bc90 0x55f166efa440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7811b9cbc734dc60 server_cookie=c4e545ae3cf188c0 in_seq=0 out_seq=0 2024-08-28T20:17:59.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f933cc00640 10 client.15177 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:59.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f933cc00640 1 -- 172.21.15.1:0/1593309339 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f166de1f40 con 0x55f166a5bc90 2024-08-28T20:17:59.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f933cc00640 10 client.15177 handle_command_reply: tid=0 2024-08-28T20:17:59.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 client.15177 shutdown 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 msgr2=0x55f166e8d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e8d690 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f934c0042e0 tx=0x7f934c004a40 comp rx=0 tx=0).stop 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 shutdown_connections 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f166a5bc90 0x55f166efa440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f166ac7f60 0x55f166e8d690 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f166aa7280 0x55f166e94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 --2- 172.21.15.1:0/1593309339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f166a9f0a0 0x55f166e94080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 >> 172.21.15.1:0/1593309339 conn(0x55f166abc350 msgr2=0x55f166e6b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:59.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.128+0000 7f933cc00640 0 client.15177 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:17:59.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 shutdown_connections 2024-08-28T20:17:59.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9360fe3740 1 -- 172.21.15.1:0/1593309339 wait complete. 2024-08-28T20:17:59.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9360fe3740 20 client.15177 trim_cache size 0 max 16384 2024-08-28T20:17:59.141 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:17:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "f9e93946-6578-11ef-bcd4-c7b262605968", 2024-08-28T20:17:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-08-28T20:17:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24701, 2024-08-28T20:17:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-08-28T20:17:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 124.05807194499999, 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 25, 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 76, 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 76, 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 138.76964652699999 2024-08-28T20:17:59.142 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:17:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93380b4b30 msgr2=0x7f93380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9358c00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93380b4b30 0x7f93380b7040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f934c005fd0 tx=0x7f934c009500 comp rx=0 tx=0).stop 2024-08-28T20:17:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 msgr2=0x7f935419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:17:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.129+0000 7f9358c00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 0x7f935419a080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f934400d720 tx=0x7f934400dbe0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 shutdown_connections 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f93380b4b30 0x7f93380b7040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9354109070 0x7f935419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93541099c0 0x7f935419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 --2- 172.21.15.1:0/3399886622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9354103730 0x7f935419a080 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 >> 172.21.15.1:0/3399886622 conn(0x7f93540ff180 msgr2=0x7f93541015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:17:59.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 shutdown_connections 2024-08-28T20:17:59.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:17:59.130+0000 7f9358c00640 1 -- 172.21.15.1:0/3399886622 wait complete. 2024-08-28T20:17:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:17:59 smithi007 ceph-mon[25357]: pgmap v361: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:59.621 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:17:59 smithi001 ceph-mon[20984]: pgmap v361: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:17:59.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:17:59 smithi121 ceph-mon[25248]: pgmap v361: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-28T20:18:00.026 INFO:teuthology.run_tasks:Running task kclient... 2024-08-28T20:18:00.052 INFO:tasks.kclient:Mounting kernel clients... 2024-08-28T20:18:00.052 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-28T20:18:00.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:00.052 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-08-28T20:18:00.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:00.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-08-28T20:18:00.189 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-08-28T20:18:00.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:18:00.192 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-08-28T20:18:00.192 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-28T20:18:00.192 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-08-28T20:18:00.192 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-08-28T20:18:00.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-28T20:18:00.573 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 -- 172.21.15.1:0/3926676721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f8075550 msgr2=0x7f70f8075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 --2- 172.21.15.1:0/3926676721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f8075550 0x7f70f8075960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009900 tx=0x7f70e802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 -- 172.21.15.1:0/3926676721 shutdown_connections 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 --2- 172.21.15.1:0/3926676721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f810fe80 0x7f70f81122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 --2- 172.21.15.1:0/3926676721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70f8075ea0 0x7f70f810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 --2- 172.21.15.1:0/3926676721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f8075550 0x7f70f8075960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 -- 172.21.15.1:0/3926676721 >> 172.21.15.1:0/3926676721 conn(0x7f70f80ff370 msgr2=0x7f70f81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 -- 172.21.15.1:0/3926676721 shutdown_connections 2024-08-28T20:18:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.241+0000 7f70fe000640 1 -- 172.21.15.1:0/3926676721 wait complete. 2024-08-28T20:18:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.242+0000 7f70fe000640 1 Processor -- start 2024-08-28T20:18:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.242+0000 7f70fe000640 1 -- start start 2024-08-28T20:18:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70fe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 0x7f70f819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70fe000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70f8075ea0 0x7f70f819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f810fe80 0x7f70f81a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70fe000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8115a30 con 0x7f70f810fe80 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70fe000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81158b0 con 0x7f70f8075550 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70fe000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8115bb0 con 0x7f70f8075ea0 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 0x7f70f819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f810fe80 0x7f70f81a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 0x7f70f819c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43674/0 (socket says 172.21.15.1:43674) 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70f8075ea0 0x7f70f819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7400640 1 -- 172.21.15.1:0/1846143866 learned_addr learned my addr 172.21.15.1:0/1846143866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7e00640 1 -- 172.21.15.1:0/1846143866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70f8075ea0 msgr2=0x7f70f819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7e00640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70f8075ea0 0x7f70f819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7e00640 1 -- 172.21.15.1:0/1846143866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 msgr2=0x7f70f819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7e00640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 0x7f70f819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.243+0000 7f70f7e00640 1 -- 172.21.15.1:0/1846143866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f81a23b0 con 0x7f70f810fe80 2024-08-28T20:18:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70f7400640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 0x7f70f819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70f7e00640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f810fe80 0x7f70f81a1c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009fd0 tx=0x7f70f000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f000ce20 con 0x7f70f810fe80 2024-08-28T20:18:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70f0005020 con 0x7f70f810fe80 2024-08-28T20:18:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f81a26a0 con 0x7f70f810fe80 2024-08-28T20:18:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0010690 con 0x7f70f810fe80 2024-08-28T20:18:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.244+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81a8e00 con 0x7f70f810fe80 2024-08-28T20:18:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.245+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f8075960 con 0x7f70f810fe80 2024-08-28T20:18:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.250+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f70f00054d0 con 0x7f70f810fe80 2024-08-28T20:18:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.251+0000 7f70efe00640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70dc0b4b30 0x7f70dc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.251+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f70f00e57a0 con 0x7f70f810fe80 2024-08-28T20:18:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.251+0000 7f70f7400640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70dc0b4b30 0x7f70dc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.252+0000 7f70f7400640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70dc0b4b30 0x7f70dc0b7040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70e8031440 tx=0x7f70e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:01.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.254+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70f00ac860 con 0x7f70f810fe80 2024-08-28T20:18:01.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:01 smithi001 ceph-mon[20984]: pgmap v362: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:18:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.491+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f70f81a9130 con 0x7f70f810fe80 2024-08-28T20:18:01.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.491+0000 7f70efe00640 1 -- 172.21.15.1:0/1846143866 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f70f00ac160 con 0x7f70f810fe80 2024-08-28T20:18:01.493 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.493+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70dc0b4b30 msgr2=0x7f70dc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.493+0000 7f70fe000640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70dc0b4b30 0x7f70dc0b7040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70e8031440 tx=0x7f70e80058d0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.493+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f810fe80 msgr2=0x7f70f81a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.493+0000 7f70fe000640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f810fe80 0x7f70f81a1c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009fd0 tx=0x7f70f000ef10 comp rx=0 tx=0).stop 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 shutdown_connections 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f70dc0b4b30 0x7f70dc0b7040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70f810fe80 0x7f70f81a1c80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70f8075ea0 0x7f70f819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 --2- 172.21.15.1:0/1846143866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70f8075550 0x7f70f819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:01.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 >> 172.21.15.1:0/1846143866 conn(0x7f70f80ff370 msgr2=0x7f70f8109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:01.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 shutdown_connections 2024-08-28T20:18:01.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:01.494+0000 7f70fe000640 1 -- 172.21.15.1:0/1846143866 wait complete. 2024-08-28T20:18:01.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:01 smithi007 ceph-mon[25357]: pgmap v362: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:18:01.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:01 smithi121 ceph-mon[25248]: pgmap v362: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-28T20:18:02.185 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-28T20:18:02.186 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-28T20:18:02.186 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-08-28T20:18:02.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:02.186 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-08-28T20:18:02.222 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-28T20:18:02.223 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42145sec preferred_lft 42145sec 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-08-28T20:18:02.224 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-08-28T20:18:02.224 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-28T20:18:02.225 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-08-28T20:18:02.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T20:18:02.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:02 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/1846143866' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T20:18:02.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:02 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/1846143866' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T20:18:02.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:02.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:02.644 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-28T20:18:02.702 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-08-28T20:18:02.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:02.706 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-08-28T20:18:02.732 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:02 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/1846143866' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T20:18:02.754 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-08-28T20:18:02.754 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-28T20:18:02.754 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-28T20:18:02.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-28T20:18:02.754 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-28T20:18:02.755 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T20:18:02.755 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-08-28T20:18:02.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-28T20:18:02.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-28T20:18:02.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-28T20:18:02.755 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-08-28T20:18:02.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T20:18:03.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:03.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:03.349 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-08-28T20:18:03.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:03.385 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-08-28T20:18:03.461 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T20:18:03.461 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-08-28T20:18:03.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--tmp-cephfs 2024-08-28T20:18:03.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-08-28T20:18:03.461 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-08-28T20:18:03.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:03 smithi001 ceph-mon[20984]: pgmap v363: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:18:03.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T20:18:03.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:03 smithi007 ceph-mon[25357]: pgmap v363: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:18:03.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:03.616 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-08-28T20:18:03.616 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T20:18:03.616 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-08-28T20:18:03.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-08-28T20:18:03.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-28T20:18:03.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-08-28T20:18:03.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-08-28T20:18:03.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-08-28T20:18:03.617 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-08-28T20:18:03.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T20:18:03.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:03 smithi121 ceph-mon[25248]: pgmap v363: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-28T20:18:03.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:03.879 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T20:18:03.880 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-08-28T20:18:03.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-08-28T20:18:03.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-08-28T20:18:03.880 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-08-28T20:18:03.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T20:18:04.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:04.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-28T20:18:04.048 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /tmp/cephfs 2024-08-28T20:18:04.083 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/tmp/cephfs' 2024-08-28T20:18:04.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-28T20:18:04.084 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /tmp/cephfs 2024-08-28T20:18:04.158 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-28T20:18:04.159 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-28T20:18:04.159 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/94f8b253-5e25-406d-94ab-b0f8ba69907a 2024-08-28T20:18:04.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:04.159 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/94f8b253-5e25-406d-94ab-b0f8ba69907a /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-08-28T20:18:04.366 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-08-28T20:18:04.367 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-08-28T20:18:05.004 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-08-28T20:18:05.004 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-08-28T20:18:05.004 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:6789,172.21.15.7:6789,172.21.15.121:6789" 2024-08-28T20:18:05.004 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with new device syntax: 0@f9e93946-6578-11ef-bcd4-c7b262605968.cephfs=/volumes/qa/sv_1/94f8b253-5e25-406d-94ab-b0f8ba69907a 2024-08-28T20:18:05.005 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.1:6789/172.21.15.7:6789/172.21.15.121:6789" will pass to kernel 2024-08-28T20:18:05.010 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-28T20:18:05.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:18:05.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /tmp/cephfs 2024-08-28T20:18:05.069 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-28T20:18:05.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T20:18:05.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:05.162 INFO:teuthology.orchestra.run.smithi001.stdout:client25217 2024-08-28T20:18:05.162 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:18:05.162 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T20:18:05.198 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-28T20:18:05.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T20:18:05.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:05.330 INFO:teuthology.orchestra.run.smithi001.stdout:client25217 2024-08-28T20:18:05.331 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-28T20:18:05.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T20:18:05.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:05.421 INFO:teuthology.orchestra.run.smithi001.stdout:client25217 2024-08-28T20:18:05.422 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9e93946-6578-11ef-bcd4-c7b262605968.client25217/status') 2024-08-28T20:18:05.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T20:18:05.518 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:05 smithi001 ceph-mon[20984]: pgmap v364: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:18:05.521 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.25217 (3)172.21.15.1:0/2454022683 2024-08-28T20:18:05.522 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-08-28T20:18:05.522 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-08-28T20:18:05.522 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-08-28T20:18:05.522 INFO:teuthology.orchestra.run.smithi001.stderr:70 bytes copied, 5.6065e-05 s, 1.2 MB/s 2024-08-28T20:18:05.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T20:18:05.533 INFO:teuthology.run_tasks:Running task exec... 2024-08-28T20:18:05.543 INFO:teuthology.task.exec:Executing custom commands... 2024-08-28T20:18:05.543 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:18:05.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-28T20:18:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:05 smithi007 ceph-mon[25357]: pgmap v364: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:18:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:05 smithi121 ceph-mon[25248]: pgmap v364: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-08-28T20:18:05.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 -- 172.21.15.1:0/3456475259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c1043b0 msgr2=0x7efe0c1047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 --2- 172.21.15.1:0/3456475259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c1043b0 0x7efe0c1047c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009900 tx=0x7efdf402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 -- 172.21.15.1:0/3456475259 shutdown_connections 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 --2- 172.21.15.1:0/3456475259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c1043b0 0x7efe0c1047c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 --2- 172.21.15.1:0/3456475259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c104d50 0x7efe0c10b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 --2- 172.21.15.1:0/3456475259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c1037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 -- 172.21.15.1:0/3456475259 >> 172.21.15.1:0/3456475259 conn(0x7efe0c0fec50 msgr2=0x7efe0c101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 -- 172.21.15.1:0/3456475259 shutdown_connections 2024-08-28T20:18:05.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.764+0000 7efe11400640 1 -- 172.21.15.1:0/3456475259 wait complete. 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.765+0000 7efe11400640 1 Processor -- start 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.765+0000 7efe11400640 1 -- start start 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe11400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe11400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 0x7efe0c19c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe11400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c104d50 0x7efe0c19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe11400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10ef10 con 0x7efe0c104d50 2024-08-28T20:18:05.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe11400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10ed90 con 0x7efe0c1043b0 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe11400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c10f090 con 0x7efe0c103330 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 0x7efe0c19c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe0be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe10a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c104d50 0x7efe0c19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 0x7efe0c19c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43694/0 (socket says 172.21.15.1:43694) 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe0be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47454/0 (socket says 172.21.15.1:47454) 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe03400640 1 -- 172.21.15.1:0/3679572859 learned_addr learned my addr 172.21.15.1:0/3679572859 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.766+0000 7efe0be00640 1 -- 172.21.15.1:0/3679572859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 msgr2=0x7efe0c19c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe0be00640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 0x7efe0c19c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:05.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe0be00640 1 -- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c104d50 msgr2=0x7efe0c19cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe0be00640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c104d50 0x7efe0c19cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe0be00640 1 -- 172.21.15.1:0/3679572859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c19d7a0 con 0x7efe0c103330 2024-08-28T20:18:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe03400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 0x7efe0c19c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe10a00640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c104d50 0x7efe0c19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:05.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe0be00640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c19bd60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00e9f0 tx=0x7efdfc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00ccc0 con 0x7efe0c103330 2024-08-28T20:18:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c19da90 con 0x7efe0c103330 2024-08-28T20:18:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdfc005020 con 0x7efe0c103330 2024-08-28T20:18:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc004a00 con 0x7efe0c103330 2024-08-28T20:18:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.767+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c1a4180 con 0x7efe0c103330 2024-08-28T20:18:05.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.768+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0c1037a0 con 0x7efe0c103330 2024-08-28T20:18:05.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.771+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7efdfc004ba0 con 0x7efe0c103330 2024-08-28T20:18:05.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.772+0000 7efe09600640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7efdf00b4b20 0x7efdf00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:05.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.772+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7efdfc0e5190 con 0x7efe0c103330 2024-08-28T20:18:05.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.773+0000 7efe03400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7efdf00b4b20 0x7efdf00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:05.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.773+0000 7efe03400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7efdf00b4b20 0x7efdf00b7030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efdf4031a50 tx=0x7efdf40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:05.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:05.774+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efdfc0ac2e0 con 0x7efe0c103330 2024-08-28T20:18:06.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.010+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7efe0c1a4950 con 0x7efe0c103330 2024-08-28T20:18:06.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.277+0000 7efe09600640 1 -- 172.21.15.1:0/3679572859 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7efdfc0abbe0 con 0x7efe0c103330 2024-08-28T20:18:06.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7efdf00b4b20 msgr2=0x7efdf00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:06.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7efdf00b4b20 0x7efdf00b7030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efdf4031a50 tx=0x7efdf40314a0 comp rx=0 tx=0).stop 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 msgr2=0x7efe0c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c19bd60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00e9f0 tx=0x7efdfc00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 shutdown_connections 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7efdf00b4b20 0x7efdf00b7030 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe0c104d50 0x7efe0c19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe0c1043b0 0x7efe0c19c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 --2- 172.21.15.1:0/3679572859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe0c103330 0x7efe0c19bd60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 >> 172.21.15.1:0/3679572859 conn(0x7efe0c0fec50 msgr2=0x7efe0c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 shutdown_connections 2024-08-28T20:18:06.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:18:06.279+0000 7efe11400640 1 -- 172.21.15.1:0/3679572859 wait complete. 2024-08-28T20:18:06.303 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-28T20:18:06.331 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-28T20:18:06.350 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:18:06.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-28T20:18:06.354 INFO:teuthology.run_tasks:Running task exec... 2024-08-28T20:18:06.382 INFO:teuthology.task.exec:Executing custom commands... 2024-08-28T20:18:06.383 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:18:06.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-08-28T20:18:06.458 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:06.486 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem Size Used Avail Use% Mounted on 2024-08-28T20:18:06.486 INFO:teuthology.orchestra.run.smithi001.stdout:0@f9e93946-6578-11ef-bcd4-c7b262605968.cephfs=/volumes/qa/sv_1/94f8b253-5e25-406d-94ab-b0f8ba69907a 340G 0 340G 0% /tmp/cephfs 2024-08-28T20:18:06.491 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-08-28T20:18:06.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:06 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3679572859' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T20:18:06.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:06 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T20:18:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:06 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3679572859' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T20:18:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:06 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T20:18:06.597 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-08-28T20:18:06.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-08-28T20:18:06.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:06 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3679572859' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T20:18:06.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:06 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T20:18:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:07 smithi007 ceph-mon[25357]: pgmap v365: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:18:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:07 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-28T20:18:07.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:07 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:07 smithi001 ceph-mon[20984]: pgmap v365: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:18:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:07 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-28T20:18:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:07 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:07 smithi121 ceph-mon[25248]: pgmap v365: 97 pgs: 97 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-28T20:18:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:07 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-28T20:18:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:07 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:08.610 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-08-28T20:18:08.687 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-08-28T20:18:08.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-08-28T20:18:08.777 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-08-28T20:18:08.856 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/: 2024-08-28T20:18:08.856 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 .. 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 data 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data: 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:08.857 INFO:teuthology.orchestra.run.smithi001.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 .. 2024-08-28T20:18:08.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-08-28T20:18:08.958 INFO:teuthology.orchestra.run.smithi001.stdout:[Service] 2024-08-28T20:18:08.959 INFO:teuthology.orchestra.run.smithi001.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-08-28T20:18:08.959 INFO:teuthology.orchestra.run.smithi001.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-08-28T20:18:08.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-08-28T20:18:09.127 INFO:teuthology.orchestra.run.smithi001.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-08-28T20:18:09.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:09 smithi007 ceph-mon[25357]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-28T20:18:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:09 smithi001 ceph-mon[20984]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-28T20:18:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:09 smithi121 ceph-mon[25248]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-28T20:18:11.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:11 smithi007 ceph-mon[25357]: pgmap v367: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-28T20:18:11.586 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:11 smithi001 ceph-mon[20984]: pgmap v367: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-28T20:18:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:11 smithi121 ceph-mon[25248]: pgmap v367: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-28T20:18:13.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:13 smithi007 ceph-mon[25357]: pgmap v368: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-08-28T20:18:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:13 smithi001 ceph-mon[20984]: pgmap v368: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-08-28T20:18:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:13 smithi121 ceph-mon[25248]: pgmap v368: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-08-28T20:18:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:15 smithi121 ceph-mon[25248]: pgmap v369: 97 pgs: 97 active+clean; 22 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 MiB/s wr, 22 op/s 2024-08-28T20:18:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:18:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:15.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:15 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:15 smithi007 ceph-mon[25357]: pgmap v369: 97 pgs: 97 active+clean; 22 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 MiB/s wr, 22 op/s 2024-08-28T20:18:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:18:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:15 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:15.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:15 smithi001 ceph-mon[20984]: pgmap v369: 97 pgs: 97 active+clean; 22 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 MiB/s wr, 22 op/s 2024-08-28T20:18:15.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:18:15.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:15.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:15 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:16.404 INFO:teuthology.orchestra.run.smithi001.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-08-28T20:18:16.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-08-28T20:18:16.554 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/: 2024-08-28T20:18:16.554 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.554 INFO:teuthology.orchestra.run.smithi001.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:18:16.554 INFO:teuthology.orchestra.run.smithi001.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 .. 2024-08-28T20:18:16.554 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 data 2024-08-28T20:18:16.554 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data: 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:total 35 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 . 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 .. 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 base 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Aug 28 20:18 global 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 log 2024-08-28T20:18:16.555 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_commit_ts 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_dynshmem 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Aug 28 20:18 pg_hba.conf 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 28 20:18 pg_ident.conf 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 pg_logical 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 pg_multixact 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_notify 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_replslot 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_serial 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_snapshots 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_stat 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_stat_tmp 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 pg_subtrans 2024-08-28T20:18:16.556 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_tblspc 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_twophase 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 pg_wal 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 pg_xact 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 28 20:18 postgresql.auto.conf 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Aug 28 20:18 postgresql.conf 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base: 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 . 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 1 2024-08-28T20:18:16.557 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 13493 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 13494 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/1: 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:total 7777 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 . 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 .. 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 112 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 113 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 1247 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1247_fsm 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1247_vm 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 28 20:18 1249 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1249_fsm 2024-08-28T20:18:16.558 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1249_vm 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 28 20:18 1255 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1255_fsm 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1255_vm 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 28 20:18 1259 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1259_fsm 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1259_vm 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 28 20:18 13344 2024-08-28T20:18:16.559 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13344_fsm 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13344_vm 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13346 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13348 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13349_fsm 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349_vm 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13351 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13353 2024-08-28T20:18:16.560 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13354_fsm 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354_vm 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13356 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13358 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13359_fsm 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359_vm 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13361 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13363 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1417 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1418 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 174 2024-08-28T20:18:16.561 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 175 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2187 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2224 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2328 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2336 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2337 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2579 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2600 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2600_fsm 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2600_vm 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2601_fsm 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601_vm 2024-08-28T20:18:16.562 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2602 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2602_fsm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2602_vm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2603 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2603_fsm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2603_vm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2604 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2605 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2605_fsm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2605_vm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2606_fsm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606_vm 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2607 2024-08-28T20:18:16.563 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2607_fsm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2607_vm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 28 20:18 2608 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2608_fsm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2608_vm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 28 20:18 2609 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2609_fsm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2609_vm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2610 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2610_fsm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2610_vm 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2611 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612 2024-08-28T20:18:16.564 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2612_fsm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612_vm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2613 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2615_fsm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615_vm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2616 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2616_fsm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2616_vm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 28 20:18 2617 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2617_fsm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2617_vm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 28 20:18 2618 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2618_fsm 2024-08-28T20:18:16.565 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2618_vm 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 28 20:18 2619 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2619_fsm 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2619_vm 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2620 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2650 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2651 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2652 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2653 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2654 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2655 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2656 2024-08-28T20:18:16.566 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2657 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 28 20:18 2658 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 2659 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2660 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2661 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2662 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2663 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2664 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2665 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2666 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2667 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2668 2024-08-28T20:18:16.567 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2669 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2670 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 28 20:18 2673 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 28 20:18 2674 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 28 20:18 2675 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2678 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2679 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2680 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2681 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2682 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2683 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2684 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2685 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2686 2024-08-28T20:18:16.568 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2687 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2688 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2689 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 28 20:18 2690 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 28 20:18 2691 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2692 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2693 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2696 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2699 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2701 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2702 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2703 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2704 2024-08-28T20:18:16.569 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2753 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2753_fsm 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2753_vm 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2754 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2755 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2756 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2757 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2830 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2831 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2832 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2833 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2834 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2835 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2836 2024-08-28T20:18:16.570 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2837 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 28 20:18 2838 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2838_fsm 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2838_vm 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2839 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840_fsm 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2840_vm 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2841 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2995 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2996 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3079_fsm 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079_vm 2024-08-28T20:18:16.571 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3080 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3081 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3085 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3118 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3119 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:18 3164 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3256 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3257 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3258 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3350 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3351 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3379 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3380 2024-08-28T20:18:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3381 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3394 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3394_fsm 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3394_vm 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3395 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3429 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3430 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3431 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3433 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3439 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3440 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3455 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 28 20:18 3456 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3456_fsm 2024-08-28T20:18:16.573 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3456_vm 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3466 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3467 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3468 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3501 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3502 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3503 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3534 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3541_fsm 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541_vm 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3542 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3574 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3575 2024-08-28T20:18:16.574 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3576 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3596 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3597 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3598 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3599 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3600_fsm 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600_vm 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3601_fsm 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601_vm 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3602_fsm 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602_vm 2024-08-28T20:18:16.575 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603_fsm 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3603_vm 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3604 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3605 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3606 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3607 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3608 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 3609 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3712 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3764_fsm 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764_vm 2024-08-28T20:18:16.576 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3766 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3767 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3997 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4143 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4144 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4145 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4146 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4147 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4148 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4149 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4150 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4151 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4152 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4153 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4154 2024-08-28T20:18:16.577 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4155 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4156 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4157 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4158 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4159 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4160 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4161 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4162 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4163 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4164 2024-08-28T20:18:16.578 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4165 2024-08-28T20:18:16.579 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4166 2024-08-28T20:18:16.579 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4167 2024-08-28T20:18:16.579 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4168 2024-08-28T20:18:16.579 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4169 2024-08-28T20:18:16.579 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4170 2024-08-28T20:18:16.579 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4171 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4172 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4173 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4174 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 5002 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 548 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 549 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6102 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6104 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6106 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6110 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6111 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6112 2024-08-28T20:18:16.580 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6113 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6117 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 826 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 827 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 828 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:total 7777 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 . 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 .. 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 112 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 113 2024-08-28T20:18:16.581 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 1247 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1247_fsm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1247_vm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 28 20:18 1249 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1249_fsm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1249_vm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 28 20:18 1255 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1255_fsm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1255_vm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 28 20:18 1259 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1259_fsm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1259_vm 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 28 20:18 13344 2024-08-28T20:18:16.582 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13344_fsm 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13344_vm 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13346 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13348 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13349_fsm 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349_vm 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13351 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13353 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13354_fsm 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354_vm 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13356 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13358 2024-08-28T20:18:16.583 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13359_fsm 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359_vm 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13361 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13363 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1417 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1418 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 174 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 175 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2187 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2224 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2328 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2336 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2337 2024-08-28T20:18:16.584 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2579 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2600 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2600_fsm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2600_vm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2601_fsm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601_vm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2602 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2602_fsm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2602_vm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2603 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2603_fsm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2603_vm 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2604 2024-08-28T20:18:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2605 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2605_fsm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2605_vm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2606_fsm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606_vm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2607 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2607_fsm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2607_vm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 28 20:18 2608 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2608_fsm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2608_vm 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 28 20:18 2609 2024-08-28T20:18:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2609_fsm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2609_vm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2610 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2610_fsm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2610_vm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2611 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2612_fsm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612_vm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2613 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2615_fsm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615_vm 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2616 2024-08-28T20:18:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2616_fsm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2616_vm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 28 20:18 2617 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2617_fsm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2617_vm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 28 20:18 2618 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2618_fsm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2618_vm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 28 20:18 2619 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2619_fsm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2619_vm 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2620 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2650 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2651 2024-08-28T20:18:16.588 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2652 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2653 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2654 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2655 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2656 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2657 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 28 20:18 2658 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 2659 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2660 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2661 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2662 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2663 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2664 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2665 2024-08-28T20:18:16.589 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2666 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2667 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2668 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2669 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2670 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 28 20:18 2673 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 28 20:18 2674 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 28 20:18 2675 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2678 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2679 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2680 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2681 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2682 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2683 2024-08-28T20:18:16.590 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2684 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2685 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2686 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2687 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2688 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2689 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 28 20:18 2690 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 28 20:18 2691 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2692 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2693 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2696 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2699 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2701 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2702 2024-08-28T20:18:16.591 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2703 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2704 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2753 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2753_fsm 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2753_vm 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2754 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2755 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2756 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2757 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2830 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2831 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2832 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2833 2024-08-28T20:18:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2834 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2835 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2836 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2837 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 28 20:18 2838 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2838_fsm 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2838_vm 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2839 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840_fsm 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2840_vm 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2841 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2995 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2996 2024-08-28T20:18:16.593 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3079_fsm 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079_vm 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3080 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3081 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3085 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3118 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3119 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:18 3164 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3256 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3257 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3258 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3350 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3351 2024-08-28T20:18:16.594 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3379 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3380 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3381 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3394 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3394_fsm 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3394_vm 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3395 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3429 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3430 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3431 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3433 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3439 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3440 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3455 2024-08-28T20:18:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 28 20:18 3456 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3456_fsm 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3456_vm 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3466 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3467 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3468 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3501 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3502 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3503 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3534 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3541_fsm 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541_vm 2024-08-28T20:18:16.596 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3542 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3574 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3575 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3576 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3596 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3597 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3598 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3599 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3600_fsm 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600_vm 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3601_fsm 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601_vm 2024-08-28T20:18:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3602_fsm 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602_vm 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603_fsm 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3603_vm 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3604 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3605 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3606 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3607 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3608 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 3609 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3712 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764 2024-08-28T20:18:16.598 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3764_fsm 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764_vm 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3766 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3767 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3997 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4143 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4144 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4145 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4146 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4147 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4148 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4149 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4150 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4151 2024-08-28T20:18:16.599 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4152 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4153 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4154 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4155 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4156 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4157 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4158 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4159 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4160 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4161 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4162 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4163 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4164 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4165 2024-08-28T20:18:16.600 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4166 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4167 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4168 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4169 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4170 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4171 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4172 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4173 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4174 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 5002 2024-08-28T20:18:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 548 2024-08-28T20:18:16.602 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 549 2024-08-28T20:18:16.602 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6102 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6104 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6106 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6110 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6111 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6112 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6113 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6117 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 826 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 827 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 828 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.603 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:total 7777 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 . 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 .. 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 112 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 113 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 1247 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1247_fsm 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1247_vm 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 28 20:18 1249 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1249_fsm 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1249_vm 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 28 20:18 1255 2024-08-28T20:18:16.604 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1255_fsm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1255_vm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 28 20:18 1259 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1259_fsm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1259_vm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 28 20:18 13344 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13344_fsm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13344_vm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13346 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13348 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13349_fsm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349_vm 2024-08-28T20:18:16.605 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13351 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13353 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13354_fsm 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354_vm 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13356 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13358 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13359_fsm 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359_vm 2024-08-28T20:18:16.606 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13361 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13363 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1417 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1418 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 174 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 175 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2187 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2224 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2328 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2336 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2337 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2579 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2600 2024-08-28T20:18:16.607 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2600_fsm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2600_vm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2601_fsm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601_vm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2602 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2602_fsm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2602_vm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2603 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2603_fsm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2603_vm 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2604 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2605 2024-08-28T20:18:16.608 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2605_fsm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2605_vm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2606_fsm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606_vm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2607 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2607_fsm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2607_vm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 28 20:18 2608 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2608_fsm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2608_vm 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 28 20:18 2609 2024-08-28T20:18:16.609 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2609_fsm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2609_vm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2610 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2610_fsm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2610_vm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2611 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2612_fsm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612_vm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2613 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2615_fsm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615_vm 2024-08-28T20:18:16.610 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2616 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2616_fsm 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2616_vm 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 28 20:18 2617 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2617_fsm 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2617_vm 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 28 20:18 2618 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2618_fsm 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2618_vm 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 28 20:18 2619 2024-08-28T20:18:16.611 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2619_fsm 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2619_vm 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2620 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2650 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2651 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2652 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2653 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2654 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2655 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2656 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2657 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 28 20:18 2658 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 2659 2024-08-28T20:18:16.612 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2660 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2661 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2662 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2663 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2664 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2665 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2666 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2667 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2668 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2669 2024-08-28T20:18:16.613 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2670 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 28 20:18 2673 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 28 20:18 2674 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 28 20:18 2675 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2678 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2679 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2680 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2681 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2682 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2683 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2684 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2685 2024-08-28T20:18:16.614 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2686 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2687 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2688 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2689 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 28 20:18 2690 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 28 20:18 2691 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2692 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2693 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2696 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2699 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2701 2024-08-28T20:18:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2702 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2703 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2704 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2753 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2753_fsm 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2753_vm 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2754 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2755 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2756 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2757 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2830 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2831 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2832 2024-08-28T20:18:16.616 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2833 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2834 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2835 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2836 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2837 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 28 20:18 2838 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2838_fsm 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2838_vm 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2839 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840_fsm 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2840_vm 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2841 2024-08-28T20:18:16.617 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2995 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2996 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3079_fsm 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079_vm 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3080 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3081 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3085 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3118 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3119 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:18 3164 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3256 2024-08-28T20:18:16.618 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3257 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3258 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3350 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3351 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3379 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3380 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3381 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3394 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3394_fsm 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3394_vm 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3395 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3429 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3430 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3431 2024-08-28T20:18:16.619 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3433 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3439 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3440 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3455 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 28 20:18 3456 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3456_fsm 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3456_vm 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3466 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3467 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3468 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3501 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3502 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3503 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3534 2024-08-28T20:18:16.620 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3541_fsm 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541_vm 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3542 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3574 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3575 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3576 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3596 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3597 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3598 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3599 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3600_fsm 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600_vm 2024-08-28T20:18:16.621 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3601_fsm 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601_vm 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3602_fsm 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602_vm 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603_fsm 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3603_vm 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3604 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3605 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3606 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3607 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3608 2024-08-28T20:18:16.622 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 3609 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3712 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3764_fsm 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764_vm 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3766 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3767 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3997 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4143 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4144 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4145 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4146 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4147 2024-08-28T20:18:16.623 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4148 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4149 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4150 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4151 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4152 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4153 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4154 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4155 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4156 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4157 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4158 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4159 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4160 2024-08-28T20:18:16.624 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4161 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4162 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4163 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4164 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4165 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4166 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4167 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4168 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4169 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4170 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4171 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4172 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4173 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4174 2024-08-28T20:18:16.625 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 5002 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 548 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 549 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6102 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6104 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6106 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6110 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6111 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6112 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6113 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6117 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 826 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 827 2024-08-28T20:18:16.626 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 828 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/global: 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:total 537 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Aug 28 20:18 . 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1213 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1213_fsm 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1213_vm 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1214 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1214_fsm 2024-08-28T20:18:16.627 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1214_vm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 1232 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 1233 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1260 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1260_fsm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1260_vm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1261 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1261_fsm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1261_vm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1262 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1262_fsm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1262_vm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2396 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2396_fsm 2024-08-28T20:18:16.628 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2396_vm 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2397 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2671 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2672 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2676 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2677 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2694 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2695 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2697 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2698 2024-08-28T20:18:16.629 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2846 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2847 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2964 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2965 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2966 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2967 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3592 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3593 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4060 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4061 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4175 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4176 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4177 2024-08-28T20:18:16.630 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4178 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4181 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4182 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4183 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4184 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4185 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4186 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6000 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6001 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6002 2024-08-28T20:18:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6100 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6114 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6115 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 pg_control 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/log: 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.632 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:total 1 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 . 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 mappings 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 28 20:18 replorigin_checkpoint 2024-08-28T20:18:16.633 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 snapshots 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 .. 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 .. 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-08-28T20:18:16.634 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 . 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 members 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 offsets 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:total 8 2024-08-28T20:18:16.635 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:18:16.636 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 .. 2024-08-28T20:18:16.636 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 0000 2024-08-28T20:18:16.636 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.636 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-08-28T20:18:16.636 INFO:teuthology.orchestra.run.smithi001.stdout:total 8 2024-08-28T20:18:16.636 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 .. 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 0000 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.637 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:total 8 2024-08-28T20:18:16.639 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 0000 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.640 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:total 16384 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 . 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:18 000000010000000000000001 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 archive_status 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 .. 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:18:16.641 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-08-28T20:18:16.642 INFO:teuthology.orchestra.run.smithi001.stdout:total 8 2024-08-28T20:18:16.642 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:18:16.642 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 28 20:18 .. 2024-08-28T20:18:16.642 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 0000 2024-08-28T20:18:16.642 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-08-28T20:18:16.873 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-08-28T20:18:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:dropping old tables... 2024-08-28T20:18:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-08-28T20:18:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-08-28T20:18:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-08-28T20:18:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-08-28T20:18:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:creating tables... 2024-08-28T20:18:16.994 INFO:teuthology.orchestra.run.smithi001.stderr:generating data (client-side)... 2024-08-28T20:18:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.14 s, remaining 4.32 s) 2024-08-28T20:18:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:17 smithi001 ceph-mon[20984]: pgmap v370: 97 pgs: 97 active+clean; 25 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 2.1 MiB/s wr, 31 op/s 2024-08-28T20:18:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:17 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:17 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:17 smithi007 ceph-mon[25357]: pgmap v370: 97 pgs: 97 active+clean; 25 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 2.1 MiB/s wr, 31 op/s 2024-08-28T20:18:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:17 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:17 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:17.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:17 smithi121 ceph-mon[25248]: pgmap v370: 97 pgs: 97 active+clean; 25 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 2.1 MiB/s wr, 31 op/s 2024-08-28T20:18:17.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:17 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:17.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:17 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:17.521 INFO:teuthology.orchestra.run.smithi001.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.50 s, remaining 7.49 s) 2024-08-28T20:18:17.832 INFO:teuthology.orchestra.run.smithi001.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.81 s, remaining 7.83 s) 2024-08-28T20:18:18.009 INFO:teuthology.orchestra.run.smithi001.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.99 s, remaining 6.91 s) 2024-08-28T20:18:18.320 INFO:teuthology.orchestra.run.smithi001.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.30 s, remaining 7.01 s) 2024-08-28T20:18:18.636 INFO:teuthology.orchestra.run.smithi001.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.61 s, remaining 7.00 s) 2024-08-28T20:18:18.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:18:18.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:18:18.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.729 INFO:teuthology.orchestra.run.smithi001.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.71 s, remaining 6.10 s) 2024-08-28T20:18:18.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:18:18.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:18:18.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:18.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:18:18.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:18:18.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:18:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:800000 of 3200000 tuples (25%) done (elapsed 2.10 s, remaining 6.30 s) 2024-08-28T20:18:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:900000 of 3200000 tuples (28%) done (elapsed 2.40 s, remaining 6.14 s) 2024-08-28T20:18:19.521 INFO:teuthology.orchestra.run.smithi001.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.50 s, remaining 5.50 s) 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 -- 172.21.15.1:0/332910463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc1044d0 msgr2=0x7f5fbc1048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 --2- 172.21.15.1:0/332910463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc1048e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009860 tx=0x7f5fa802a340 comp rx=0 tx=0).stop 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 -- 172.21.15.1:0/332910463 shutdown_connections 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 --2- 172.21.15.1:0/332910463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc104e70 0x7f5fbc10b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 --2- 172.21.15.1:0/332910463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc1048e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 --2- 172.21.15.1:0/332910463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc103450 0x7f5fbc1038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 -- 172.21.15.1:0/332910463 >> 172.21.15.1:0/332910463 conn(0x7f5fbc0fed90 msgr2=0x7f5fbc101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 -- 172.21.15.1:0/332910463 shutdown_connections 2024-08-28T20:18:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.630+0000 7f5fc3600640 1 -- 172.21.15.1:0/332910463 wait complete. 2024-08-28T20:18:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.632+0000 7f5fc3600640 1 Processor -- start 2024-08-28T20:18:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.632+0000 7f5fc3600640 1 -- start start 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.632+0000 7f5fc3600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 0x7f5fbc199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.632+0000 7f5fc3600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.632+0000 7f5fc3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc104e70 0x7f5fbc19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.632+0000 7f5fc3600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10f0d0 con 0x7f5fbc103450 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc3600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10ef50 con 0x7f5fbc104e70 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc3600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc10f250 con 0x7f5fbc1044d0 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 0x7f5fbc199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 0x7f5fbc199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42040/0 (socket says 172.21.15.1:42040) 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc0c00640 1 -- 172.21.15.1:0/2907782782 learned_addr learned my addr 172.21.15.1:0/2907782782 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc104e70 0x7f5fbc19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fbbe00640 1 -- 172.21.15.1:0/2907782782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc104e70 msgr2=0x7f5fbc19af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc104e70 0x7f5fbc19af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fbbe00640 1 -- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 msgr2=0x7f5fbc199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 0x7f5fbc199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fbbe00640 1 -- 172.21.15.1:0/2907782782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc19b750 con 0x7f5fbc1044d0 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 0x7f5fbc199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.633+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc104e70 0x7f5fbc19af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.634+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc19a380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fa802a860 tx=0x7f5fa8032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.634+0000 7f5fb9600640 1 -- 172.21.15.1:0/2907782782 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8040020 con 0x7f5fbc1044d0 2024-08-28T20:18:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.634+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc19b9e0 con 0x7f5fbc1044d0 2024-08-28T20:18:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.634+0000 7f5fb9600640 1 -- 172.21.15.1:0/2907782782 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fa8030810 con 0x7f5fbc1044d0 2024-08-28T20:18:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.634+0000 7f5fb9600640 1 -- 172.21.15.1:0/2907782782 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8037040 con 0x7f5fbc1044d0 2024-08-28T20:18:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.634+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc1a2130 con 0x7f5fbc1044d0 2024-08-28T20:18:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.637+0000 7f5fca61b740 1 Processor -- start 2024-08-28T20:18:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.637+0000 7f5fca61b740 1 -- start start 2024-08-28T20:18:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fb9600640 1 -- 172.21.15.1:0/2907782782 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f5fa8043020 con 0x7f5fbc1044d0 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb6d1b0 0x55aedff171d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb442f0 0x55aedff17840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff18390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fca61b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55aedfe85f70 con 0x55aedfb6d1b0 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fca61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aedfe75500 con 0x55aedfb4c4d0 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fca61b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55aedfe794b0 con 0x55aedfb442f0 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff18390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fc1600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb6d1b0 0x55aedff171d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fc1600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb6d1b0 0x55aedff171d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42046/0 (socket says 172.21.15.1:42046) 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff18390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:37978/0 (socket says 172.21.15.1:37978) 2024-08-28T20:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fc1600640 1 -- 172.21.15.1:0/2789411208 learned_addr learned my addr 172.21.15.1:0/2789411208 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb442f0 0x55aedff17840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 -- 172.21.15.1:0/2789411208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb442f0 msgr2=0x55aedff17840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb442f0 0x55aedff17840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 -- 172.21.15.1:0/2789411208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb6d1b0 msgr2=0x55aedff171d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb6d1b0 0x55aedff171d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.638+0000 7f5fbbe00640 1 -- 172.21.15.1:0/2789411208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aedfe2fc10 con 0x55aedfb4c4d0 2024-08-28T20:18:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.639+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff18390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8102690 tx=0x7f5fa8108c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1580ab860ef77e71 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.639+0000 7f5fadc00640 1 -- 172.21.15.1:0/2789411208 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8114070 con 0x55aedfb4c4d0 2024-08-28T20:18:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.639+0000 7f5fadc00640 1 -- 172.21.15.1:0/2789411208 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fa8110460 con 0x55aedfb4c4d0 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.639+0000 7f5fadc00640 1 -- 172.21.15.1:0/2789411208 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa810f620 con 0x55aedfb4c4d0 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 -- 172.21.15.1:0/2789411208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 msgr2=0x55aedff18390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff18390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8102690 tx=0x7f5fa8108c90 comp rx=0 tx=0).stop 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 -- 172.21.15.1:0/2789411208 shutdown_connections 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff18390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb442f0 0x55aedff17840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2789411208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb6d1b0 0x55aedff171d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.640+0000 7f5fca61b740 1 -- 172.21.15.1:0/2789411208 >> 172.21.15.1:0/2789411208 conn(0x55aedfb61300 msgr2=0x55aedff0e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.641+0000 7f5fb9600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5fa40b4bb0 0x7f5fa40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.641+0000 7f5fca61b740 1 -- 172.21.15.1:0/2789411208 shutdown_connections 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.641+0000 7f5fca61b740 1 -- 172.21.15.1:0/2789411208 wait complete. 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.641+0000 7f5fb9600640 1 -- 172.21.15.1:0/2907782782 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5fa8104c60 con 0x7f5fbc1044d0 2024-08-28T20:18:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.641+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5fa40b4bb0 0x7f5fa40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.641+0000 7f5fca61b740 1 -- start start 2024-08-28T20:18:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.642+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5fa40b4bb0 0x7f5fa40b70c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005c10 tx=0x7f5fb40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.642+0000 7f5fca61b740 1 Processor -- start 2024-08-28T20:18:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.642+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff20570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff20c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff217a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fca61b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55aedfdaeab0 con 0x55aedfb442f0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fca61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aedfe1c320 con 0x55aedfb6d1b0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fca61b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55aedff18c70 con 0x55aedfb4c4d0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fca61b740 10 client.0 _ll_register_callbacks cb 0x55aedfe226a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff217a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:37986/0 (socket says 172.21.15.1:37986) 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 -- 172.21.15.1:0/2193965749 learned_addr learned my addr 172.21.15.1:0/2193965749 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff20c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff20570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 -- 172.21.15.1:0/2193965749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 msgr2=0x55aedff20c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff20c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 -- 172.21.15.1:0/2193965749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 msgr2=0x55aedff20570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff20570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc1600640 1 -- 172.21.15.1:0/2193965749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aedfbd8790 con 0x55aedfb6d1b0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.643+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff20570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fc1600640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff217a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5fb401b490 tx=0x7f5fb4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4565331ad8a1d29 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fa2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fa2000640 1 -- 172.21.15.1:0/2193965749 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb40197e0 con 0x55aedfb6d1b0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fa2000640 1 -- 172.21.15.1:0/2193965749 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5fb4019980 con 0x55aedfb6d1b0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fa8110460 con 0x55aedfb6d1b0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fa2000640 1 -- 172.21.15.1:0/2193965749 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fb4019b80 con 0x55aedfb6d1b0 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fca61b740 10 client.25235 fetch_fsmap learned FSMap version 27 2024-08-28T20:18:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aedfc51620 con 0x55aedfb6d1b0 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.644+0000 7f5fa2000640 1 -- 172.21.15.1:0/2193965749 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fa8110460 con 0x55aedfb6d1b0 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fa2000640 1 -- 172.21.15.1:0/2193965749 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f5fb400b040 con 0x55aedfb6d1b0 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fca61b740 10 client.25235 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fca61b740 10 client.25235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fca61b740 20 client.25235 populate_metadata read hostname 'smithi001' 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb2bd80 0x55aedff2de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fca61b740 4 client.25235 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aedfe87ec0 con 0x55aedfb2bd80 2024-08-28T20:18:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.645+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb2bd80 0x55aedff2de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.646+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb2bd80 0x55aedff2de90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf43c95859dd744 server_cookie=71d7326a07028da8 in_seq=0 out_seq=0 2024-08-28T20:18:19.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.646+0000 7f5fa2000640 10 client.25235 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.646+0000 7f5fa2000640 1 -- 172.21.15.1:0/2193965749 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aedfe87ec0 con 0x55aedfb2bd80 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.646+0000 7f5fa2000640 10 client.25235 handle_command_reply: tid=0 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 client.25235 shutdown 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 msgr2=0x55aedff217a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff217a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5fb401b490 tx=0x7f5fb4004ab0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 shutdown_connections 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb2bd80 0x55aedff2de90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff217a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff20c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fa2000640 0 client.25235 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 --2- 172.21.15.1:0/2193965749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff20570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 >> 172.21.15.1:0/2193965749 conn(0x55aedfb61300 msgr2=0x55aedff0ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 shutdown_connections 2024-08-28T20:18:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 1 -- 172.21.15.1:0/2193965749 wait complete. 2024-08-28T20:18:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.647+0000 7f5fca61b740 20 client.25235 trim_cache size 0 max 16384 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 Processor -- start 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 -- start start 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff1ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb6d1b0 0x55aedff0e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1ab380 con 0x55aedfb442f0 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1a8c50 con 0x55aedfb4c4d0 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.663+0000 7f5fca61b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1a6aa0 con 0x55aedfb6d1b0 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fc1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb6d1b0 0x55aedff0e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff1ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fc1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb6d1b0 0x55aedff0e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:56442/0 (socket says 172.21.15.1:56442) 2024-08-28T20:18:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fc1600640 1 -- 172.21.15.1:0/267105028 learned_addr learned my addr 172.21.15.1:0/267105028 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 -- 172.21.15.1:0/267105028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb6d1b0 msgr2=0x55aedff0e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb6d1b0 0x55aedff0e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 -- 172.21.15.1:0/267105028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 msgr2=0x55aedff1ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff1ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 -- 172.21.15.1:0/267105028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aedff20300 con 0x55aedfb4c4d0 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff1ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.664+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff096f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8035040 tx=0x7f5fa802a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e716327b2843062 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.665+0000 7f5fad200640 1 -- 172.21.15.1:0/267105028 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8114070 con 0x55aedfb4c4d0 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.665+0000 7f5fad200640 1 -- 172.21.15.1:0/267105028 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fa80d4280 con 0x55aedfb4c4d0 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.665+0000 7f5fad200640 1 -- 172.21.15.1:0/267105028 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80cb130 con 0x55aedfb4c4d0 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 -- 172.21.15.1:0/267105028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 msgr2=0x55aedff096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff096f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8035040 tx=0x7f5fa802a340 comp rx=0 tx=0).stop 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 -- 172.21.15.1:0/267105028 shutdown_connections 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb6d1b0 0x55aedff0e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb4c4d0 0x55aedff096f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 --2- 172.21.15.1:0/267105028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff1ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 -- 172.21.15.1:0/267105028 >> 172.21.15.1:0/267105028 conn(0x55aedfb61300 msgr2=0x55aedff1eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:19.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 -- 172.21.15.1:0/267105028 shutdown_connections 2024-08-28T20:18:19.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 -- 172.21.15.1:0/267105028 wait complete. 2024-08-28T20:18:19.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 -- start start 2024-08-28T20:18:19.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.666+0000 7f5fca61b740 1 Processor -- start 2024-08-28T20:18:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff27890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff27f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff26450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1a7110 con 0x55aedfb442f0 2024-08-28T20:18:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1a8580 con 0x55aedfb6d1b0 2024-08-28T20:18:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1a77e0 con 0x55aedfb4c4d0 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fca61b740 10 client.0 _ll_register_callbacks cb 0x7f5fb400bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff27890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fc0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff27890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42068/0 (socket says 172.21.15.1:42068) 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fc0c00640 1 -- 172.21.15.1:0/4167162008 learned_addr learned my addr 172.21.15.1:0/4167162008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff27f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fc1600640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff26450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fbbe00640 1 -- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 msgr2=0x55aedff26450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff26450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fbbe00640 1 -- 172.21.15.1:0/4167162008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 msgr2=0x55aedff27890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff27890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.667+0000 7f5fbbe00640 1 -- 172.21.15.1:0/4167162008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aedff26990 con 0x55aedfb4c4d0 2024-08-28T20:18:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fbbe00640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff27f10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80c7650 tx=0x7f5fa8108c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f1af0b5c72a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fa2000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fa2000640 1 -- 172.21.15.1:0/4167162008 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8114070 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fa2000640 1 -- 172.21.15.1:0/4167162008 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5fa80c78b0 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aedfe83960 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fa2000640 1 -- 172.21.15.1:0/4167162008 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fa80cb130 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fca61b740 10 client.25228 fetch_fsmap learned FSMap version 27 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aedff98fe0 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.668+0000 7f5fa2000640 1 -- 172.21.15.1:0/4167162008 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aedfe83960 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fa2000640 1 -- 172.21.15.1:0/4167162008 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f5fa8004160 con 0x55aedfb4c4d0 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fca61b740 10 client.25228 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fca61b740 10 client.25228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fca61b740 20 client.25228 populate_metadata read hostname 'smithi001' 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fca61b740 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb011c0 0x55aedff9b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fca61b740 4 client.25228 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:18:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aedfe810a0 con 0x55aedfb011c0 2024-08-28T20:18:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb011c0 0x55aedff9b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fc0c00640 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb011c0 0x55aedff9b590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6329e0bf1c632 server_cookie=e6dee527cbb532de in_seq=0 out_seq=0 2024-08-28T20:18:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.669+0000 7f5fa2000640 10 client.25228 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:19.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:19 smithi121 ceph-mon[25248]: pgmap v371: 97 pgs: 97 active+clean; 36 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 3.7 MiB/s wr, 53 op/s 2024-08-28T20:18:19.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:19 smithi001 ceph-mon[20984]: pgmap v371: 97 pgs: 97 active+clean; 36 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 3.7 MiB/s wr, 53 op/s 2024-08-28T20:18:19.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:19 smithi007 ceph-mon[25357]: pgmap v371: 97 pgs: 97 active+clean; 36 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 3.7 MiB/s wr, 53 op/s 2024-08-28T20:18:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fa2000640 1 -- 172.21.15.1:0/4167162008 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aedfe810a0 con 0x55aedfb011c0 2024-08-28T20:18:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fa2000640 10 client.25228 handle_command_reply: tid=0 2024-08-28T20:18:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fca61b740 1 client.25228 shutdown 2024-08-28T20:18:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 msgr2=0x55aedff27f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fca61b740 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff27f10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80c7650 tx=0x7f5fa8108c90 comp rx=0 tx=0).stop 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 shutdown_connections 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.857+0000 7f5fca61b740 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aedfb011c0 0x55aedff9b590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aedfb6d1b0 0x55aedff26450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aedfb4c4d0 0x55aedff27f10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 1 --2- 172.21.15.1:0/4167162008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aedfb442f0 0x55aedff27890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 >> 172.21.15.1:0/4167162008 conn(0x55aedfb61300 msgr2=0x55aedff32640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fa2000640 0 client.25228 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 shutdown_connections 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 1 -- 172.21.15.1:0/4167162008 wait complete. 2024-08-28T20:18:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.858+0000 7f5fca61b740 20 client.25228 trim_cache size 0 max 16384 2024-08-28T20:18:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:18:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:18:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:18:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5fa40b4bb0 msgr2=0x7f5fa40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5fa40b4bb0 0x7f5fa40b70c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005c10 tx=0x7f5fb40095c0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc1044d0 msgr2=0x7f5fbc19a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc19a380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fa802a860 tx=0x7f5fa8032d50 comp rx=0 tx=0).stop 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 shutdown_connections 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5fa40b4bb0 0x7f5fa40b70c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fbc104e70 0x7f5fbc19af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fbc1044d0 0x7f5fbc19a380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 --2- 172.21.15.1:0/2907782782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fbc103450 0x7f5fbc199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 >> 172.21.15.1:0/2907782782 conn(0x7f5fbc0fed90 msgr2=0x7f5fbc1077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 shutdown_connections 2024-08-28T20:18:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:19.859+0000 7f5fc3600640 1 -- 172.21.15.1:0/2907782782 wait complete. 2024-08-28T20:18:19.981 INFO:teuthology.orchestra.run.smithi001.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.96 s, remaining 5.65 s) 2024-08-28T20:18:20.075 INFO:teuthology.orchestra.run.smithi001.stderr:1200000 of 3200000 tuples (37%) done (elapsed 3.05 s, remaining 5.09 s) 2024-08-28T20:18:20.377 INFO:teuthology.orchestra.run.smithi001.stderr:1300000 of 3200000 tuples (40%) done (elapsed 3.35 s, remaining 4.90 s) 2024-08-28T20:18:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.66 s, remaining 4.70 s) 2024-08-28T20:18:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.79 s, remaining 4.30 s) 2024-08-28T20:18:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:1600000 of 3200000 tuples (50%) done (elapsed 4.13 s, remaining 4.13 s) 2024-08-28T20:18:21.331 INFO:teuthology.orchestra.run.smithi001.stderr:1700000 of 3200000 tuples (53%) done (elapsed 4.31 s, remaining 3.80 s) 2024-08-28T20:18:21.599 INFO:teuthology.orchestra.run.smithi001.stderr:1800000 of 3200000 tuples (56%) done (elapsed 4.58 s, remaining 3.56 s) 2024-08-28T20:18:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:21 smithi001 ceph-mon[20984]: pgmap v372: 97 pgs: 97 active+clean; 77 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 10 MiB/s wr, 146 op/s 2024-08-28T20:18:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:21 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:21 smithi121 ceph-mon[25248]: pgmap v372: 97 pgs: 97 active+clean; 77 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 10 MiB/s wr, 146 op/s 2024-08-28T20:18:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:21 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:21 smithi007 ceph-mon[25357]: pgmap v372: 97 pgs: 97 active+clean; 77 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 10 MiB/s wr, 146 op/s 2024-08-28T20:18:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:21 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.94 s, remaining 3.38 s) 2024-08-28T20:18:22.170 INFO:teuthology.orchestra.run.smithi001.stderr:2000000 of 3200000 tuples (62%) done (elapsed 5.15 s, remaining 3.09 s) 2024-08-28T20:18:22.493 INFO:teuthology.orchestra.run.smithi001.stderr:2100000 of 3200000 tuples (65%) done (elapsed 5.47 s, remaining 2.87 s) 2024-08-28T20:18:22.835 INFO:teuthology.orchestra.run.smithi001.stderr:2200000 of 3200000 tuples (68%) done (elapsed 5.81 s, remaining 2.64 s) 2024-08-28T20:18:22.989 INFO:teuthology.orchestra.run.smithi001.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.97 s, remaining 2.33 s) 2024-08-28T20:18:23.367 INFO:teuthology.orchestra.run.smithi001.stderr:2400000 of 3200000 tuples (75%) done (elapsed 6.34 s, remaining 2.11 s) 2024-08-28T20:18:23.673 INFO:teuthology.orchestra.run.smithi001.stderr:2500000 of 3200000 tuples (78%) done (elapsed 6.65 s, remaining 1.86 s) 2024-08-28T20:18:23.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:23 smithi001 ceph-mon[20984]: pgmap v373: 97 pgs: 97 active+clean; 112 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 15 MiB/s wr, 197 op/s 2024-08-28T20:18:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:23 smithi121 ceph-mon[25248]: pgmap v373: 97 pgs: 97 active+clean; 112 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 15 MiB/s wr, 197 op/s 2024-08-28T20:18:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:23 smithi007 ceph-mon[25357]: pgmap v373: 97 pgs: 97 active+clean; 112 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 15 MiB/s wr, 197 op/s 2024-08-28T20:18:23.872 INFO:teuthology.orchestra.run.smithi001.stderr:2600000 of 3200000 tuples (81%) done (elapsed 6.85 s, remaining 1.58 s) 2024-08-28T20:18:24.151 INFO:teuthology.orchestra.run.smithi001.stderr:2700000 of 3200000 tuples (84%) done (elapsed 7.13 s, remaining 1.32 s) 2024-08-28T20:18:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2800000 of 3200000 tuples (87%) done (elapsed 7.43 s, remaining 1.06 s) 2024-08-28T20:18:24.632 INFO:teuthology.orchestra.run.smithi001.stderr:2900000 of 3200000 tuples (90%) done (elapsed 7.61 s, remaining 0.79 s) 2024-08-28T20:18:24.970 INFO:teuthology.orchestra.run.smithi001.stderr:3000000 of 3200000 tuples (93%) done (elapsed 7.95 s, remaining 0.53 s) 2024-08-28T20:18:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:3100000 of 3200000 tuples (96%) done (elapsed 8.26 s, remaining 0.27 s) 2024-08-28T20:18:25.381 INFO:teuthology.orchestra.run.smithi001.stderr:3200000 of 3200000 tuples (100%) done (elapsed 8.36 s, remaining 0.00 s) 2024-08-28T20:18:25.495 INFO:teuthology.orchestra.run.smithi001.stderr:vacuuming... 2024-08-28T20:18:25.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:25 smithi001 ceph-mon[20984]: pgmap v374: 97 pgs: 97 active+clean; 216 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 32 MiB/s wr, 296 op/s 2024-08-28T20:18:25.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:25 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:25.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:25 smithi121 ceph-mon[25248]: pgmap v374: 97 pgs: 97 active+clean; 216 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 32 MiB/s wr, 296 op/s 2024-08-28T20:18:25.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:25 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:25 smithi007 ceph-mon[25357]: pgmap v374: 97 pgs: 97 active+clean; 216 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 32 MiB/s wr, 296 op/s 2024-08-28T20:18:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:25 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:18:26.440 INFO:teuthology.orchestra.run.smithi001.stderr:creating primary keys... 2024-08-28T20:18:27.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:27 smithi001 ceph-mon[20984]: pgmap v375: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 44 MiB/s wr, 300 op/s 2024-08-28T20:18:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:27 smithi121 ceph-mon[25248]: pgmap v375: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 44 MiB/s wr, 300 op/s 2024-08-28T20:18:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:27 smithi007 ceph-mon[25357]: pgmap v375: 97 pgs: 97 active+clean; 305 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 44 MiB/s wr, 300 op/s 2024-08-28T20:18:28.622 INFO:teuthology.orchestra.run.smithi001.stderr:done in 11.64 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 8.50 s, vacuum 0.94 s, primary keys 2.18 s). 2024-08-28T20:18:28.629 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-08-28T20:18:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:starting vacuum...end. 2024-08-28T20:18:29.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:29 smithi001 ceph-mon[20984]: pgmap v376: 97 pgs: 97 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 51 MiB/s wr, 304 op/s 2024-08-28T20:18:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:29 smithi121 ceph-mon[25248]: pgmap v376: 97 pgs: 97 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 51 MiB/s wr, 304 op/s 2024-08-28T20:18:29.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:29 smithi007 ceph-mon[25357]: pgmap v376: 97 pgs: 97 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 51 MiB/s wr, 304 op/s 2024-08-28T20:18:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:31 smithi001 ceph-mon[20984]: pgmap v377: 97 pgs: 97 active+clean; 405 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 59 MiB/s wr, 287 op/s 2024-08-28T20:18:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:31 smithi121 ceph-mon[25248]: pgmap v377: 97 pgs: 97 active+clean; 405 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 59 MiB/s wr, 287 op/s 2024-08-28T20:18:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:31 smithi007 ceph-mon[25357]: pgmap v377: 97 pgs: 97 active+clean; 405 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 59 MiB/s wr, 287 op/s 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 -- 172.21.15.1:0/2199692098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4099960 msgr2=0x7fc8f40a0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 --2- 172.21.15.1:0/2199692098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4099960 0x7fc8f40a0300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc066220 tx=0x7fc8fc097db0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 -- 172.21.15.1:0/2199692098 shutdown_connections 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 --2- 172.21.15.1:0/2199692098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4099960 0x7fc8f40a0300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 --2- 172.21.15.1:0/2199692098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8f4098fc0 0x7fc8f40993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 --2- 172.21.15.1:0/2199692098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 0x7fc8f40983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 -- 172.21.15.1:0/2199692098 >> 172.21.15.1:0/2199692098 conn(0x7fc8f40938a0 msgr2=0x7fc8f4095d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:33.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 -- 172.21.15.1:0/2199692098 shutdown_connections 2024-08-28T20:18:33.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.176+0000 7fc902e00640 1 -- 172.21.15.1:0/2199692098 wait complete. 2024-08-28T20:18:33.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 Processor -- start 2024-08-28T20:18:33.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 -- start start 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 0x7fc8f412e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4098fc0 0x7fc8f412ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8f4099960 0x7fc8f412f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f40a3af0 con 0x7fc8f4097f40 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f40a3970 con 0x7fc8f4098fc0 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.178+0000 7fc902e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f40a3c70 con 0x7fc8f4099960 2024-08-28T20:18:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.179+0000 7fc901a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 0x7fc8f412e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.179+0000 7fc901a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 0x7fc8f412e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43602/0 (socket says 172.21.15.1:43602) 2024-08-28T20:18:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.179+0000 7fc901a00640 1 -- 172.21.15.1:0/321953660 learned_addr learned my addr 172.21.15.1:0/321953660 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.179+0000 7fc901000640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4098fc0 0x7fc8f412ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.179+0000 7fc902400640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8f4099960 0x7fc8f412f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.180+0000 7fc901000640 1 -- 172.21.15.1:0/321953660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8f4099960 msgr2=0x7fc8f412f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.180+0000 7fc901000640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8f4099960 0x7fc8f412f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.180+0000 7fc901000640 1 -- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 msgr2=0x7fc8f412e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.180+0000 7fc901000640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 0x7fc8f412e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.180+0000 7fc901000640 1 -- 172.21.15.1:0/321953660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f4130150 con 0x7fc8f4098fc0 2024-08-28T20:18:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.180+0000 7fc901000640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4098fc0 0x7fc8f412ed80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8005fd0 tx=0x7fc8e800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.181+0000 7fc8fa000640 1 -- 172.21.15.1:0/321953660 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8009c30 con 0x7fc8f4098fc0 2024-08-28T20:18:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.182+0000 7fc8fa000640 1 -- 172.21.15.1:0/321953660 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8e8009dd0 con 0x7fc8f4098fc0 2024-08-28T20:18:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.182+0000 7fc8fa000640 1 -- 172.21.15.1:0/321953660 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8010460 con 0x7fc8f4098fc0 2024-08-28T20:18:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.182+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f4130440 con 0x7fc8f4098fc0 2024-08-28T20:18:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.182+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f4136b30 con 0x7fc8f4098fc0 2024-08-28T20:18:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.192+0000 7fc90b469740 1 Processor -- start 2024-08-28T20:18:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.192+0000 7fc90b469740 1 -- start start 2024-08-28T20:18:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc90b469740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc90b469740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb82610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc90b469740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb83160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc90b469740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b78baf4f70 con 0x55b78b7dc1b0 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc90b469740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b78bae4500 con 0x55b78b7b32f0 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc90b469740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b78bae84b0 con 0x55b78b7bb4d0 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc901a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb82610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc901a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb82610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40172/0 (socket says 172.21.15.1:40172) 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.193+0000 7fc901a00640 1 -- 172.21.15.1:0/2999839151 learned_addr learned my addr 172.21.15.1:0/2999839151 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.194+0000 7fc901a00640 1 -- 172.21.15.1:0/2999839151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 msgr2=0x55b78bb83160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.194+0000 7fc901a00640 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb83160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.194+0000 7fc901a00640 1 -- 172.21.15.1:0/2999839151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 msgr2=0x55b78bb81fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.195+0000 7fc901a00640 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.195+0000 7fc901a00640 1 -- 172.21.15.1:0/2999839151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78ba9ec10 con 0x55b78b7b32f0 2024-08-28T20:18:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.196+0000 7fc901a00640 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb82610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009e70 tx=0x7fc8f00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae2a2d69ed828ea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.197+0000 7fc8eea00640 1 -- 172.21.15.1:0/2999839151 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0012650 con 0x55b78b7b32f0 2024-08-28T20:18:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.197+0000 7fc8eea00640 1 -- 172.21.15.1:0/2999839151 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8f0012ca0 con 0x55b78b7b32f0 2024-08-28T20:18:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.197+0000 7fc8eea00640 1 -- 172.21.15.1:0/2999839151 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f001acd0 con 0x55b78b7b32f0 2024-08-28T20:18:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.199+0000 7fc8fa000640 1 -- 172.21.15.1:0/321953660 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fc8e8003e80 con 0x7fc8f4098fc0 2024-08-28T20:18:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 -- 172.21.15.1:0/2999839151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 msgr2=0x55b78bb82610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb82610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009e70 tx=0x7fc8f00117b0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 -- 172.21.15.1:0/2999839151 shutdown_connections 2024-08-28T20:18:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb83160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb82610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 --2- 172.21.15.1:0/2999839151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb81fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 -- 172.21.15.1:0/2999839151 >> 172.21.15.1:0/2999839151 conn(0x55b78b7d0300 msgr2=0x55b78bb7da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.201+0000 7fc90b469740 1 -- 172.21.15.1:0/2999839151 shutdown_connections 2024-08-28T20:18:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.202+0000 7fc90b469740 1 -- 172.21.15.1:0/2999839151 wait complete. 2024-08-28T20:18:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.202+0000 7fc8fa000640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc8e40b4b60 0x7fc8e40b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.203+0000 7fc8fa000640 1 -- 172.21.15.1:0/321953660 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc8e80e42f0 con 0x7fc8f4098fc0 2024-08-28T20:18:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.203+0000 7fc90b469740 1 -- start start 2024-08-28T20:18:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.204+0000 7fc901a00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc8e40b4b60 0x7fc8e40b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.204+0000 7fc90b469740 1 Processor -- start 2024-08-28T20:18:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.205+0000 7fc901a00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc8e40b4b60 0x7fc8e40b7070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001a5f0 tx=0x7fc8f001a650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.206+0000 7fc90b469740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb93e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.206+0000 7fc90b469740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb94550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.206+0000 7fc90b469740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.206+0000 7fc901a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb93e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc901a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb93e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40176/0 (socket says 172.21.15.1:40176) 2024-08-28T20:18:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc902400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc902400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43618/0 (socket says 172.21.15.1:43618) 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b78ba1dab0 con 0x55b78b7dc1b0 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b78ba8b320 con 0x55b78b7b32f0 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b78bb83c80 con 0x55b78b7bb4d0 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc901a00640 1 -- 172.21.15.1:0/289791713 learned_addr learned my addr 172.21.15.1:0/289791713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc901000640 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb94550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.207+0000 7fc90b469740 10 client.0 _ll_register_callbacks cb 0x55b78ba916a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:18:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc901a00640 1 -- 172.21.15.1:0/289791713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 msgr2=0x55b78bb94550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc901a00640 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb94550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc901a00640 1 -- 172.21.15.1:0/289791713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 msgr2=0x55b78bb950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc901a00640 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc901a00640 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b78b847790 con 0x55b78b7b32f0 2024-08-28T20:18:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc901a00640 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb93e90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001ac90 tx=0x7fc8f00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f342c5d97cb09f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.208+0000 7fc8e3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:18:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.209+0000 7fc8e3400640 1 -- 172.21.15.1:0/289791713 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0034020 con 0x55b78b7b32f0 2024-08-28T20:18:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.209+0000 7fc8e3400640 1 -- 172.21.15.1:0/289791713 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc8f001ad80 con 0x55b78b7b32f0 2024-08-28T20:18:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.209+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f0012ca0 con 0x55b78b7b32f0 2024-08-28T20:18:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.210+0000 7fc8e3400640 1 -- 172.21.15.1:0/289791713 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8f002c040 con 0x55b78b7b32f0 2024-08-28T20:18:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.210+0000 7fc90b469740 10 client.25253 fetch_fsmap learned FSMap version 29 2024-08-28T20:18:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.210+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b78b8c0620 con 0x55b78b7b32f0 2024-08-28T20:18:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.211+0000 7fc8e3400640 1 -- 172.21.15.1:0/289791713 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8f0012ca0 con 0x55b78b7b32f0 2024-08-28T20:18:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc8e3400640 1 -- 172.21.15.1:0/289791713 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fc8f0041020 con 0x55b78b7b32f0 2024-08-28T20:18:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc90b469740 10 client.25253 fetch_fsmap finished waiting for FSMap version 29 2024-08-28T20:18:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc90b469740 10 client.25253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:18:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc90b469740 20 client.25253 populate_metadata read hostname 'smithi001' 2024-08-28T20:18:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc90b469740 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78b79ad80 0x55b78bba15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc90b469740 4 client.25253 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:18:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.212+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b78baf6ec0 con 0x55b78b79ad80 2024-08-28T20:18:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.213+0000 7fc901000640 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78b79ad80 0x55b78bba15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.215+0000 7fc8e3400640 10 client.25253 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.215+0000 7fc901000640 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78b79ad80 0x55b78bba15a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396ca602b25c4412 server_cookie=9687f57215e8aee7 in_seq=0 out_seq=0 2024-08-28T20:18:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.217+0000 7fc8e3400640 1 -- 172.21.15.1:0/289791713 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b78baf6ec0 con 0x55b78b79ad80 2024-08-28T20:18:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.217+0000 7fc8e3400640 10 client.25253 handle_command_reply: tid=0 2024-08-28T20:18:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.217+0000 7fc90b469740 1 client.25253 shutdown 2024-08-28T20:18:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.218+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 msgr2=0x55b78bb93e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.218+0000 7fc90b469740 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb93e90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001ac90 tx=0x7fc8f00117b0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 shutdown_connections 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc90b469740 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78b79ad80 0x55b78bba15a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc90b469740 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7dc1b0 0x55b78bb950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc90b469740 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7bb4d0 0x55b78bb94550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc90b469740 1 --2- 172.21.15.1:0/289791713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7b32f0 0x55b78bb93e90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc8e3400640 0 client.25253 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.219+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 >> 172.21.15.1:0/289791713 conn(0x55b78b7d0300 msgr2=0x55b78bb7bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.220+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 shutdown_connections 2024-08-28T20:18:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.220+0000 7fc90b469740 1 -- 172.21.15.1:0/289791713 wait complete. 2024-08-28T20:18:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.220+0000 7fc90b469740 20 client.25253 trim_cache size 0 max 16384 2024-08-28T20:18:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.287+0000 7fc90b469740 1 Processor -- start 2024-08-28T20:18:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.287+0000 7fc90b469740 1 -- start start 2024-08-28T20:18:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.288+0000 7fc90b469740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 0x55b78bb939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.288+0000 7fc90b469740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7bb4d0 0x55b78bb80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.288+0000 7fc90b469740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7dc1b0 0x55b78bb80dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.288+0000 7fc90b469740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f413dcd0 con 0x55b78b7bb4d0 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.288+0000 7fc90b469740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f413b570 con 0x55b78b7dc1b0 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.288+0000 7fc90b469740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f41393e0 con 0x55b78b7b32f0 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.289+0000 7fc901a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 0x55b78bb939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.289+0000 7fc902400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7dc1b0 0x55b78bb80dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.289+0000 7fc901a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 0x55b78bb939c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43446/0 (socket says 172.21.15.1:43446) 2024-08-28T20:18:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.289+0000 7fc901a00640 1 -- 172.21.15.1:0/2393933986 learned_addr learned my addr 172.21.15.1:0/2393933986 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.289+0000 7fc901000640 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7bb4d0 0x55b78bb80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.289+0000 7fc901a00640 1 -- 172.21.15.1:0/2393933986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7dc1b0 msgr2=0x55b78bb80dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc901a00640 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7dc1b0 0x55b78bb80dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc901a00640 1 -- 172.21.15.1:0/2393933986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7bb4d0 msgr2=0x55b78bb80880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc901a00640 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7bb4d0 0x55b78bb80880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc901a00640 1 -- 172.21.15.1:0/2393933986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78bb91f80 con 0x55b78b7b32f0 2024-08-28T20:18:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc902400640 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7dc1b0 0x55b78bb80dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:18:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc901000640 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7bb4d0 0x55b78bb80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:18:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.290+0000 7fc901a00640 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 0x55b78bb939c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001ac60 tx=0x7fc8f001a800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542e5ab18dd068c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.291+0000 7fc8ee000640 1 -- 172.21.15.1:0/2393933986 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0046020 con 0x55b78b7b32f0 2024-08-28T20:18:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.292+0000 7fc8ee000640 1 -- 172.21.15.1:0/2393933986 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8f0011cb0 con 0x55b78b7b32f0 2024-08-28T20:18:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.292+0000 7fc8ee000640 1 -- 172.21.15.1:0/2393933986 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0034070 con 0x55b78b7b32f0 2024-08-28T20:18:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 -- 172.21.15.1:0/2393933986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 msgr2=0x55b78bb939c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 0x55b78bb939c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001ac60 tx=0x7fc8f001a800 comp rx=0 tx=0).stop 2024-08-28T20:18:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 -- 172.21.15.1:0/2393933986 shutdown_connections 2024-08-28T20:18:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7bb4d0 0x55b78bb80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7dc1b0 0x55b78bb80dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 --2- 172.21.15.1:0/2393933986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7b32f0 0x55b78bb939c0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001ac60 tx=0x7fc8f001a800 comp rx=0 tx=0).stop 2024-08-28T20:18:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 -- 172.21.15.1:0/2393933986 >> 172.21.15.1:0/2393933986 conn(0x55b78b7d0300 msgr2=0x55b78bb80170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.294+0000 7fc90b469740 1 -- 172.21.15.1:0/2393933986 shutdown_connections 2024-08-28T20:18:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.296+0000 7fc90b469740 1 -- 172.21.15.1:0/2393933986 wait complete. 2024-08-28T20:18:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.296+0000 7fc90b469740 1 -- start start 2024-08-28T20:18:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.296+0000 7fc90b469740 1 Processor -- start 2024-08-28T20:18:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.299+0000 7fc90b469740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7bb4d0 0x55b78bb9bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.299+0000 7fc90b469740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 0x55b78bb97a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.299+0000 7fc90b469740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7701c0 0x55b78bb97fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.299+0000 7fc90b469740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4139a30 con 0x55b78b7701c0 2024-08-28T20:18:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.299+0000 7fc90b469740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f413aea0 con 0x55b78b7bb4d0 2024-08-28T20:18:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.299+0000 7fc90b469740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f413a100 con 0x55b78b7dc1b0 2024-08-28T20:18:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.300+0000 7fc90b469740 10 client.0 _ll_register_callbacks cb 0x7fc8f0009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:18:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.300+0000 7fc901000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 0x55b78bb97a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.300+0000 7fc901000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 0x55b78bb97a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43452/0 (socket says 172.21.15.1:43452) 2024-08-28T20:18:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.300+0000 7fc901000640 1 -- 172.21.15.1:0/1059808132 learned_addr learned my addr 172.21.15.1:0/1059808132 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.300+0000 7fc901a00640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7bb4d0 0x55b78bb9bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.301+0000 7fc901000640 1 -- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7bb4d0 msgr2=0x55b78bb9bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.301+0000 7fc902400640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7701c0 0x55b78bb97fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.301+0000 7fc901000640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7bb4d0 0x55b78bb9bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.301+0000 7fc901000640 1 -- 172.21.15.1:0/1059808132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7701c0 msgr2=0x55b78bb97fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.301+0000 7fc901000640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7701c0 0x55b78bb97fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.302+0000 7fc901000640 1 -- 172.21.15.1:0/1059808132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b78bb98bf0 con 0x55b78b7dc1b0 2024-08-28T20:18:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.302+0000 7fc901000640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 0x55b78bb97a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80a6de0 tx=0x7fc8e80aa930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c329c5ceca61ea4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.303+0000 7fc8e3400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:18:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.303+0000 7fc8e3400640 1 -- 172.21.15.1:0/1059808132 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80b3fd0 con 0x55b78b7dc1b0 2024-08-28T20:18:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.303+0000 7fc8e3400640 1 -- 172.21.15.1:0/1059808132 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc8e8004170 con 0x55b78b7dc1b0 2024-08-28T20:18:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.303+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f0011cb0 con 0x55b78b7dc1b0 2024-08-28T20:18:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.304+0000 7fc8e3400640 1 -- 172.21.15.1:0/1059808132 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8e8004370 con 0x55b78b7dc1b0 2024-08-28T20:18:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.306+0000 7fc90b469740 10 client.25243 fetch_fsmap learned FSMap version 29 2024-08-28T20:18:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.306+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b78bc1d160 con 0x55b78b7dc1b0 2024-08-28T20:18:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.307+0000 7fc8e3400640 1 -- 172.21.15.1:0/1059808132 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8f0011cb0 con 0x55b78b7dc1b0 2024-08-28T20:18:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.307+0000 7fc8e3400640 1 -- 172.21.15.1:0/1059808132 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fc8e80a6760 con 0x55b78b7dc1b0 2024-08-28T20:18:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.308+0000 7fc90b469740 10 client.25243 fetch_fsmap finished waiting for FSMap version 29 2024-08-28T20:18:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.308+0000 7fc90b469740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:18:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.308+0000 7fc90b469740 20 client.25243 populate_metadata read hostname 'smithi001' 2024-08-28T20:18:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.308+0000 7fc90b469740 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78bc1db90 0x55b78bc1ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.308+0000 7fc90b469740 4 client.25243 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:18:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.308+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b78baf2960 con 0x55b78bc1db90 2024-08-28T20:18:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.309+0000 7fc901a00640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78bc1db90 0x55b78bc1ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.310+0000 7fc901a00640 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78bc1db90 0x55b78bc1ffb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66278c1e44238bb3 server_cookie=aae67c53d841a8c6 in_seq=0 out_seq=0 2024-08-28T20:18:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.310+0000 7fc8e3400640 10 client.25243 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.342+0000 7fc8e3400640 1 -- 172.21.15.1:0/1059808132 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b78baf2960 con 0x55b78bc1db90 2024-08-28T20:18:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.342+0000 7fc8e3400640 10 client.25243 handle_command_reply: tid=0 2024-08-28T20:18:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.342+0000 7fc90b469740 1 client.25243 shutdown 2024-08-28T20:18:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.343+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 msgr2=0x55b78bb97a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.343+0000 7fc90b469740 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 0x55b78bb97a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80a6de0 tx=0x7fc8e80aa930 comp rx=0 tx=0).stop 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 shutdown_connections 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b78bc1db90 0x55b78bc1ffb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b78b7701c0 0x55b78bb97fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78b7dc1b0 0x55b78bb97a80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 --2- 172.21.15.1:0/1059808132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78b7bb4d0 0x55b78bb9bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 >> 172.21.15.1:0/1059808132 conn(0x55b78b7d0300 msgr2=0x55b78bb8f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc8e3400640 0 client.25243 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.344+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 shutdown_connections 2024-08-28T20:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.345+0000 7fc90b469740 1 -- 172.21.15.1:0/1059808132 wait complete. 2024-08-28T20:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.345+0000 7fc90b469740 20 client.25243 trim_cache size 0 max 16384 2024-08-28T20:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:18:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:18:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:18:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc8e40b4b60 msgr2=0x7fc8e40b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc8e40b4b60 0x7fc8e40b7070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc8f001a5f0 tx=0x7fc8f001a650 comp rx=0 tx=0).stop 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4098fc0 msgr2=0x7fc8f412ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4098fc0 0x7fc8f412ed80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8005fd0 tx=0x7fc8e800dde0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 shutdown_connections 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc8e40b4b60 0x7fc8e40b7070 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8f4099960 0x7fc8f412f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8f4098fc0 0x7fc8f412ed80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 --2- 172.21.15.1:0/321953660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8f4097f40 0x7fc8f412e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.346+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 >> 172.21.15.1:0/321953660 conn(0x7fc8f40938a0 msgr2=0x7fc8f409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.347+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 shutdown_connections 2024-08-28T20:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:33.347+0000 7fc902e00640 1 -- 172.21.15.1:0/321953660 wait complete. 2024-08-28T20:18:33.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:33 smithi001 ceph-mon[20984]: pgmap v378: 97 pgs: 97 active+clean; 466 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 61 MiB/s wr, 265 op/s 2024-08-28T20:18:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:33 smithi121 ceph-mon[25248]: pgmap v378: 97 pgs: 97 active+clean; 466 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 61 MiB/s wr, 265 op/s 2024-08-28T20:18:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 5.0 s, 3517.5 tps, lat 27.400 ms stddev 28.829 2024-08-28T20:18:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:33 smithi007 ceph-mon[25357]: pgmap v378: 97 pgs: 97 active+clean; 466 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 61 MiB/s wr, 265 op/s 2024-08-28T20:18:35.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:35 smithi001 ceph-mon[20984]: pgmap v379: 97 pgs: 97 active+clean; 722 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 62 MiB/s wr, 279 op/s 2024-08-28T20:18:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:35 smithi121 ceph-mon[25248]: pgmap v379: 97 pgs: 97 active+clean; 722 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 62 MiB/s wr, 279 op/s 2024-08-28T20:18:35.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:35 smithi007 ceph-mon[25357]: pgmap v379: 97 pgs: 97 active+clean; 722 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 62 MiB/s wr, 279 op/s 2024-08-28T20:18:37.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:37 smithi001 ceph-mon[20984]: pgmap v380: 97 pgs: 97 active+clean; 816 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 46 MiB/s wr, 236 op/s 2024-08-28T20:18:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:37 smithi121 ceph-mon[25248]: pgmap v380: 97 pgs: 97 active+clean; 816 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 46 MiB/s wr, 236 op/s 2024-08-28T20:18:37.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:37 smithi007 ceph-mon[25357]: pgmap v380: 97 pgs: 97 active+clean; 816 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 46 MiB/s wr, 236 op/s 2024-08-28T20:18:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 10.0 s, 4364.1 tps, lat 22.911 ms stddev 24.072 2024-08-28T20:18:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:39 smithi121 ceph-mon[25248]: pgmap v381: 97 pgs: 97 active+clean; 896 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 352 op/s 2024-08-28T20:18:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:39 smithi007 ceph-mon[25357]: pgmap v381: 97 pgs: 97 active+clean; 896 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 352 op/s 2024-08-28T20:18:39.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:39 smithi001 ceph-mon[20984]: pgmap v381: 97 pgs: 97 active+clean; 896 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 352 op/s 2024-08-28T20:18:41.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:41 smithi007 ceph-mon[25357]: pgmap v382: 97 pgs: 97 active+clean; 919 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 498 op/s 2024-08-28T20:18:41.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:41 smithi001 ceph-mon[20984]: pgmap v382: 97 pgs: 97 active+clean; 919 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 498 op/s 2024-08-28T20:18:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:41 smithi121 ceph-mon[25248]: pgmap v382: 97 pgs: 97 active+clean; 919 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 498 op/s 2024-08-28T20:18:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 15.0 s, 3781.7 tps, lat 26.414 ms stddev 25.925 2024-08-28T20:18:43.781 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:43 smithi121 ceph-mon[25248]: pgmap v383: 97 pgs: 97 active+clean; 925 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 MiB/s wr, 653 op/s 2024-08-28T20:18:43.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:43 smithi007 ceph-mon[25357]: pgmap v383: 97 pgs: 97 active+clean; 925 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 MiB/s wr, 653 op/s 2024-08-28T20:18:43.896 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:43 smithi001 ceph-mon[20984]: pgmap v383: 97 pgs: 97 active+clean; 925 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 MiB/s wr, 653 op/s 2024-08-28T20:18:45.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:45 smithi007 ceph-mon[25357]: pgmap v384: 97 pgs: 97 active+clean; 931 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 780 op/s 2024-08-28T20:18:45.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:45 smithi001 ceph-mon[20984]: pgmap v384: 97 pgs: 97 active+clean; 931 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 780 op/s 2024-08-28T20:18:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:45 smithi121 ceph-mon[25248]: pgmap v384: 97 pgs: 97 active+clean; 931 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 780 op/s 2024-08-28T20:18:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 -- 172.21.15.1:0/3109887600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810a160 msgr2=0x7f63d810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 --2- 172.21.15.1:0/3109887600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810a160 0x7f63d810c580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009ca0 tx=0x7f63d002a8b0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 -- 172.21.15.1:0/3109887600 shutdown_connections 2024-08-28T20:18:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 --2- 172.21.15.1:0/3109887600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810f770 0x7f63d811a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 --2- 172.21.15.1:0/3109887600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810cb50 0x7f63d810f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 --2- 172.21.15.1:0/3109887600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810a160 0x7f63d810c580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 -- 172.21.15.1:0/3109887600 >> 172.21.15.1:0/3109887600 conn(0x7f63d80705b0 msgr2=0x7f63d8072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.677+0000 7f63dd600640 1 -- 172.21.15.1:0/3109887600 shutdown_connections 2024-08-28T20:18:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.678+0000 7f63dd600640 1 -- 172.21.15.1:0/3109887600 wait complete. 2024-08-28T20:18:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.679+0000 7f63dd600640 1 Processor -- start 2024-08-28T20:18:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.679+0000 7f63dd600640 1 -- start start 2024-08-28T20:18:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63dd600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 0x7f63d81a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63dd600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810cb50 0x7f63d81a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63dd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810f770 0x7f63d81a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63dd600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63d811def0 con 0x7f63d810cb50 2024-08-28T20:18:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63dd600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63d811dd70 con 0x7f63d810f770 2024-08-28T20:18:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63dd600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f63d811e070 con 0x7f63d810a160 2024-08-28T20:18:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 0x7f63d81a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 0x7f63d81a8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39836/0 (socket says 172.21.15.1:39836) 2024-08-28T20:18:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63d6a00640 1 -- 172.21.15.1:0/880176466 learned_addr learned my addr 172.21.15.1:0/880176466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.680+0000 7f63d6000640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810cb50 0x7f63d81a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d7400640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810f770 0x7f63d81a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d6a00640 1 -- 172.21.15.1:0/880176466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810f770 msgr2=0x7f63d81a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d6a00640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810f770 0x7f63d81a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d6a00640 1 -- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810cb50 msgr2=0x7f63d81a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d6a00640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810cb50 0x7f63d81a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d6a00640 1 -- 172.21.15.1:0/880176466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d81aa540 con 0x7f63d810a160 2024-08-28T20:18:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.681+0000 7f63d6000640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810cb50 0x7f63d81a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:18:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.682+0000 7f63d6a00640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 0x7f63d81a8b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63d00307a0 tx=0x7f63d0003b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.682+0000 7f63cf400640 1 -- 172.21.15.1:0/880176466 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0004240 con 0x7f63d810a160 2024-08-28T20:18:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.682+0000 7f63cf400640 1 -- 172.21.15.1:0/880176466 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d0040070 con 0x7f63d810a160 2024-08-28T20:18:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.682+0000 7f63cf400640 1 -- 172.21.15.1:0/880176466 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0045c80 con 0x7f63d810a160 2024-08-28T20:18:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.682+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d81aa7d0 con 0x7f63d810a160 2024-08-28T20:18:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.683+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d81b0f20 con 0x7f63d810a160 2024-08-28T20:18:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.688+0000 7f63cf400640 1 -- 172.21.15.1:0/880176466 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f63d00043e0 con 0x7f63d810a160 2024-08-28T20:18:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.689+0000 7f63e4688740 1 Processor -- start 2024-08-28T20:18:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.690+0000 7f63e4688740 1 -- start start 2024-08-28T20:18:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.690+0000 7f63cf400640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f63bc0b4c30 0x7f63bc0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.690+0000 7f63cf400640 1 -- 172.21.15.1:0/880176466 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f63d0106320 con 0x7f63d810a160 2024-08-28T20:18:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63e4688740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24571b0 0x558df27fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63e4688740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df27fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63e4688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24364d0 0x558df27fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63e4688740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558df276ff70 con 0x558df24571b0 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63e4688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558df275f500 con 0x558df24364d0 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63e4688740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558df27634b0 con 0x558df242e2f0 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63d6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df27fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24571b0 0x558df27fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63d6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df27fd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39840/0 (socket says 172.21.15.1:39840) 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63d6000640 1 -- 172.21.15.1:0/736839753 learned_addr learned my addr 172.21.15.1:0/736839753 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.691+0000 7f63d7400640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f63bc0b4c30 0x7f63bc0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.692+0000 7f63d6000640 1 -- 172.21.15.1:0/736839753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24364d0 msgr2=0x558df27fdcf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:18:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.692+0000 7f63d6000640 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24364d0 0x558df27fdcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.692+0000 7f63d6000640 1 -- 172.21.15.1:0/736839753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24571b0 msgr2=0x558df27fcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.692+0000 7f63d6000640 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24571b0 0x558df27fcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.692+0000 7f63d6000640 1 -- 172.21.15.1:0/736839753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558df2719c10 con 0x558df242e2f0 2024-08-28T20:18:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.693+0000 7f63d6000640 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df27fd1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009c50 tx=0x7f63c400e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724d0c9477b75dea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.694+0000 7f63c3400640 1 -- 172.21.15.1:0/736839753 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4016070 con 0x558df242e2f0 2024-08-28T20:18:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.694+0000 7f63c3400640 1 -- 172.21.15.1:0/736839753 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63c40054d0 con 0x558df242e2f0 2024-08-28T20:18:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.694+0000 7f63c3400640 1 -- 172.21.15.1:0/736839753 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011470 con 0x558df242e2f0 2024-08-28T20:18:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.694+0000 7f63d7400640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f63bc0b4c30 0x7f63bc0b7140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009d10 tx=0x7f63c80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.695+0000 7f63e4688740 1 -- 172.21.15.1:0/736839753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 msgr2=0x558df27fd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.695+0000 7f63e4688740 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df27fd1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009c50 tx=0x7f63c400e6c0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 -- 172.21.15.1:0/736839753 shutdown_connections 2024-08-28T20:18:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24364d0 0x558df27fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df27fd1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 --2- 172.21.15.1:0/736839753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24571b0 0x558df27fcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 -- 172.21.15.1:0/736839753 >> 172.21.15.1:0/736839753 conn(0x558df244b300 msgr2=0x558df27f85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 -- 172.21.15.1:0/736839753 shutdown_connections 2024-08-28T20:18:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.696+0000 7f63e4688740 1 -- 172.21.15.1:0/736839753 wait complete. 2024-08-28T20:18:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.697+0000 7f63e4688740 1 -- start start 2024-08-28T20:18:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.697+0000 7f63e4688740 1 Processor -- start 2024-08-28T20:18:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.699+0000 7f63e4688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df242e2f0 0x558df2806270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.699+0000 7f63e4688740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2806930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.699+0000 7f63e4688740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df24571b0 0x558df28074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.700+0000 7f63d6000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2806930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.700+0000 7f63d6000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2806930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33828/0 (socket says 172.21.15.1:33828) 2024-08-28T20:18:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.702+0000 7f63d7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df24571b0 0x558df28074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.702+0000 7f63d7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df24571b0 0x558df28074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39842/0 (socket says 172.21.15.1:39842) 2024-08-28T20:18:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.702+0000 7f63e4688740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558df2698ab0 con 0x558df24364d0 2024-08-28T20:18:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.702+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558df2706320 con 0x558df242e2f0 2024-08-28T20:18:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.702+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558df27fe810 con 0x558df24571b0 2024-08-28T20:18:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.702+0000 7f63d6000640 1 -- 172.21.15.1:0/3516706055 learned_addr learned my addr 172.21.15.1:0/3516706055 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63e4688740 10 client.0 _ll_register_callbacks cb 0x558df273fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63d6a00640 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df242e2f0 0x558df2806270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63d6000640 1 -- 172.21.15.1:0/3516706055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df24571b0 msgr2=0x558df28074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63d6000640 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df24571b0 0x558df28074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63d6000640 1 -- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df242e2f0 msgr2=0x558df2806270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63d6000640 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df242e2f0 0x558df2806270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.703+0000 7f63d6000640 1 -- 172.21.15.1:0/3516706055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558df24c2790 con 0x558df24364d0 2024-08-28T20:18:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.704+0000 7f63d6000640 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2806930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f63c40058c0 tx=0x7f63c4005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917b65af32b6525b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.704+0000 7f63b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:18:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.705+0000 7f63b7e00640 1 -- 172.21.15.1:0/3516706055 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4016040 con 0x558df24364d0 2024-08-28T20:18:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.705+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63c40054d0 con 0x558df24364d0 2024-08-28T20:18:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.706+0000 7f63b7e00640 1 -- 172.21.15.1:0/3516706055 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f63c4020070 con 0x558df24364d0 2024-08-28T20:18:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.706+0000 7f63b7e00640 1 -- 172.21.15.1:0/3516706055 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f63c4016040 con 0x558df24364d0 2024-08-28T20:18:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.706+0000 7f63e4688740 10 client.15225 fetch_fsmap learned FSMap version 29 2024-08-28T20:18:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.706+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558df253b620 con 0x558df24364d0 2024-08-28T20:18:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.707+0000 7f63b7e00640 1 -- 172.21.15.1:0/3516706055 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63c40054d0 con 0x558df24364d0 2024-08-28T20:18:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.707+0000 7f63b7e00640 1 -- 172.21.15.1:0/3516706055 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f63c400f040 con 0x558df24364d0 2024-08-28T20:18:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63e4688740 10 client.15225 fetch_fsmap finished waiting for FSMap version 29 2024-08-28T20:18:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63e4688740 10 client.15225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:18:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63e4688740 20 client.15225 populate_metadata read hostname 'smithi001' 2024-08-28T20:18:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63e4688740 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df2415d80 0x558df28136c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63e4688740 4 client.15225 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:18:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558df2771ec0 con 0x558df2415d80 2024-08-28T20:18:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.708+0000 7f63d6a00640 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df2415d80 0x558df28136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.710+0000 7f63d6a00640 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df2415d80 0x558df28136c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=531b2ab36cb58e3b server_cookie=9cf4a0230caae14e in_seq=0 out_seq=0 2024-08-28T20:18:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.710+0000 7f63b7e00640 10 client.15225 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.711+0000 7f63b7e00640 1 -- 172.21.15.1:0/3516706055 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558df2771ec0 con 0x558df2415d80 2024-08-28T20:18:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.711+0000 7f63b7e00640 10 client.15225 handle_command_reply: tid=0 2024-08-28T20:18:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.711+0000 7f63e4688740 1 client.15225 shutdown 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.712+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 msgr2=0x558df2806930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.712+0000 7f63e4688740 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2806930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f63c40058c0 tx=0x7f63c4005430 comp rx=0 tx=0).stop 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 shutdown_connections 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63e4688740 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df2415d80 0x558df28136c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63e4688740 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2806930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63e4688740 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df24571b0 0x558df28074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63b7e00640 0 client.15225 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63e4688740 1 --2- 172.21.15.1:0/3516706055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df242e2f0 0x558df2806270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.713+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 >> 172.21.15.1:0/3516706055 conn(0x558df244b300 msgr2=0x558df27f6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.714+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 shutdown_connections 2024-08-28T20:18:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.715+0000 7f63e4688740 1 -- 172.21.15.1:0/3516706055 wait complete. 2024-08-28T20:18:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.715+0000 7f63e4688740 20 client.15225 trim_cache size 0 max 16384 2024-08-28T20:18:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 Processor -- start 2024-08-28T20:18:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 -- start start 2024-08-28T20:18:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df2807a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df27f3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df27f7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63d81bc390 con 0x558df24364d0 2024-08-28T20:18:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63d81b9c30 con 0x558df24571b0 2024-08-28T20:18:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.761+0000 7f63e4688740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f63d81b7a80 con 0x558df242e2f0 2024-08-28T20:18:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df2807a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df2807a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39852/0 (socket says 172.21.15.1:39852) 2024-08-28T20:18:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 -- 172.21.15.1:0/3192628032 learned_addr learned my addr 172.21.15.1:0/3192628032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6000640 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df27f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d7400640 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df27f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 -- 172.21.15.1:0/3192628032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 msgr2=0x558df27f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df27f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 -- 172.21.15.1:0/3192628032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 msgr2=0x558df27f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df27f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d6a00640 1 -- 172.21.15.1:0/3192628032 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558df2805b80 con 0x558df242e2f0 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.762+0000 7f63d7400640 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df27f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.763+0000 7f63d6a00640 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df2807a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63d00cc9e0 tx=0x7f63d0103c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3b375e34736c72 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.763+0000 7f63c2a00640 1 -- 172.21.15.1:0/3192628032 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00d1550 con 0x558df242e2f0 2024-08-28T20:18:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.763+0000 7f63c2a00640 1 -- 172.21.15.1:0/3192628032 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d0036040 con 0x558df242e2f0 2024-08-28T20:18:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.763+0000 7f63c2a00640 1 -- 172.21.15.1:0/3192628032 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00c8f70 con 0x558df242e2f0 2024-08-28T20:18:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.764+0000 7f63e4688740 1 -- 172.21.15.1:0/3192628032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 msgr2=0x558df2807a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.764+0000 7f63e4688740 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df2807a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63d00cc9e0 tx=0x7f63d0103c80 comp rx=0 tx=0).stop 2024-08-28T20:18:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 -- 172.21.15.1:0/3192628032 shutdown_connections 2024-08-28T20:18:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df27f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df27f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 --2- 172.21.15.1:0/3192628032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df2807a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 -- 172.21.15.1:0/3192628032 >> 172.21.15.1:0/3192628032 conn(0x558df244b300 msgr2=0x558df2805470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 -- 172.21.15.1:0/3192628032 shutdown_connections 2024-08-28T20:18:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.765+0000 7f63e4688740 1 -- 172.21.15.1:0/3192628032 wait complete. 2024-08-28T20:18:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.766+0000 7f63e4688740 1 -- start start 2024-08-28T20:18:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 Processor -- start 2024-08-28T20:18:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df280ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2809be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df280a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f63d81b80f0 con 0x558df24364d0 2024-08-28T20:18:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63d81b9560 con 0x558df24571b0 2024-08-28T20:18:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63e4688740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f63d81b87c0 con 0x558df242e2f0 2024-08-28T20:18:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.767+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df280ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.768+0000 7f63d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df280ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39858/0 (socket says 172.21.15.1:39858) 2024-08-28T20:18:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.768+0000 7f63d6a00640 1 -- 172.21.15.1:0/2791908588 learned_addr learned my addr 172.21.15.1:0/2791908588 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:18:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.768+0000 7f63d7400640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df280a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.768+0000 7f63d6000640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2809be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.768+0000 7f63e4688740 10 client.0 _ll_register_callbacks cb 0x7f63d00c8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:18:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.769+0000 7f63d7400640 1 -- 172.21.15.1:0/2791908588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 msgr2=0x558df280ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.769+0000 7f63d7400640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df280ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.769+0000 7f63d7400640 1 -- 172.21.15.1:0/2791908588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 msgr2=0x558df2809be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.769+0000 7f63d7400640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2809be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.769+0000 7f63d7400640 1 -- 172.21.15.1:0/2791908588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558df280a660 con 0x558df24571b0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.770+0000 7f63d7400640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df280a120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63c8011c40 tx=0x7f63c8004780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bfa4d6b8c319f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.770+0000 7f63b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.770+0000 7f63b7e00640 1 -- 172.21.15.1:0/2791908588 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c802e060 con 0x558df24571b0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.770+0000 7f63b7e00640 1 -- 172.21.15.1:0/2791908588 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f63c8020c00 con 0x558df24571b0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.770+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d0036040 con 0x558df24571b0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.771+0000 7f63b7e00640 1 -- 172.21.15.1:0/2791908588 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f63c8020e00 con 0x558df24571b0 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.771+0000 7f63e4688740 10 client.25274 fetch_fsmap learned FSMap version 29 2024-08-28T20:18:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.771+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558df287e130 con 0x558df24571b0 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63b7e00640 1 -- 172.21.15.1:0/2791908588 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d0036040 con 0x558df24571b0 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63b7e00640 1 -- 172.21.15.1:0/2791908588 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f63c8034510 con 0x558df24571b0 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63e4688740 10 client.25274 fetch_fsmap finished waiting for FSMap version 29 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63e4688740 10 client.25274 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63e4688740 20 client.25274 populate_metadata read hostname 'smithi001' 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63e4688740 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df23eb1c0 0x558df2880b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63e4688740 4 client.25274 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:18:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.772+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558df276d960 con 0x558df23eb1c0 2024-08-28T20:18:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.773+0000 7f63d6a00640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df23eb1c0 0x558df2880b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:18:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.774+0000 7f63d6a00640 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df23eb1c0 0x558df2880b90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6652d975793badab server_cookie=796fa6d93ca94c2e in_seq=0 out_seq=0 2024-08-28T20:18:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.774+0000 7f63b7e00640 10 client.25274 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.791+0000 7f63b7e00640 1 -- 172.21.15.1:0/2791908588 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558df276d960 con 0x558df23eb1c0 2024-08-28T20:18:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63b7e00640 10 client.25274 handle_command_reply: tid=0 2024-08-28T20:18:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 client.25274 shutdown 2024-08-28T20:18:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 msgr2=0x558df280a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df280a120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63c8011c40 tx=0x7f63c8004780 comp rx=0 tx=0).stop 2024-08-28T20:18:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 shutdown_connections 2024-08-28T20:18:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558df23eb1c0 0x558df2880b90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558df24364d0 0x558df2809be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558df24571b0 0x558df280a120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 --2- 172.21.15.1:0/2791908588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558df242e2f0 0x558df280ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.792+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 >> 172.21.15.1:0/2791908588 conn(0x558df244b300 msgr2=0x558df2805470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.793+0000 7f63b7e00640 0 client.25274 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.793+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 shutdown_connections 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.793+0000 7f63e4688740 1 -- 172.21.15.1:0/2791908588 wait complete. 2024-08-28T20:18:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.794+0000 7f63e4688740 20 client.25274 trim_cache size 0 max 16384 2024-08-28T20:18:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:18:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:18:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:18:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f63bc0b4c30 msgr2=0x7f63bc0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f63bc0b4c30 0x7f63bc0b7140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009d10 tx=0x7f63c80095f0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 msgr2=0x7f63d81a8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 0x7f63d81a8b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63d00307a0 tx=0x7f63d0003b80 comp rx=0 tx=0).stop 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 shutdown_connections 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f63bc0b4c30 0x7f63bc0b7140 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63d810cb50 0x7f63d81a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d810f770 0x7f63d81a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 --2- 172.21.15.1:0/880176466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63d810a160 0x7f63d81a8b00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:18:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.795+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 >> 172.21.15.1:0/880176466 conn(0x7f63d80705b0 msgr2=0x7f63d810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:18:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.796+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 shutdown_connections 2024-08-28T20:18:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:18:46.796+0000 7f63dd600640 1 -- 172.21.15.1:0/880176466 wait complete. 2024-08-28T20:18:47.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:47 smithi007 ceph-mon[25357]: pgmap v385: 97 pgs: 97 active+clean; 932 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 783 op/s 2024-08-28T20:18:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:47 smithi001 ceph-mon[20984]: pgmap v385: 97 pgs: 97 active+clean; 932 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 783 op/s 2024-08-28T20:18:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:47 smithi121 ceph-mon[25248]: pgmap v385: 97 pgs: 97 active+clean; 932 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 783 op/s 2024-08-28T20:18:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 20.0 s, 3004.1 tps, lat 33.228 ms stddev 37.187 2024-08-28T20:18:49.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:49 smithi007 ceph-mon[25357]: pgmap v386: 97 pgs: 97 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-08-28T20:18:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:49 smithi001 ceph-mon[20984]: pgmap v386: 97 pgs: 97 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-08-28T20:18:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:49 smithi121 ceph-mon[25248]: pgmap v386: 97 pgs: 97 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-08-28T20:18:51.779 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:51 smithi001 ceph-mon[20984]: pgmap v387: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 919 op/s 2024-08-28T20:18:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:51 smithi007 ceph-mon[25357]: pgmap v387: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 919 op/s 2024-08-28T20:18:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:51 smithi121 ceph-mon[25248]: pgmap v387: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 919 op/s 2024-08-28T20:18:53.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 25.0 s, 3654.8 tps, lat 27.400 ms stddev 30.141 2024-08-28T20:18:53.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:53 smithi007 ceph-mon[25357]: pgmap v388: 97 pgs: 97 active+clean; 954 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 10 MiB/s wr, 812 op/s 2024-08-28T20:18:53.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:53 smithi001 ceph-mon[20984]: pgmap v388: 97 pgs: 97 active+clean; 954 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 10 MiB/s wr, 812 op/s 2024-08-28T20:18:53.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:53 smithi121 ceph-mon[25248]: pgmap v388: 97 pgs: 97 active+clean; 954 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 10 MiB/s wr, 812 op/s 2024-08-28T20:18:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:55 smithi001 ceph-mon[20984]: pgmap v389: 97 pgs: 97 active+clean; 955 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 840 op/s 2024-08-28T20:18:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:55 smithi007 ceph-mon[25357]: pgmap v389: 97 pgs: 97 active+clean; 955 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 840 op/s 2024-08-28T20:18:55.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:55 smithi121 ceph-mon[25248]: pgmap v389: 97 pgs: 97 active+clean; 955 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 840 op/s 2024-08-28T20:18:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:57 smithi007 ceph-mon[25357]: pgmap v390: 97 pgs: 97 active+clean; 960 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 MiB/s wr, 702 op/s 2024-08-28T20:18:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:57 smithi001 ceph-mon[20984]: pgmap v390: 97 pgs: 97 active+clean; 960 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 MiB/s wr, 702 op/s 2024-08-28T20:18:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:57 smithi121 ceph-mon[25248]: pgmap v390: 97 pgs: 97 active+clean; 960 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 MiB/s wr, 702 op/s 2024-08-28T20:18:58.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 30.0 s, 3444.5 tps, lat 29.044 ms stddev 32.863 2024-08-28T20:18:59.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:18:59 smithi007 ceph-mon[25357]: pgmap v391: 97 pgs: 97 active+clean; 970 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 769 op/s 2024-08-28T20:18:59.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:18:59 smithi001 ceph-mon[20984]: pgmap v391: 97 pgs: 97 active+clean; 970 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 769 op/s 2024-08-28T20:18:59.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:18:59 smithi121 ceph-mon[25248]: pgmap v391: 97 pgs: 97 active+clean; 970 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 769 op/s 2024-08-28T20:19:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 -- 172.21.15.1:0/864881813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 msgr2=0x7f8700111ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 --2- 172.21.15.1:0/864881813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700111ff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009860 tx=0x7f86e802a340 comp rx=0 tx=0).stop 2024-08-28T20:19:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 -- 172.21.15.1:0/864881813 shutdown_connections 2024-08-28T20:19:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 --2- 172.21.15.1:0/864881813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700111ff0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 --2- 172.21.15.1:0/864881813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 --2- 172.21.15.1:0/864881813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 0x7f8700075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.106+0000 7f8705800640 1 -- 172.21.15.1:0/864881813 >> 172.21.15.1:0/864881813 conn(0x7f87000fed90 msgr2=0x7f8700101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.107+0000 7f8705800640 1 -- 172.21.15.1:0/864881813 shutdown_connections 2024-08-28T20:19:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.107+0000 7f8705800640 1 -- 172.21.15.1:0/864881813 wait complete. 2024-08-28T20:19:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.108+0000 7f8705800640 1 Processor -- start 2024-08-28T20:19:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.109+0000 7f8705800640 1 -- start start 2024-08-28T20:19:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f8705800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f8705800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 0x7f8700072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f8705800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700073340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f8705800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8700115670 con 0x7f8700076e90 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f8705800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87001154f0 con 0x7f8700075a90 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f8705800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87001157f0 con 0x7f870010fbd0 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f86fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f86fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59444/0 (socket says 172.21.15.1:59444) 2024-08-28T20:19:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.110+0000 7f86fea00640 1 -- 172.21.15.1:0/321307137 learned_addr learned my addr 172.21.15.1:0/321307137 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fe000640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 0x7f8700072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86ff400640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700073340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fea00640 1 -- 172.21.15.1:0/321307137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 msgr2=0x7f8700073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fea00640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700073340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fea00640 1 -- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 msgr2=0x7f8700072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fea00640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 0x7f8700072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fea00640 1 -- 172.21.15.1:0/321307137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8700073ad0 con 0x7f8700075a90 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86ff400640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fe000640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 0x7f8700072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.111+0000 7f86fea00640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700072120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86f800cce0 tx=0x7f86f800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.112+0000 7f86f7400640 1 -- 172.21.15.1:0/321307137 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f800f650 con 0x7f8700075a90 2024-08-28T20:19:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.112+0000 7f86f7400640 1 -- 172.21.15.1:0/321307137 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f800fca0 con 0x7f8700075a90 2024-08-28T20:19:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.112+0000 7f86f7400640 1 -- 172.21.15.1:0/321307137 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8018b40 con 0x7f8700075a90 2024-08-28T20:19:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.112+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8700073dc0 con 0x7f8700075a90 2024-08-28T20:19:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.112+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8700074330 con 0x7f8700075a90 2024-08-28T20:19:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.119+0000 7f86f7400640 1 -- 172.21.15.1:0/321307137 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f86f800f7f0 con 0x7f8700075a90 2024-08-28T20:19:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.119+0000 7f870c875740 1 Processor -- start 2024-08-28T20:19:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.120+0000 7f870c875740 1 -- start start 2024-08-28T20:19:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.121+0000 7f86f7400640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f86e40b4bf0 0x7f86e40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.121+0000 7f86f7400640 1 -- 172.21.15.1:0/321307137 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f86f80e56a0 con 0x7f8700075a90 2024-08-28T20:19:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.122+0000 7f86ff400640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f86e40b4bf0 0x7f86e40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.127+0000 7f870c875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c3862dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.127+0000 7f870c875740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c3863430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.127+0000 7f870c875740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3863f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.127+0000 7f870c875740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652c37d5f70 con 0x5652c34942f0 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f86fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c3862dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f870c875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5652c37c5500 con 0x5652c34bd1b0 2024-08-28T20:19:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f870c875740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5652c37c94b0 con 0x5652c349c4d0 2024-08-28T20:19:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f86fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c3862dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59452/0 (socket says 172.21.15.1:59452) 2024-08-28T20:19:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f86fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c3863430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f86ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3863f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f86fe000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c3863430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49754/0 (socket says 172.21.15.1:49754) 2024-08-28T20:19:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.128+0000 7f86fe000640 1 -- 172.21.15.1:0/4169582445 learned_addr learned my addr 172.21.15.1:0/4169582445 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.129+0000 7f86ff400640 1 -- 172.21.15.1:0/4169582445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 msgr2=0x5652c3862dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.129+0000 7f86ff400640 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c3862dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.129+0000 7f86ff400640 1 -- 172.21.15.1:0/4169582445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 msgr2=0x5652c3863430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.129+0000 7f86ff400640 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c3863430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.129+0000 7f86ff400640 1 -- 172.21.15.1:0/4169582445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c377fc10 con 0x5652c349c4d0 2024-08-28T20:19:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.131+0000 7f86ff400640 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3863f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009830 tx=0x7f86e8030550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2677ec65fca3323e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.131+0000 7f86ff400640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f86e40b4bf0 0x7f86e40b7100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86e8031000 tx=0x7f86e8039000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.132+0000 7f86efe00640 1 -- 172.21.15.1:0/4169582445 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8045070 con 0x5652c349c4d0 2024-08-28T20:19:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.132+0000 7f86efe00640 1 -- 172.21.15.1:0/4169582445 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8005500 con 0x5652c349c4d0 2024-08-28T20:19:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.132+0000 7f86efe00640 1 -- 172.21.15.1:0/4169582445 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8037070 con 0x5652c349c4d0 2024-08-28T20:19:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.134+0000 7f870c875740 1 -- 172.21.15.1:0/4169582445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 msgr2=0x5652c3863f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.134+0000 7f870c875740 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3863f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009830 tx=0x7f86e8030550 comp rx=0 tx=0).stop 2024-08-28T20:19:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.134+0000 7f870c875740 1 -- 172.21.15.1:0/4169582445 shutdown_connections 2024-08-28T20:19:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.134+0000 7f870c875740 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c3863430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.134+0000 7f870c875740 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3863f80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.134+0000 7f870c875740 1 --2- 172.21.15.1:0/4169582445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c3862dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.135+0000 7f870c875740 1 -- 172.21.15.1:0/4169582445 >> 172.21.15.1:0/4169582445 conn(0x5652c34b1300 msgr2=0x5652c385e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.135+0000 7f870c875740 1 -- 172.21.15.1:0/4169582445 shutdown_connections 2024-08-28T20:19:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.135+0000 7f870c875740 1 -- 172.21.15.1:0/4169582445 wait complete. 2024-08-28T20:19:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.136+0000 7f870c875740 1 -- start start 2024-08-28T20:19:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.136+0000 7f870c875740 1 Processor -- start 2024-08-28T20:19:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c386c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c349c4d0 0x5652c386cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 0x5652c386d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652c36feab0 con 0x5652c34942f0 2024-08-28T20:19:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5652c376c320 con 0x5652c349c4d0 2024-08-28T20:19:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5652c3864ae0 con 0x5652c34bd1b0 2024-08-28T20:19:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f870c875740 10 client.0 _ll_register_callbacks cb 0x5652c37726a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f86fe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c349c4d0 0x5652c386cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.137+0000 7f86ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 0x5652c386d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 0x5652c386d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43154/0 (socket says 172.21.15.1:43154) 2024-08-28T20:19:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 -- 172.21.15.1:0/1467363249 learned_addr learned my addr 172.21.15.1:0/1467363249 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86fe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c349c4d0 0x5652c386cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59466/0 (socket says 172.21.15.1:59466) 2024-08-28T20:19:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 -- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c349c4d0 msgr2=0x5652c386cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c349c4d0 0x5652c386cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 -- 172.21.15.1:0/1467363249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 msgr2=0x5652c386c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c386c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.138+0000 7f86ff400640 1 -- 172.21.15.1:0/1467363249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c3528790 con 0x5652c34bd1b0 2024-08-28T20:19:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.139+0000 7f86ff400640 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 0x5652c386d750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86e8044040 tx=0x7f86e8030a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b47fada186717c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.139+0000 7f86ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:19:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.141+0000 7f86ecc00640 1 -- 172.21.15.1:0/1467363249 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8037040 con 0x5652c34bd1b0 2024-08-28T20:19:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.141+0000 7f86ecc00640 1 -- 172.21.15.1:0/1467363249 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f86e8005250 con 0x5652c34bd1b0 2024-08-28T20:19:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.141+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e8005500 con 0x5652c34bd1b0 2024-08-28T20:19:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.141+0000 7f86ecc00640 1 -- 172.21.15.1:0/1467363249 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86e8045040 con 0x5652c34bd1b0 2024-08-28T20:19:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.141+0000 7f870c875740 10 client.25270 fetch_fsmap learned FSMap version 29 2024-08-28T20:19:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.141+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5652c35a1620 con 0x5652c34bd1b0 2024-08-28T20:19:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f86ecc00640 1 -- 172.21.15.1:0/1467363249 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8005500 con 0x5652c34bd1b0 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f86ecc00640 1 -- 172.21.15.1:0/1467363249 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f86e804a570 con 0x5652c34bd1b0 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f870c875740 10 client.25270 fetch_fsmap finished waiting for FSMap version 29 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f870c875740 10 client.25270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f870c875740 20 client.25270 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f870c875740 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c347bd80 0x5652c3879900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f870c875740 4 client.25270 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:19:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.142+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652c37d7ec0 con 0x5652c347bd80 2024-08-28T20:19:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.144+0000 7f86fea00640 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c347bd80 0x5652c3879900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.144+0000 7f86ecc00640 10 client.25270 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.144+0000 7f86fea00640 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c347bd80 0x5652c3879900 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60aed9676c01d0c server_cookie=d6c63f3787ab1956 in_seq=0 out_seq=0 2024-08-28T20:19:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.145+0000 7f86ecc00640 1 -- 172.21.15.1:0/1467363249 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652c37d7ec0 con 0x5652c347bd80 2024-08-28T20:19:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.145+0000 7f86ecc00640 10 client.25270 handle_command_reply: tid=0 2024-08-28T20:19:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.145+0000 7f870c875740 1 client.25270 shutdown 2024-08-28T20:19:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 msgr2=0x5652c386d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 0x5652c386d750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86e8044040 tx=0x7f86e8030a40 comp rx=0 tx=0).stop 2024-08-28T20:19:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 shutdown_connections 2024-08-28T20:19:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c347bd80 0x5652c3879900 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34bd1b0 0x5652c386d750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c349c4d0 0x5652c386cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 --2- 172.21.15.1:0/1467363249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34942f0 0x5652c386c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 >> 172.21.15.1:0/1467363249 conn(0x5652c34b1300 msgr2=0x5652c385ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f86ecc00640 0 client.25270 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 shutdown_connections 2024-08-28T20:19:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.148+0000 7f870c875740 1 -- 172.21.15.1:0/1467363249 wait complete. 2024-08-28T20:19:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.149+0000 7f870c875740 20 client.25270 trim_cache size 0 max 16384 2024-08-28T20:19:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.180+0000 7f870c875740 1 Processor -- start 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 -- start start 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34942f0 0x5652c385e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c349c4d0 0x5652c3874630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c386b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f87001bc410 con 0x5652c349c4d0 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87001b9cb0 con 0x5652c34bd1b0 2024-08-28T20:19:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.181+0000 7f870c875740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87001b7b00 con 0x5652c34942f0 2024-08-28T20:19:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.182+0000 7f86ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c386b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.182+0000 7f86ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c386b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59482/0 (socket says 172.21.15.1:59482) 2024-08-28T20:19:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.182+0000 7f86ff400640 1 -- 172.21.15.1:0/4255759722 learned_addr learned my addr 172.21.15.1:0/4255759722 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.182+0000 7f86fea00640 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34942f0 0x5652c385e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.182+0000 7f86fe000640 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c349c4d0 0x5652c3874630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.183+0000 7f86ff400640 1 -- 172.21.15.1:0/4255759722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34942f0 msgr2=0x5652c385e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.183+0000 7f86ff400640 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34942f0 0x5652c385e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.183+0000 7f86ff400640 1 -- 172.21.15.1:0/4255759722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c349c4d0 msgr2=0x5652c3874630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.183+0000 7f86ff400640 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c349c4d0 0x5652c3874630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.183+0000 7f86ff400640 1 -- 172.21.15.1:0/4255759722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c3863d20 con 0x5652c34bd1b0 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.183+0000 7f86ff400640 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c386b740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f86e804a910 tx=0x7f86e80303b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e823f64984a3a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.184+0000 7f86ef400640 1 -- 172.21.15.1:0/4255759722 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8037040 con 0x5652c34bd1b0 2024-08-28T20:19:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.184+0000 7f86ef400640 1 -- 172.21.15.1:0/4255759722 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8005460 con 0x5652c34bd1b0 2024-08-28T20:19:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.184+0000 7f86ef400640 1 -- 172.21.15.1:0/4255759722 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8037040 con 0x5652c34bd1b0 2024-08-28T20:19:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 -- 172.21.15.1:0/4255759722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 msgr2=0x5652c386b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c386b740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f86e804a910 tx=0x7f86e80303b0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 -- 172.21.15.1:0/4255759722 shutdown_connections 2024-08-28T20:19:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c349c4d0 0x5652c3874630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34bd1b0 0x5652c386b740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 --2- 172.21.15.1:0/4255759722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c34942f0 0x5652c385e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.185+0000 7f870c875740 1 -- 172.21.15.1:0/4255759722 >> 172.21.15.1:0/4255759722 conn(0x5652c34b1300 msgr2=0x5652c3879880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.186+0000 7f870c875740 1 -- 172.21.15.1:0/4255759722 shutdown_connections 2024-08-28T20:19:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.186+0000 7f870c875740 1 -- 172.21.15.1:0/4255759722 wait complete. 2024-08-28T20:19:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.186+0000 7f870c875740 1 -- start start 2024-08-28T20:19:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 Processor -- start 2024-08-28T20:19:00.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34942f0 0x5652c3873700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3873c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34bd1b0 0x5652c38722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f87001b8170 con 0x5652c34bd1b0 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87001b95e0 con 0x5652c34942f0 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87001b8840 con 0x5652c349c4d0 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.187+0000 7f870c875740 10 client.0 _ll_register_callbacks cb 0x7f86f0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.188+0000 7f86fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34942f0 0x5652c3873700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.188+0000 7f86fea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34942f0 0x5652c3873700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59490/0 (socket says 172.21.15.1:59490) 2024-08-28T20:19:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.188+0000 7f86fea00640 1 -- 172.21.15.1:0/1845099002 learned_addr learned my addr 172.21.15.1:0/1845099002 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.188+0000 7f86fe000640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3873c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.188+0000 7f86ff400640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34bd1b0 0x5652c38722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86fe000640 1 -- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34942f0 msgr2=0x5652c3873700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86fe000640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34942f0 0x5652c3873700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86fe000640 1 -- 172.21.15.1:0/1845099002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34bd1b0 msgr2=0x5652c38722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86fe000640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34bd1b0 0x5652c38722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86fe000640 1 -- 172.21.15.1:0/1845099002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c3872800 con 0x5652c349c4d0 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86fe000640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3873c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5652c38596e0 tx=0x7f86f0014d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7253e7e7fc29bb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86ff400640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34bd1b0 0x5652c38722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.189+0000 7f86ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.190+0000 7f86ecc00640 1 -- 172.21.15.1:0/1845099002 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0023060 con 0x5652c349c4d0 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.190+0000 7f86ecc00640 1 -- 172.21.15.1:0/1845099002 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f86f0011b70 con 0x5652c349c4d0 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.190+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e8005460 con 0x5652c349c4d0 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.191+0000 7f86ecc00640 1 -- 172.21.15.1:0/1845099002 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86f0011d70 con 0x5652c349c4d0 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.191+0000 7f870c875740 10 client.25276 fetch_fsmap learned FSMap version 29 2024-08-28T20:19:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.191+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5652c38e4a60 con 0x5652c349c4d0 2024-08-28T20:19:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.191+0000 7f86ecc00640 1 -- 172.21.15.1:0/1845099002 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e8005460 con 0x5652c349c4d0 2024-08-28T20:19:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f86ecc00640 1 -- 172.21.15.1:0/1845099002 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f86f001d3e0 con 0x5652c349c4d0 2024-08-28T20:19:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f870c875740 10 client.25276 fetch_fsmap finished waiting for FSMap version 29 2024-08-28T20:19:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f870c875740 10 client.25276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f870c875740 20 client.25276 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f870c875740 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c34511c0 0x5652c38e7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f870c875740 4 client.25276 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:19:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.192+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652c37d3960 con 0x5652c34511c0 2024-08-28T20:19:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.193+0000 7f86fea00640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c34511c0 0x5652c38e7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.193+0000 7f86fea00640 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c34511c0 0x5652c38e7470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3472d6e4ed2a064b server_cookie=8710a1278d482201 in_seq=0 out_seq=0 2024-08-28T20:19:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.193+0000 7f86ecc00640 10 client.25276 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.210+0000 7f86ecc00640 1 -- 172.21.15.1:0/1845099002 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652c37d3960 con 0x5652c34511c0 2024-08-28T20:19:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.210+0000 7f86ecc00640 10 client.25276 handle_command_reply: tid=0 2024-08-28T20:19:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.210+0000 7f870c875740 1 client.25276 shutdown 2024-08-28T20:19:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 msgr2=0x5652c3873c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3873c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5652c38596e0 tx=0x7f86f0014d90 comp rx=0 tx=0).stop 2024-08-28T20:19:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 shutdown_connections 2024-08-28T20:19:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652c34511c0 0x5652c38e7470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652c34bd1b0 0x5652c38722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652c349c4d0 0x5652c3873c40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 --2- 172.21.15.1:0/1845099002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652c34942f0 0x5652c3873700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.211+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 >> 172.21.15.1:0/1845099002 conn(0x5652c34b1300 msgr2=0x5652c3867630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.212+0000 7f86ecc00640 0 client.25276 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.212+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 shutdown_connections 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.212+0000 7f870c875740 1 -- 172.21.15.1:0/1845099002 wait complete. 2024-08-28T20:19:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.212+0000 7f870c875740 20 client.25276 trim_cache size 0 max 16384 2024-08-28T20:19:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:19:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:19:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:19:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f86e40b4bf0 msgr2=0x7f86e40b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f86e40b4bf0 0x7f86e40b7100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86e8031000 tx=0x7f86e8039000 comp rx=0 tx=0).stop 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 msgr2=0x7f8700072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700072120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86f800cce0 tx=0x7f86f800a620 comp rx=0 tx=0).stop 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 shutdown_connections 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f86e40b4bf0 0x7f86e40b7100 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8700076e90 0x7f8700072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f870010fbd0 0x7f8700073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 --2- 172.21.15.1:0/321307137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8700075a90 0x7f8700072120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 >> 172.21.15.1:0/321307137 conn(0x7f87000fed90 msgr2=0x7f87000ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 shutdown_connections 2024-08-28T20:19:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:00.214+0000 7f8705800640 1 -- 172.21.15.1:0/321307137 wait complete. 2024-08-28T20:19:01.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:01 smithi007 ceph-mon[25357]: pgmap v392: 97 pgs: 97 active+clean; 991 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-08-28T20:19:01.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:01 smithi001 ceph-mon[20984]: pgmap v392: 97 pgs: 97 active+clean; 991 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-08-28T20:19:01.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:01 smithi121 ceph-mon[25248]: pgmap v392: 97 pgs: 97 active+clean; 991 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-08-28T20:19:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 35.0 s, 3494.1 tps, lat 28.569 ms stddev 31.078 2024-08-28T20:19:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:03 smithi001 ceph-mon[20984]: pgmap v393: 97 pgs: 97 active+clean; 992 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 696 op/s 2024-08-28T20:19:03.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:03 smithi121 ceph-mon[25248]: pgmap v393: 97 pgs: 97 active+clean; 992 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 696 op/s 2024-08-28T20:19:04.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:03 smithi007 ceph-mon[25357]: pgmap v393: 97 pgs: 97 active+clean; 992 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 696 op/s 2024-08-28T20:19:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:05 smithi001 ceph-mon[20984]: pgmap v394: 97 pgs: 97 active+clean; 981 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 832 op/s 2024-08-28T20:19:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:05 smithi121 ceph-mon[25248]: pgmap v394: 97 pgs: 97 active+clean; 981 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 832 op/s 2024-08-28T20:19:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:05 smithi007 ceph-mon[25357]: pgmap v394: 97 pgs: 97 active+clean; 981 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 832 op/s 2024-08-28T20:19:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:07 smithi001 ceph-mon[20984]: pgmap v395: 97 pgs: 97 active+clean; 991 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 720 op/s 2024-08-28T20:19:07.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:07 smithi121 ceph-mon[25248]: pgmap v395: 97 pgs: 97 active+clean; 991 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 720 op/s 2024-08-28T20:19:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:07 smithi007 ceph-mon[25357]: pgmap v395: 97 pgs: 97 active+clean; 991 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 720 op/s 2024-08-28T20:19:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 40.0 s, 3657.2 tps, lat 27.311 ms stddev 28.862 2024-08-28T20:19:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:09 smithi001 ceph-mon[20984]: pgmap v396: 97 pgs: 97 active+clean; 991 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 820 op/s 2024-08-28T20:19:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:09 smithi121 ceph-mon[25248]: pgmap v396: 97 pgs: 97 active+clean; 991 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 820 op/s 2024-08-28T20:19:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:09 smithi007 ceph-mon[25357]: pgmap v396: 97 pgs: 97 active+clean; 991 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 820 op/s 2024-08-28T20:19:10.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:10 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:19:10.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:10 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:19:11.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:10 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:19:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:11 smithi001 ceph-mon[20984]: pgmap v397: 97 pgs: 97 active+clean; 996 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 822 op/s 2024-08-28T20:19:11.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:11 smithi121 ceph-mon[25248]: pgmap v397: 97 pgs: 97 active+clean; 996 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 822 op/s 2024-08-28T20:19:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:11 smithi007 ceph-mon[25357]: pgmap v397: 97 pgs: 97 active+clean; 996 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 822 op/s 2024-08-28T20:19:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 -- 172.21.15.1:0/3191915697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2901054b0 msgr2=0x7ff290105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 --2- 172.21.15.1:0/3191915697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2901054b0 0x7ff290105920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff280009900 tx=0x7ff28002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 -- 172.21.15.1:0/3191915697 shutdown_connections 2024-08-28T20:19:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 --2- 172.21.15.1:0/3191915697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff290106530 0x7ff290106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 --2- 172.21.15.1:0/3191915697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff290106ed0 0x7ff29010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 --2- 172.21.15.1:0/3191915697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2901054b0 0x7ff290105920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 -- 172.21.15.1:0/3191915697 >> 172.21.15.1:0/3191915697 conn(0x7ff290100df0 msgr2=0x7ff2901032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.513+0000 7ff295600640 1 -- 172.21.15.1:0/3191915697 shutdown_connections 2024-08-28T20:19:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.514+0000 7ff295600640 1 -- 172.21.15.1:0/3191915697 wait complete. 2024-08-28T20:19:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 Processor -- start 2024-08-28T20:19:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 -- start start 2024-08-28T20:19:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 0x7ff290077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff290106530 0x7ff290077fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff290106ed0 0x7ff290078b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff290111130 con 0x7ff290106ed0 2024-08-28T20:19:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff290110fb0 con 0x7ff2901054b0 2024-08-28T20:19:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.515+0000 7ff295600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901112b0 con 0x7ff290106530 2024-08-28T20:19:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 0x7ff290077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 0x7ff290077960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44122/0 (socket says 172.21.15.1:44122) 2024-08-28T20:19:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 -- 172.21.15.1:0/777027875 learned_addr learned my addr 172.21.15.1:0/777027875 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff294c00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff290106ed0 0x7ff290078b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28f400640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff290106530 0x7ff290077fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 -- 172.21.15.1:0/777027875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff290106530 msgr2=0x7ff290077fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff290106530 0x7ff290077fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 -- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff290106ed0 msgr2=0x7ff290078b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff290106ed0 0x7ff290078b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.516+0000 7ff28fe00640 1 -- 172.21.15.1:0/777027875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900793a0 con 0x7ff2901054b0 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.517+0000 7ff28f400640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff290106530 0x7ff290077fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.517+0000 7ff28fe00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 0x7ff290077960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2800058c0 tx=0x7ff280003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.517+0000 7ff28cc00640 1 -- 172.21.15.1:0/777027875 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28003f070 con 0x7ff2901054b0 2024-08-28T20:19:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.517+0000 7ff28cc00640 1 -- 172.21.15.1:0/777027875 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff280031bc0 con 0x7ff2901054b0 2024-08-28T20:19:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.517+0000 7ff28cc00640 1 -- 172.21.15.1:0/777027875 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280035030 con 0x7ff2901054b0 2024-08-28T20:19:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.519+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff290079630 con 0x7ff2901054b0 2024-08-28T20:19:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.519+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff290079b70 con 0x7ff2901054b0 2024-08-28T20:19:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.523+0000 7ff29de3e740 1 Processor -- start 2024-08-28T20:19:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.524+0000 7ff29de3e740 1 -- start start 2024-08-28T20:19:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.525+0000 7ff28cc00640 1 -- 172.21.15.1:0/777027875 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ff280042070 con 0x7ff2901054b0 2024-08-28T20:19:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff28cc00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2740b4c20 0x7ff2740b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3dac11b0 0x557b3de66fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de67610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 0x557b3de68160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff29de3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557b3ddd9f70 con 0x557b3dac11b0 2024-08-28T20:19:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff29de3e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557b3ddc9500 con 0x557b3daa04d0 2024-08-28T20:19:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff29de3e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557b3ddcd4b0 con 0x557b3da982f0 2024-08-28T20:19:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff294c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 0x557b3de68160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff28cc00640 1 -- 172.21.15.1:0/777027875 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff2801060a0 con 0x7ff2901054b0 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.527+0000 7ff294c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 0x557b3de68160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44134/0 (socket says 172.21.15.1:44134) 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.528+0000 7ff294c00640 1 -- 172.21.15.1:0/4065760125 learned_addr learned my addr 172.21.15.1:0/4065760125 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.528+0000 7ff294c00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2740b4c20 0x7ff2740b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.528+0000 7ff28fe00640 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3dac11b0 0x557b3de66fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.528+0000 7ff28f400640 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de67610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.528+0000 7ff294c00640 1 -- 172.21.15.1:0/4065760125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 msgr2=0x557b3de67610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.529+0000 7ff294c00640 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de67610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.529+0000 7ff294c00640 1 -- 172.21.15.1:0/4065760125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3dac11b0 msgr2=0x557b3de66fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.529+0000 7ff294c00640 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3dac11b0 0x557b3de66fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.529+0000 7ff294c00640 1 -- 172.21.15.1:0/4065760125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3dd83c10 con 0x557b3daa04d0 2024-08-28T20:19:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.529+0000 7ff294c00640 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 0x557b3de68160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff288012da0 tx=0x7ff2880107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2183431bdb491e1f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.530+0000 7ff294c00640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2740b4c20 0x7ff2740b7130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff28800f000 tx=0x7ff28801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.530+0000 7ff285200640 1 -- 172.21.15.1:0/4065760125 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288012e90 con 0x557b3daa04d0 2024-08-28T20:19:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.530+0000 7ff285200640 1 -- 172.21.15.1:0/4065760125 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff288023070 con 0x557b3daa04d0 2024-08-28T20:19:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.530+0000 7ff285200640 1 -- 172.21.15.1:0/4065760125 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28801eb10 con 0x557b3daa04d0 2024-08-28T20:19:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.531+0000 7ff29de3e740 1 -- 172.21.15.1:0/4065760125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 msgr2=0x557b3de68160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.531+0000 7ff29de3e740 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 0x557b3de68160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff288012da0 tx=0x7ff2880107a0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 -- 172.21.15.1:0/4065760125 shutdown_connections 2024-08-28T20:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3daa04d0 0x557b3de68160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de67610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 --2- 172.21.15.1:0/4065760125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3dac11b0 0x557b3de66fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 -- 172.21.15.1:0/4065760125 >> 172.21.15.1:0/4065760125 conn(0x557b3dab5300 msgr2=0x557b3de62a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 -- 172.21.15.1:0/4065760125 shutdown_connections 2024-08-28T20:19:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.532+0000 7ff29de3e740 1 -- 172.21.15.1:0/4065760125 wait complete. 2024-08-28T20:19:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.533+0000 7ff29de3e740 1 -- start start 2024-08-28T20:19:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.533+0000 7ff29de3e740 1 Processor -- start 2024-08-28T20:19:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.534+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de70650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.534+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de70d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.534+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 0x557b3de71880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.534+0000 7ff29de3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557b3dd02ab0 con 0x557b3da982f0 2024-08-28T20:19:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.534+0000 7ff29de3e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557b3dd70320 con 0x557b3dac11b0 2024-08-28T20:19:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.534+0000 7ff29de3e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557b3de68c20 con 0x557b3daa04d0 2024-08-28T20:19:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff29de3e740 10 client.0 _ll_register_callbacks cb 0x557b3dd766a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff28f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de70d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 0x557b3de71880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 0x557b3de71880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44140/0 (socket says 172.21.15.1:44140) 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 -- 172.21.15.1:0/2423775499 learned_addr learned my addr 172.21.15.1:0/2423775499 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff28fe00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de70650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 -- 172.21.15.1:0/2423775499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 msgr2=0x557b3de70d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de70d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 -- 172.21.15.1:0/2423775499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 msgr2=0x557b3de70650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de70650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff294c00640 1 -- 172.21.15.1:0/2423775499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3db2c790 con 0x557b3dac11b0 2024-08-28T20:19:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.535+0000 7ff28fe00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de70650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.536+0000 7ff27d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.536+0000 7ff294c00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 0x557b3de71880 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff288009d50 tx=0x7ff288005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db4355ded683ff2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.536+0000 7ff27d600640 1 -- 172.21.15.1:0/2423775499 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880128b0 con 0x557b3dac11b0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.536+0000 7ff27d600640 1 -- 172.21.15.1:0/2423775499 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff288003970 con 0x557b3dac11b0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.536+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff288023070 con 0x557b3dac11b0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.537+0000 7ff27d600640 1 -- 172.21.15.1:0/2423775499 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff288003b70 con 0x557b3dac11b0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.537+0000 7ff29de3e740 10 client.25304 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.537+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557b3dba5620 con 0x557b3dac11b0 2024-08-28T20:19:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.537+0000 7ff27d600640 1 -- 172.21.15.1:0/2423775499 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff288023070 con 0x557b3dac11b0 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff27d600640 1 -- 172.21.15.1:0/2423775499 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff288004050 con 0x557b3dac11b0 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff29de3e740 10 client.25304 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff29de3e740 10 client.25304 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff29de3e740 20 client.25304 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3da7fd80 0x557b3de7dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff29de3e740 4 client.25304 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b3dddbec0 con 0x557b3da7fd80 2024-08-28T20:19:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.538+0000 7ff28fe00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3da7fd80 0x557b3de7dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.539+0000 7ff28fe00640 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3da7fd80 0x557b3de7dae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e74b9e268ddfa0c server_cookie=e52cca76aa90e6f7 in_seq=0 out_seq=0 2024-08-28T20:19:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.539+0000 7ff27d600640 10 client.25304 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.540+0000 7ff27d600640 1 -- 172.21.15.1:0/2423775499 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b3dddbec0 con 0x557b3da7fd80 2024-08-28T20:19:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.540+0000 7ff27d600640 10 client.25304 handle_command_reply: tid=0 2024-08-28T20:19:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.540+0000 7ff29de3e740 1 client.25304 shutdown 2024-08-28T20:19:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 msgr2=0x557b3de71880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 0x557b3de71880 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff288009d50 tx=0x7ff288005a90 comp rx=0 tx=0).stop 2024-08-28T20:19:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 shutdown_connections 2024-08-28T20:19:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3da7fd80 0x557b3de7dae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff27d600640 0 client.25304 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3dac11b0 0x557b3de71880 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de70d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2423775499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de70650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.542+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 >> 172.21.15.1:0/2423775499 conn(0x557b3dab5300 msgr2=0x557b3de60f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.543+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 shutdown_connections 2024-08-28T20:19:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.543+0000 7ff29de3e740 1 -- 172.21.15.1:0/2423775499 wait complete. 2024-08-28T20:19:13.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.543+0000 7ff29de3e740 20 client.25304 trim_cache size 0 max 16384 2024-08-28T20:19:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.572+0000 7ff29de3e740 1 Processor -- start 2024-08-28T20:19:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 -- start start 2024-08-28T20:19:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de6f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de61bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901b39e0 con 0x557b3da982f0 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901b1250 con 0x557b3da7fd80 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff29de3e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901af0a0 con 0x557b3daa04d0 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff28fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de6f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff28fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de6f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44142/0 (socket says 172.21.15.1:44142) 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff28fe00640 1 -- 172.21.15.1:0/583788987 learned_addr learned my addr 172.21.15.1:0/583788987 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.573+0000 7ff294c00640 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de61bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff294c00640 1 -- 172.21.15.1:0/583788987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 msgr2=0x557b3de6f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff294c00640 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de6f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff294c00640 1 -- 172.21.15.1:0/583788987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 msgr2=0x557b3de616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff294c00640 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff294c00640 1 -- 172.21.15.1:0/583788987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3de78b20 con 0x557b3daa04d0 2024-08-28T20:19:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff294c00640 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de61bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff288006010 tx=0x7ff288005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90862c016f4fdcb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.574+0000 7ff27fe00640 1 -- 172.21.15.1:0/583788987 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288003970 con 0x557b3daa04d0 2024-08-28T20:19:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.575+0000 7ff27fe00640 1 -- 172.21.15.1:0/583788987 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff288023040 con 0x557b3daa04d0 2024-08-28T20:19:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.575+0000 7ff27fe00640 1 -- 172.21.15.1:0/583788987 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288003f90 con 0x557b3daa04d0 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 -- 172.21.15.1:0/583788987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 msgr2=0x557b3de61bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de61bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff288006010 tx=0x7ff288005b00 comp rx=0 tx=0).stop 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 -- 172.21.15.1:0/583788987 shutdown_connections 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3da982f0 0x557b3de616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3daa04d0 0x557b3de61bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 --2- 172.21.15.1:0/583788987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de6f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 -- 172.21.15.1:0/583788987 >> 172.21.15.1:0/583788987 conn(0x557b3dab5300 msgr2=0x557b3de623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 -- 172.21.15.1:0/583788987 shutdown_connections 2024-08-28T20:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.576+0000 7ff29de3e740 1 -- 172.21.15.1:0/583788987 wait complete. 2024-08-28T20:19:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.577+0000 7ff29de3e740 1 -- start start 2024-08-28T20:19:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.577+0000 7ff29de3e740 1 Processor -- start 2024-08-28T20:19:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.578+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de783c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.578+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de741d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.578+0000 7ff29de3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3daa04d0 0x557b3de74870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff29de3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901af710 con 0x557b3daa04d0 2024-08-28T20:19:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff29de3e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901b0b80 con 0x557b3da7fd80 2024-08-28T20:19:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff29de3e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2901afde0 con 0x557b3da982f0 2024-08-28T20:19:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff29de3e740 10 client.0 _ll_register_callbacks cb 0x7ff288009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de741d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51992/0 (socket says 172.21.15.1:51992) 2024-08-28T20:19:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28f400640 1 -- 172.21.15.1:0/2228170101 learned_addr learned my addr 172.21.15.1:0/2228170101 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28f400640 1 -- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 msgr2=0x557b3de783c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28f400640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de783c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.579+0000 7ff28f400640 1 -- 172.21.15.1:0/2228170101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3daa04d0 msgr2=0x557b3de74870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.580+0000 7ff294c00640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3daa04d0 0x557b3de74870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.580+0000 7ff28f400640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3daa04d0 0x557b3de74870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.580+0000 7ff28f400640 1 -- 172.21.15.1:0/2228170101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3de75410 con 0x557b3da982f0 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.580+0000 7ff294c00640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3daa04d0 0x557b3de74870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.581+0000 7ff28f400640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de741d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff278013710 tx=0x7ff278013bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a44bcbde473e3de3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.581+0000 7ff27d600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.581+0000 7ff27d600640 1 -- 172.21.15.1:0/2228170101 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278011e10 con 0x557b3da982f0 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.581+0000 7ff27d600640 1 -- 172.21.15.1:0/2228170101 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff278005020 con 0x557b3da982f0 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.582+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff288023040 con 0x557b3da982f0 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.582+0000 7ff27d600640 1 -- 172.21.15.1:0/2228170101 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff278005220 con 0x557b3da982f0 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.582+0000 7ff29de3e740 10 client.25291 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.582+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557b3dee88f0 con 0x557b3da982f0 2024-08-28T20:19:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.582+0000 7ff27d600640 1 -- 172.21.15.1:0/2228170101 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff288023040 con 0x557b3da982f0 2024-08-28T20:19:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff27d600640 1 -- 172.21.15.1:0/2228170101 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff27801a070 con 0x557b3da982f0 2024-08-28T20:19:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff29de3e740 10 client.25291 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff29de3e740 10 client.25291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff29de3e740 20 client.25291 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3dac11b0 0x557b3deeb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff29de3e740 4 client.25291 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:19:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.584+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b3ddd7960 con 0x557b3dac11b0 2024-08-28T20:19:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.585+0000 7ff28fe00640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3dac11b0 0x557b3deeb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.587+0000 7ff27d600640 10 client.25291 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.587+0000 7ff28fe00640 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3dac11b0 0x557b3deeb340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b76b8ee70f440bc server_cookie=6d1667c1ff95c7d in_seq=0 out_seq=0 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.673+0000 7ff27d600640 1 -- 172.21.15.1:0/2228170101 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b3ddd7960 con 0x557b3dac11b0 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.673+0000 7ff27d600640 10 client.25291 handle_command_reply: tid=0 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.674+0000 7ff29de3e740 1 client.25291 shutdown 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.674+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 msgr2=0x557b3de741d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.674+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de741d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff278013710 tx=0x7ff278013bd0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.674+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 shutdown_connections 2024-08-28T20:19:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.674+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557b3dac11b0 0x557b3deeb340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b3daa04d0 0x557b3de74870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b3da982f0 0x557b3de741d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff29de3e740 1 --2- 172.21.15.1:0/2228170101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b3da7fd80 0x557b3de783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 >> 172.21.15.1:0/2228170101 conn(0x557b3dab5300 msgr2=0x557b3de6d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff27d600640 0 client.25291 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 shutdown_connections 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.675+0000 7ff29de3e740 1 -- 172.21.15.1:0/2228170101 wait complete. 2024-08-28T20:19:13.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.676+0000 7ff29de3e740 20 client.25291 trim_cache size 0 max 16384 2024-08-28T20:19:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:19:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:19:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:19:13.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.677+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2740b4c20 msgr2=0x7ff2740b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.677+0000 7ff295600640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2740b4c20 0x7ff2740b7130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff28800f000 tx=0x7ff28801e000 comp rx=0 tx=0).stop 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.677+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 msgr2=0x7ff290077960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.677+0000 7ff295600640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 0x7ff290077960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2800058c0 tx=0x7ff280003c10 comp rx=0 tx=0).stop 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 shutdown_connections 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2740b4c20 0x7ff2740b7130 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff290106ed0 0x7ff290078b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff290106530 0x7ff290077fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 --2- 172.21.15.1:0/777027875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2901054b0 0x7ff290077960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 >> 172.21.15.1:0/777027875 conn(0x7ff290100df0 msgr2=0x7ff290109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.678+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 shutdown_connections 2024-08-28T20:19:13.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:13.679+0000 7ff295600640 1 -- 172.21.15.1:0/777027875 wait complete. 2024-08-28T20:19:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 45.0 s, 3222.7 tps, lat 31.052 ms stddev 35.442 2024-08-28T20:19:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:13 smithi001 ceph-mon[20984]: pgmap v398: 97 pgs: 97 active+clean; 996 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 770 op/s 2024-08-28T20:19:13.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:13 smithi121 ceph-mon[25248]: pgmap v398: 97 pgs: 97 active+clean; 996 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 770 op/s 2024-08-28T20:19:14.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:13 smithi007 ceph-mon[25357]: pgmap v398: 97 pgs: 97 active+clean; 996 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 770 op/s 2024-08-28T20:19:15.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:15 smithi001 ceph-mon[20984]: pgmap v399: 97 pgs: 97 active+clean; 996 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 844 op/s 2024-08-28T20:19:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:15 smithi121 ceph-mon[25248]: pgmap v399: 97 pgs: 97 active+clean; 996 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 844 op/s 2024-08-28T20:19:16.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:15 smithi007 ceph-mon[25357]: pgmap v399: 97 pgs: 97 active+clean; 996 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 844 op/s 2024-08-28T20:19:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:17 smithi001 ceph-mon[20984]: pgmap v400: 97 pgs: 97 active+clean; 1004 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-08-28T20:19:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:17 smithi121 ceph-mon[25248]: pgmap v400: 97 pgs: 97 active+clean; 1004 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-08-28T20:19:18.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:17 smithi007 ceph-mon[25357]: pgmap v400: 97 pgs: 97 active+clean; 1004 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-08-28T20:19:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 50.0 s, 3724.4 tps, lat 26.829 ms stddev 29.680 2024-08-28T20:19:18.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:18 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:19:18.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:18 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:19:19.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:18 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:19:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:19 smithi007 ceph-mon[25357]: pgmap v401: 97 pgs: 97 active+clean; 1006 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.1 MiB/s wr, 795 op/s 2024-08-28T20:19:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:19 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:19 smithi001 ceph-mon[20984]: pgmap v401: 97 pgs: 97 active+clean; 1006 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.1 MiB/s wr, 795 op/s 2024-08-28T20:19:20.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:19 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:19 smithi121 ceph-mon[25248]: pgmap v401: 97 pgs: 97 active+clean; 1006 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.1 MiB/s wr, 795 op/s 2024-08-28T20:19:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:20.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:19 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:21.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:19:21.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:19:21.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:21.129 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:19:21.129 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:19:21.129 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:21.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:19:21.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:19:21.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:19:22.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:21 smithi001 ceph-mon[20984]: pgmap v402: 97 pgs: 97 active+clean; 1015 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 9.5 MiB/s wr, 781 op/s 2024-08-28T20:19:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:21 smithi121 ceph-mon[25248]: pgmap v402: 97 pgs: 97 active+clean; 1015 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 9.5 MiB/s wr, 781 op/s 2024-08-28T20:19:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:21 smithi007 ceph-mon[25357]: pgmap v402: 97 pgs: 97 active+clean; 1015 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 9.5 MiB/s wr, 781 op/s 2024-08-28T20:19:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 55.0 s, 3009.9 tps, lat 33.140 ms stddev 35.706 2024-08-28T20:19:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:23 smithi001 ceph-mon[20984]: pgmap v403: 97 pgs: 97 active+clean; 1016 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.8 MiB/s wr, 740 op/s 2024-08-28T20:19:24.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:23 smithi121 ceph-mon[25248]: pgmap v403: 97 pgs: 97 active+clean; 1016 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.8 MiB/s wr, 740 op/s 2024-08-28T20:19:24.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:23 smithi007 ceph-mon[25357]: pgmap v403: 97 pgs: 97 active+clean; 1016 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.8 MiB/s wr, 740 op/s 2024-08-28T20:19:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:25 smithi001 ceph-mon[20984]: pgmap v404: 97 pgs: 97 active+clean; 1016 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 9.9 MiB/s wr, 820 op/s 2024-08-28T20:19:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:25 smithi121 ceph-mon[25248]: pgmap v404: 97 pgs: 97 active+clean; 1016 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 9.9 MiB/s wr, 820 op/s 2024-08-28T20:19:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:25 smithi007 ceph-mon[25357]: pgmap v404: 97 pgs: 97 active+clean; 1016 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 9.9 MiB/s wr, 820 op/s 2024-08-28T20:19:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.002+0000 7f746f200640 1 -- 172.21.15.1:0/883587566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470076e90 msgr2=0x7f7470075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.002+0000 7f746f200640 1 --2- 172.21.15.1:0/883587566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470076e90 0x7f7470075550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7460009900 tx=0x7f746002a420 comp rx=0 tx=0).stop 2024-08-28T20:19:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.003+0000 7f746f200640 1 -- 172.21.15.1:0/883587566 shutdown_connections 2024-08-28T20:19:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.003+0000 7f746f200640 1 --2- 172.21.15.1:0/883587566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f747010fab0 0x7f7470111ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.003+0000 7f746f200640 1 --2- 172.21.15.1:0/883587566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470075a90 0x7f7470075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.003+0000 7f746f200640 1 --2- 172.21.15.1:0/883587566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470076e90 0x7f7470075550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.003+0000 7f746f200640 1 -- 172.21.15.1:0/883587566 >> 172.21.15.1:0/883587566 conn(0x7f74700fec50 msgr2=0x7f7470101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.004+0000 7f746f200640 1 -- 172.21.15.1:0/883587566 shutdown_connections 2024-08-28T20:19:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.004+0000 7f746f200640 1 -- 172.21.15.1:0/883587566 wait complete. 2024-08-28T20:19:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.005+0000 7f746f200640 1 Processor -- start 2024-08-28T20:19:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.006+0000 7f746f200640 1 -- start start 2024-08-28T20:19:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.006+0000 7f746f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 0x7f74701a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.006+0000 7f746f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 0x7f74701a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.006+0000 7f746f200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f747010fab0 0x7f74701a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.007+0000 7f746de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 0x7f74701a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.007+0000 7f746d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 0x7f74701a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.007+0000 7f746d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 0x7f74701a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:45636/0 (socket says 172.21.15.1:45636) 2024-08-28T20:19:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.007+0000 7f746de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 0x7f74701a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47942/0 (socket says 172.21.15.1:47942) 2024-08-28T20:19:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.008+0000 7f746d400640 1 -- 172.21.15.1:0/2623989587 learned_addr learned my addr 172.21.15.1:0/2623989587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.008+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7470115500 con 0x7f747010fab0 2024-08-28T20:19:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.008+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7470115380 con 0x7f7470076e90 2024-08-28T20:19:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.008+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7470115680 con 0x7f7470075a90 2024-08-28T20:19:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.009+0000 7f746d400640 1 -- 172.21.15.1:0/2623989587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 msgr2=0x7f74701a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.009+0000 7f746d400640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 0x7f74701a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.009+0000 7f746d400640 1 -- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f747010fab0 msgr2=0x7f74701a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.009+0000 7f746d400640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f747010fab0 0x7f74701a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.009+0000 7f746d400640 1 -- 172.21.15.1:0/2623989587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74701a1b60 con 0x7f7470076e90 2024-08-28T20:19:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.009+0000 7f746de00640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 0x7f74701a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:19:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.010+0000 7f746d400640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 0x7f74701a0790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9f0 tx=0x7f745c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.010+0000 7f7466a00640 1 -- 172.21.15.1:0/2623989587 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c00cd80 con 0x7f7470076e90 2024-08-28T20:19:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.011+0000 7f7466a00640 1 -- 172.21.15.1:0/2623989587 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0108e0 con 0x7f7470076e90 2024-08-28T20:19:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.011+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74701a1e50 con 0x7f7470076e90 2024-08-28T20:19:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.011+0000 7f7466a00640 1 -- 172.21.15.1:0/2623989587 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c018980 con 0x7f7470076e90 2024-08-28T20:19:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.011+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701a8540 con 0x7f7470076e90 2024-08-28T20:19:27.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.019+0000 7f747c415740 1 Processor -- start 2024-08-28T20:19:27.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.020+0000 7f747c415740 1 -- start start 2024-08-28T20:19:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f747c415740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 0x557c40b41d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f747c415740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f747c415740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b42f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f747c415740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c40ab4f70 con 0x557c407732f0 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f747c415740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557c40aa4500 con 0x557c4079c1b0 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f747c415740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557c40aa84b0 con 0x557c4077b4d0 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f746e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 0x557c40b41d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f746e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 0x557c40b41d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:45642/0 (socket says 172.21.15.1:45642) 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f746e800640 1 -- 172.21.15.1:0/4126063192 learned_addr learned my addr 172.21.15.1:0/4126063192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.021+0000 7f746de00640 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746e800640 1 -- 172.21.15.1:0/4126063192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 msgr2=0x557c40b42f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746e800640 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b42f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746e800640 1 -- 172.21.15.1:0/4126063192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 msgr2=0x557c40b423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746e800640 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746e800640 1 -- 172.21.15.1:0/4126063192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c40a5ec10 con 0x557c4079c1b0 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746de00640 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:19:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.022+0000 7f746e800640 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 0x557c40b41d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7468009ea0 tx=0x7f7468009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e838e97abff0ed3f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.023+0000 7f7466a00640 1 -- 172.21.15.1:0/2623989587 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f745c010430 con 0x7f7470076e90 2024-08-28T20:19:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.025+0000 7f745b400640 1 -- 172.21.15.1:0/4126063192 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004d20 con 0x557c4079c1b0 2024-08-28T20:19:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.025+0000 7f745b400640 1 -- 172.21.15.1:0/4126063192 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f746800ee60 con 0x557c4079c1b0 2024-08-28T20:19:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.025+0000 7f745b400640 1 -- 172.21.15.1:0/4126063192 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468010850 con 0x557c4079c1b0 2024-08-28T20:19:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.025+0000 7f7466a00640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f74540b4cb0 0x7f74540b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 -- 172.21.15.1:0/4126063192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 msgr2=0x557c40b41d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 0x557c40b41d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7468009ea0 tx=0x7f7468009f90 comp rx=0 tx=0).stop 2024-08-28T20:19:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f7466a00640 1 -- 172.21.15.1:0/2623989587 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f745c0e53d0 con 0x7f7470076e90 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f746de00640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f74540b4cb0 0x7f74540b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 -- 172.21.15.1:0/4126063192 shutdown_connections 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b42f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 --2- 172.21.15.1:0/4126063192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4079c1b0 0x557c40b41d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 -- 172.21.15.1:0/4126063192 >> 172.21.15.1:0/4126063192 conn(0x557c40790300 msgr2=0x557c40b3d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 -- 172.21.15.1:0/4126063192 shutdown_connections 2024-08-28T20:19:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.026+0000 7f747c415740 1 -- 172.21.15.1:0/4126063192 wait complete. 2024-08-28T20:19:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.027+0000 7f746de00640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f74540b4cb0 0x7f74540b71c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7460006010 tx=0x7f7460000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.027+0000 7f747c415740 1 -- start start 2024-08-28T20:19:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.027+0000 7f747c415740 1 Processor -- start 2024-08-28T20:19:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f747c415740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b4b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f747c415740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b4bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f747c415740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b4c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f746de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b4b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f746d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b4bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f746de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b4b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:45656/0 (socket says 172.21.15.1:45656) 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f746d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b4bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47956/0 (socket says 172.21.15.1:47956) 2024-08-28T20:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.028+0000 7f746de00640 1 -- 172.21.15.1:0/2741410413 learned_addr learned my addr 172.21.15.1:0/2741410413 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c409ddab0 con 0x557c4079c1b0 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557c40a4b320 con 0x557c407732f0 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557c40b43a20 con 0x557c4077b4d0 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f747c415740 10 client.0 _ll_register_callbacks cb 0x557c40a84e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746de00640 1 -- 172.21.15.1:0/2741410413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 msgr2=0x557c40b4bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746de00640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b4bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746e800640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b4c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746de00640 1 -- 172.21.15.1:0/2741410413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 msgr2=0x557c40b4c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746de00640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b4c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746de00640 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c40807790 con 0x557c407732f0 2024-08-28T20:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f746800ee60 con 0x557c407732f0 2024-08-28T20:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.029+0000 7f746e800640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b4c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f746de00640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b4b440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7460032000 tx=0x7f746002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfed96794eb121ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f744fe00640 10 client.25322 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f744fe00640 1 -- 172.21.15.1:0/2741410413 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460047870 con 0x557c407732f0 2024-08-28T20:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f744fe00640 1 -- 172.21.15.1:0/2741410413 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7460047a10 con 0x557c407732f0 2024-08-28T20:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f744fe00640 1 -- 172.21.15.1:0/2741410413 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7460047c10 con 0x557c407732f0 2024-08-28T20:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f747c415740 10 client.25322 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.030+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557c40880620 con 0x557c407732f0 2024-08-28T20:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f744fe00640 1 -- 172.21.15.1:0/2741410413 <== mon.2 v2:172.21.15.7:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7460050070 con 0x557c407732f0 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f747c415740 10 client.25322 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f747c415740 10 client.25322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f747c415740 20 client.25322 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f747c415740 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c4075ad80 0x557c40b58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f747c415740 4 client.25322 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c40ab6ec0 con 0x557c4075ad80 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.031+0000 7f746d400640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c4075ad80 0x557c40b58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.032+0000 7f746d400640 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c4075ad80 0x557c40b58a80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e223d6eab559d962 server_cookie=7081daf7f897ef56 in_seq=0 out_seq=0 2024-08-28T20:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.032+0000 7f744fe00640 10 client.25322 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.032+0000 7f744fe00640 1 -- 172.21.15.1:0/2741410413 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c40ab6ec0 con 0x557c4075ad80 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.032+0000 7f744fe00640 10 client.25322 handle_command_reply: tid=0 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 client.25322 shutdown 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 msgr2=0x557c40b4b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b4b440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7460032000 tx=0x7f746002a420 comp rx=0 tx=0).stop 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 shutdown_connections 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c4075ad80 0x557c40b58a80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b4c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b4bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 --2- 172.21.15.1:0/2741410413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b4b440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 >> 172.21.15.1:0/2741410413 conn(0x557c40790300 msgr2=0x557c40b3bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f744fe00640 0 client.25322 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.033+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 shutdown_connections 2024-08-28T20:19:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.034+0000 7f747c415740 1 -- 172.21.15.1:0/2741410413 wait complete. 2024-08-28T20:19:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.034+0000 7f747c415740 20 client.25322 trim_cache size 0 max 16384 2024-08-28T20:19:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.056+0000 7f747c415740 1 Processor -- start 2024-08-28T20:19:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.056+0000 7f747c415740 1 -- start start 2024-08-28T20:19:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.057+0000 7f747c415740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b4a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.058+0000 7f747c415740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4077b4d0 0x557c40b45e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.058+0000 7f747c415740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4079c1b0 0x557c40b46370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.058+0000 7f747c415740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b3b50 con 0x557c407732f0 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.058+0000 7f747c415740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b13c0 con 0x557c4077b4d0 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.058+0000 7f747c415740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74701af210 con 0x557c4079c1b0 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.058+0000 7f746d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4077b4d0 0x557c40b45e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b4a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4079c1b0 0x557c40b46370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b4a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50766/0 (socket says 172.21.15.1:50766) 2024-08-28T20:19:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4079c1b0 0x557c40b46370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47960/0 (socket says 172.21.15.1:47960) 2024-08-28T20:19:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746de00640 1 -- 172.21.15.1:0/1825473142 learned_addr learned my addr 172.21.15.1:0/1825473142 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746d400640 1 -- 172.21.15.1:0/1825473142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4079c1b0 msgr2=0x557c40b46370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746d400640 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4079c1b0 0x557c40b46370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746d400640 1 -- 172.21.15.1:0/1825473142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 msgr2=0x557c40b4a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746d400640 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b4a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746d400640 1 -- 172.21.15.1:0/1825473142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c40b4c9e0 con 0x557c4077b4d0 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.059+0000 7f746de00640 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b4a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.060+0000 7f746d400640 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4077b4d0 0x557c40b45e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9c0 tx=0x7f745c01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c2c3eb5e8e2f9d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.060+0000 7f745aa00640 1 -- 172.21.15.1:0/1825473142 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0971d0 con 0x557c4077b4d0 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.060+0000 7f745aa00640 1 -- 172.21.15.1:0/1825473142 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0b5110 con 0x557c4077b4d0 2024-08-28T20:19:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.060+0000 7f745aa00640 1 -- 172.21.15.1:0/1825473142 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c018b20 con 0x557c4077b4d0 2024-08-28T20:19:27.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.062+0000 7f747c415740 1 -- 172.21.15.1:0/1825473142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4077b4d0 msgr2=0x557c40b45e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.062+0000 7f747c415740 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4077b4d0 0x557c40b45e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9c0 tx=0x7f745c01a040 comp rx=0 tx=0).stop 2024-08-28T20:19:27.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.063+0000 7f747c415740 1 -- 172.21.15.1:0/1825473142 shutdown_connections 2024-08-28T20:19:27.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.063+0000 7f747c415740 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4079c1b0 0x557c40b46370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.063+0000 7f747c415740 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c4077b4d0 0x557c40b45e30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.063+0000 7f747c415740 1 --2- 172.21.15.1:0/1825473142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c407732f0 0x557c40b4a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.063+0000 7f747c415740 1 -- 172.21.15.1:0/1825473142 >> 172.21.15.1:0/1825473142 conn(0x557c40790300 msgr2=0x557c40b49950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.064+0000 7f747c415740 1 -- 172.21.15.1:0/1825473142 shutdown_connections 2024-08-28T20:19:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.064+0000 7f747c415740 1 -- 172.21.15.1:0/1825473142 wait complete. 2024-08-28T20:19:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.065+0000 7f747c415740 1 -- start start 2024-08-28T20:19:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.065+0000 7f747c415740 1 Processor -- start 2024-08-28T20:19:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b50890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b50f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b51a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74701af880 con 0x557c4079c1b0 2024-08-28T20:19:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b0cf0 con 0x557c407732f0 2024-08-28T20:19:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74701aff50 con 0x557c4077b4d0 2024-08-28T20:19:27.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f747c415740 10 client.0 _ll_register_callbacks cb 0x7f745c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:27.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f746de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b50890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f746de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b50890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:45686/0 (socket says 172.21.15.1:45686) 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f746de00640 1 -- 172.21.15.1:0/2751254913 learned_addr learned my addr 172.21.15.1:0/2751254913 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.066+0000 7f746d400640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b50f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746de00640 1 -- 172.21.15.1:0/2751254913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 msgr2=0x557c40b50f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746de00640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b50f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746de00640 1 -- 172.21.15.1:0/2751254913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 msgr2=0x557c40b51a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746e800640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b51a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746de00640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b51a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746de00640 1 -- 172.21.15.1:0/2751254913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c40b521b0 con 0x557c407732f0 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.067+0000 7f746d400640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b50f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.068+0000 7f746e800640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b51a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.068+0000 7f746de00640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b50890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74600096c0 tx=0x7f7460043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3295a3dd360449 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.068+0000 7f744fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.069+0000 7f744fe00640 1 -- 172.21.15.1:0/2751254913 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460063060 con 0x557c407732f0 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.069+0000 7f744fe00640 1 -- 172.21.15.1:0/2751254913 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7460052ae0 con 0x557c407732f0 2024-08-28T20:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.069+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f745c0b5110 con 0x557c407732f0 2024-08-28T20:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.069+0000 7f744fe00640 1 -- 172.21.15.1:0/2751254913 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7460009780 con 0x557c407732f0 2024-08-28T20:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.069+0000 7f747c415740 10 client.25328 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.069+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c40b53440 con 0x557c407732f0 2024-08-28T20:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.070+0000 7f744fe00640 1 -- 172.21.15.1:0/2751254913 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0b5110 con 0x557c407732f0 2024-08-28T20:19:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f744fe00640 1 -- 172.21.15.1:0/2751254913 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7460050070 con 0x557c407732f0 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f747c415740 10 client.25328 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f747c415740 10 client.25328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f747c415740 20 client.25328 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f747c415740 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c407301c0 0x557c40bd6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f747c415740 4 client.25328 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.071+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c40ab2960 con 0x557c407301c0 2024-08-28T20:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.072+0000 7f746d400640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c407301c0 0x557c40bd6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.073+0000 7f746d400640 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c407301c0 0x557c40bd6930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dfc95d28baeb8d1 server_cookie=ab474221f97340b5 in_seq=0 out_seq=0 2024-08-28T20:19:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.073+0000 7f744fe00640 10 client.25328 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.090+0000 7f744fe00640 1 -- 172.21.15.1:0/2751254913 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c40ab2960 con 0x557c407301c0 2024-08-28T20:19:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f744fe00640 10 client.25328 handle_command_reply: tid=0 2024-08-28T20:19:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 client.25328 shutdown 2024-08-28T20:19:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 msgr2=0x557c40b50890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b50890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74600096c0 tx=0x7f7460043000 comp rx=0 tx=0).stop 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 shutdown_connections 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557c407301c0 0x557c40bd6930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c4079c1b0 0x557c40b51a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557c4077b4d0 0x557c40b50f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 --2- 172.21.15.1:0/2751254913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c407732f0 0x557c40b50890 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74600096c0 tx=0x7f7460043000 comp rx=0 tx=0).stop 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 >> 172.21.15.1:0/2751254913 conn(0x557c40790300 msgr2=0x557c40b49550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.091+0000 7f744fe00640 0 client.25328 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.092+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 shutdown_connections 2024-08-28T20:19:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.092+0000 7f747c415740 1 -- 172.21.15.1:0/2751254913 wait complete. 2024-08-28T20:19:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.093+0000 7f747c415740 20 client.25328 trim_cache size 0 max 16384 2024-08-28T20:19:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:19:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:19:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:19:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.094+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f74540b4cb0 msgr2=0x7f74540b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.094+0000 7f746f200640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f74540b4cb0 0x7f74540b71c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7460006010 tx=0x7f7460000bc0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.094+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 msgr2=0x7f74701a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.094+0000 7f746f200640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 0x7f74701a0790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9f0 tx=0x7f745c00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 shutdown_connections 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f74540b4cb0 0x7f74540b71c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f747010fab0 0x7f74701a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7470076e90 0x7f74701a0790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 --2- 172.21.15.1:0/2623989587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7470075a90 0x7f74701a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 >> 172.21.15.1:0/2623989587 conn(0x7f74700fec50 msgr2=0x7f7470102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 shutdown_connections 2024-08-28T20:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:27.095+0000 7f746f200640 1 -- 172.21.15.1:0/2623989587 wait complete. 2024-08-28T20:19:28.115 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:27 smithi007 ceph-mon[25357]: pgmap v405: 97 pgs: 97 active+clean; 1017 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-08-28T20:19:28.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:27 smithi001 ceph-mon[20984]: pgmap v405: 97 pgs: 97 active+clean; 1017 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-08-28T20:19:28.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:27 smithi121 ceph-mon[25248]: pgmap v405: 97 pgs: 97 active+clean; 1017 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-08-28T20:19:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 60.0 s, 3192.7 tps, lat 31.213 ms stddev 35.744 2024-08-28T20:19:30.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:29 smithi001 ceph-mon[20984]: pgmap v406: 97 pgs: 97 active+clean; 1021 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 8.3 MiB/s wr, 712 op/s 2024-08-28T20:19:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:29 smithi121 ceph-mon[25248]: pgmap v406: 97 pgs: 97 active+clean; 1021 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 8.3 MiB/s wr, 712 op/s 2024-08-28T20:19:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:29 smithi007 ceph-mon[25357]: pgmap v406: 97 pgs: 97 active+clean; 1021 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 8.3 MiB/s wr, 712 op/s 2024-08-28T20:19:32.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:31 smithi001 ceph-mon[20984]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 10 MiB/s wr, 808 op/s 2024-08-28T20:19:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:31 smithi121 ceph-mon[25248]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 10 MiB/s wr, 808 op/s 2024-08-28T20:19:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:31 smithi007 ceph-mon[25357]: pgmap v407: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 10 MiB/s wr, 808 op/s 2024-08-28T20:19:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 65.0 s, 3385.9 tps, lat 29.680 ms stddev 31.692 2024-08-28T20:19:34.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:33 smithi001 ceph-mon[20984]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.9 MiB/s wr, 765 op/s 2024-08-28T20:19:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:33 smithi121 ceph-mon[25248]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.9 MiB/s wr, 765 op/s 2024-08-28T20:19:34.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:33 smithi007 ceph-mon[25357]: pgmap v408: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.9 MiB/s wr, 765 op/s 2024-08-28T20:19:36.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:35 smithi001 ceph-mon[20984]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-08-28T20:19:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:35 smithi121 ceph-mon[25248]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-08-28T20:19:36.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:35 smithi007 ceph-mon[25357]: pgmap v409: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-08-28T20:19:38.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:37 smithi001 ceph-mon[20984]: pgmap v410: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.3 MiB/s wr, 736 op/s 2024-08-28T20:19:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:37 smithi121 ceph-mon[25248]: pgmap v410: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.3 MiB/s wr, 736 op/s 2024-08-28T20:19:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:37 smithi007 ceph-mon[25357]: pgmap v410: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.3 MiB/s wr, 736 op/s 2024-08-28T20:19:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 70.0 s, 4248.2 tps, lat 23.511 ms stddev 25.709 2024-08-28T20:19:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:39 smithi001 ceph-mon[20984]: pgmap v411: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 794 op/s 2024-08-28T20:19:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:39 smithi121 ceph-mon[25248]: pgmap v411: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 794 op/s 2024-08-28T20:19:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:39 smithi007 ceph-mon[25357]: pgmap v411: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 794 op/s 2024-08-28T20:19:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.409+0000 7fbccb600640 1 -- 172.21.15.1:0/850965736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc406b450 msgr2=0x7fbcc41084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.409+0000 7fbccb600640 1 --2- 172.21.15.1:0/850965736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc406b450 0x7fbcc41084a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009900 tx=0x7fbcb002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.410+0000 7fbccb600640 1 -- 172.21.15.1:0/850965736 shutdown_connections 2024-08-28T20:19:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.410+0000 7fbccb600640 1 --2- 172.21.15.1:0/850965736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc41089e0 0x7fbcc410ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.410+0000 7fbccb600640 1 --2- 172.21.15.1:0/850965736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 0x7fbcc410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.410+0000 7fbccb600640 1 --2- 172.21.15.1:0/850965736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc406b450 0x7fbcc41084a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.410+0000 7fbccb600640 1 -- 172.21.15.1:0/850965736 >> 172.21.15.1:0/850965736 conn(0x7fbcc40fdca0 msgr2=0x7fbcc4100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.411+0000 7fbccb600640 1 -- 172.21.15.1:0/850965736 shutdown_connections 2024-08-28T20:19:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.411+0000 7fbccb600640 1 -- 172.21.15.1:0/850965736 wait complete. 2024-08-28T20:19:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.413+0000 7fbccb600640 1 Processor -- start 2024-08-28T20:19:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.413+0000 7fbccb600640 1 -- start start 2024-08-28T20:19:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.414+0000 7fbccb600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc406b450 0x7fbcc40720a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.415+0000 7fbccb600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc41089e0 0x7fbcc4072710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.415+0000 7fbccb600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 0x7fbcc40732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbcc9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 0x7fbcc40732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbcc9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 0x7fbcc40732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35754/0 (socket says 172.21.15.1:35754) 2024-08-28T20:19:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbcc9600640 1 -- 172.21.15.1:0/3898874773 learned_addr learned my addr 172.21.15.1:0/3898874773 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc41112d0 con 0x7fbcc406b450 2024-08-28T20:19:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4111150 con 0x7fbcc410b3c0 2024-08-28T20:19:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4111450 con 0x7fbcc41089e0 2024-08-28T20:19:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbcc3e00640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc41089e0 0x7fbcc4072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.416+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc406b450 0x7fbcc40720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.418+0000 7fbcc8c00640 1 -- 172.21.15.1:0/3898874773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc41089e0 msgr2=0x7fbcc4072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.418+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc41089e0 0x7fbcc4072710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.418+0000 7fbcc8c00640 1 -- 172.21.15.1:0/3898874773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 msgr2=0x7fbcc40732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.418+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 0x7fbcc40732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.418+0000 7fbcc8c00640 1 -- 172.21.15.1:0/3898874773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4073a50 con 0x7fbcc406b450 2024-08-28T20:19:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.419+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc406b450 0x7fbcc40720a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcb002a9e0 tx=0x7fbcb0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.419+0000 7fbcc1600640 1 -- 172.21.15.1:0/3898874773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb003f070 con 0x7fbcc406b450 2024-08-28T20:19:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.420+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc4073ce0 con 0x7fbcc406b450 2024-08-28T20:19:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.420+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc40742b0 con 0x7fbcc406b450 2024-08-28T20:19:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.420+0000 7fbcc1600640 1 -- 172.21.15.1:0/3898874773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcb0005d50 con 0x7fbcc406b450 2024-08-28T20:19:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.422+0000 7fbcc1600640 1 -- 172.21.15.1:0/3898874773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0035030 con 0x7fbcc406b450 2024-08-28T20:19:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.438+0000 7fbcd2851740 1 Processor -- start 2024-08-28T20:19:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.439+0000 7fbcc1600640 1 -- 172.21.15.1:0/3898874773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbcb0042070 con 0x7fbcc406b450 2024-08-28T20:19:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.439+0000 7fbcd2851740 1 -- start start 2024-08-28T20:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.440+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921fc1b0 0x5652925a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.440+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 0x5652925a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.440+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.440+0000 7fbcd2851740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565292514f70 con 0x5652921fc1b0 2024-08-28T20:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.440+0000 7fbcd2851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x565292504500 con 0x5652921d32f0 2024-08-28T20:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.440+0000 7fbcd2851740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5652925084b0 con 0x5652921db4d0 2024-08-28T20:19:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.441+0000 7fbcc8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 0x5652925a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.441+0000 7fbcc8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 0x5652925a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35762/0 (socket says 172.21.15.1:35762) 2024-08-28T20:19:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.441+0000 7fbcc8c00640 1 -- 172.21.15.1:0/86054065 learned_addr learned my addr 172.21.15.1:0/86054065 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.441+0000 7fbcc3e00640 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.442+0000 7fbcc8c00640 1 -- 172.21.15.1:0/86054065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 msgr2=0x5652925a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.442+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925a2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.442+0000 7fbcc8c00640 1 -- 172.21.15.1:0/86054065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921fc1b0 msgr2=0x5652925a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.442+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921fc1b0 0x5652925a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.442+0000 7fbcc8c00640 1 -- 172.21.15.1:0/86054065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652924bec10 con 0x5652921d32f0 2024-08-28T20:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.443+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 0x5652925a2430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0108f10 tx=0x7fbcb010d0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f658d6ac2b8c2231 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.443+0000 7fbcb5c00640 1 -- 172.21.15.1:0/86054065 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb010db10 con 0x5652921d32f0 2024-08-28T20:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.443+0000 7fbcb5c00640 1 -- 172.21.15.1:0/86054065 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcb0112030 con 0x5652921d32f0 2024-08-28T20:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.443+0000 7fbcb5c00640 1 -- 172.21.15.1:0/86054065 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb01163d0 con 0x5652921d32f0 2024-08-28T20:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.445+0000 7fbcd2851740 1 -- 172.21.15.1:0/86054065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 msgr2=0x5652925a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.445+0000 7fbcd2851740 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 0x5652925a2430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0108f10 tx=0x7fbcb010d0e0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcd2851740 1 -- 172.21.15.1:0/86054065 shutdown_connections 2024-08-28T20:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcd2851740 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcd2851740 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921d32f0 0x5652925a2430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcd2851740 1 --2- 172.21.15.1:0/86054065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921fc1b0 0x5652925a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcc1600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbcac0b4bb0 0x7fbcac0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcd2851740 1 -- 172.21.15.1:0/86054065 >> 172.21.15.1:0/86054065 conn(0x5652921f0300 msgr2=0x56529259d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.446+0000 7fbcc1600640 1 -- 172.21.15.1:0/3898874773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbcb0105080 con 0x7fbcc406b450 2024-08-28T20:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.447+0000 7fbcc9600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbcac0b4bb0 0x7fbcac0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.448+0000 7fbcd2851740 1 -- 172.21.15.1:0/86054065 shutdown_connections 2024-08-28T20:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.449+0000 7fbcd2851740 1 -- 172.21.15.1:0/86054065 wait complete. 2024-08-28T20:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.450+0000 7fbcd2851740 1 -- start start 2024-08-28T20:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.450+0000 7fbcd2851740 1 Processor -- start 2024-08-28T20:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.453+0000 7fbcc9600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbcac0b4bb0 0x7fbcac0b70c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009270 tx=0x7fbcbc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.455+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.455+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.455+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.455+0000 7fbcd2851740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56529243dab0 con 0x5652921d32f0 2024-08-28T20:19:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcd2851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5652924ab320 con 0x5652921fc1b0 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcd2851740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5652925a3860 con 0x5652921db4d0 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35774/0 (socket says 172.21.15.1:35774) 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 -- 172.21.15.1:0/2189136070 learned_addr learned my addr 172.21.15.1:0/2189136070 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcd2851740 10 client.0 _ll_register_callbacks cb 0x5652924b16a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc3e00640 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 -- 172.21.15.1:0/2189136070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 msgr2=0x5652925ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 -- 172.21.15.1:0/2189136070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 msgr2=0x5652925ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.456+0000 7fbcc9600640 1 -- 172.21.15.1:0/2189136070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565292267790 con 0x5652921fc1b0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.457+0000 7fbcc9600640 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925ac3a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc023ed0 tx=0x7fbcbc009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4cdea372263a624 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.458+0000 7fbcaa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.458+0000 7fbcaa000640 1 -- 172.21.15.1:0/2189136070 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc023420 con 0x5652921fc1b0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.458+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb0112030 con 0x5652921fc1b0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.458+0000 7fbcaa000640 1 -- 172.21.15.1:0/2189136070 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbcbc0235c0 con 0x5652921fc1b0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.459+0000 7fbcaa000640 1 -- 172.21.15.1:0/2189136070 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcbc0237c0 con 0x5652921fc1b0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.459+0000 7fbcd2851740 10 client.25340 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.459+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5652922e0620 con 0x5652921fc1b0 2024-08-28T20:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcaa000640 1 -- 172.21.15.1:0/2189136070 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcb0112030 con 0x5652921fc1b0 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcaa000640 1 -- 172.21.15.1:0/2189136070 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbcbc00f040 con 0x5652921fc1b0 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcd2851740 10 client.25340 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcd2851740 10 client.25340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcd2851740 20 client.25340 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcd2851740 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921bad80 0x5652925b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcd2851740 4 client.25340 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565292516ec0 con 0x5652921bad80 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.460+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921bad80 0x5652925b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.461+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921bad80 0x5652925b8b60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34efb5937735b0bc server_cookie=9a6dd2f956b71292 in_seq=0 out_seq=0 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.461+0000 7fbcaa000640 10 client.25340 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.462+0000 7fbcaa000640 1 -- 172.21.15.1:0/2189136070 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565292516ec0 con 0x5652921bad80 2024-08-28T20:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.462+0000 7fbcaa000640 10 client.25340 handle_command_reply: tid=0 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.462+0000 7fbcd2851740 1 client.25340 shutdown 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 msgr2=0x5652925ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925ac3a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc023ed0 tx=0x7fbcbc009680 comp rx=0 tx=0).stop 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 shutdown_connections 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921bad80 0x5652925b8b60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925ac3a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 --2- 172.21.15.1:0/2189136070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 >> 172.21.15.1:0/2189136070 conn(0x5652921f0300 msgr2=0x56529259bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.463+0000 7fbcaa000640 0 client.25340 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.464+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 shutdown_connections 2024-08-28T20:19:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.464+0000 7fbcd2851740 1 -- 172.21.15.1:0/2189136070 wait complete. 2024-08-28T20:19:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.464+0000 7fbcd2851740 20 client.25340 trim_cache size 0 max 16384 2024-08-28T20:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 Processor -- start 2024-08-28T20:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 -- start start 2024-08-28T20:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4010e80 con 0x5652921d32f0 2024-08-28T20:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbca400e6f0 con 0x5652921fc1b0 2024-08-28T20:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.497+0000 7fbcd2851740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbca400c4e0 con 0x5652921db4d0 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.498+0000 7fbcc9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.498+0000 7fbcc8c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.498+0000 7fbcc9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35782/0 (socket says 172.21.15.1:35782) 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.498+0000 7fbcc9600640 1 -- 172.21.15.1:0/4225145914 learned_addr learned my addr 172.21.15.1:0/4225145914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.498+0000 7fbcc3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.499+0000 7fbcc9600640 1 -- 172.21.15.1:0/4225145914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 msgr2=0x5652925b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.499+0000 7fbcc9600640 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.499+0000 7fbcc9600640 1 -- 172.21.15.1:0/4225145914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 msgr2=0x5652925b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.499+0000 7fbcc9600640 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925b8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.499+0000 7fbcc9600640 1 -- 172.21.15.1:0/4225145914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652925a3310 con 0x5652921fc1b0 2024-08-28T20:19:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.499+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:19:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.500+0000 7fbcc9600640 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b3040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc023ea0 tx=0x7fbcbc012cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5bab8e714d463f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.500+0000 7fbcb5200640 1 -- 172.21.15.1:0/4225145914 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc01c4d0 con 0x5652921fc1b0 2024-08-28T20:19:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.500+0000 7fbcb5200640 1 -- 172.21.15.1:0/4225145914 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcbc023070 con 0x5652921fc1b0 2024-08-28T20:19:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.500+0000 7fbcb5200640 1 -- 172.21.15.1:0/4225145914 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc01e7f0 con 0x5652921fc1b0 2024-08-28T20:19:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 -- 172.21.15.1:0/4225145914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 msgr2=0x5652925b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b3040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc023ea0 tx=0x7fbcbc012cb0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 -- 172.21.15.1:0/4225145914 shutdown_connections 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b3040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921db4d0 0x5652925b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 --2- 172.21.15.1:0/4225145914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921d32f0 0x5652925b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 -- 172.21.15.1:0/4225145914 >> 172.21.15.1:0/4225145914 conn(0x5652921f0300 msgr2=0x5652925a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 -- 172.21.15.1:0/4225145914 shutdown_connections 2024-08-28T20:19:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.502+0000 7fbcd2851740 1 -- 172.21.15.1:0/4225145914 wait complete. 2024-08-28T20:19:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.503+0000 7fbcd2851740 1 -- start start 2024-08-28T20:19:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.504+0000 7fbcd2851740 1 Processor -- start 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921d32f0 0x5652925b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 0x5652925b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbca400cbb0 con 0x5652921db4d0 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbca400e020 con 0x5652921fc1b0 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbca400d280 con 0x5652921d32f0 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcd2851740 10 client.0 _ll_register_callbacks cb 0x7fbcbc023ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.505+0000 7fbcc3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 0x5652925b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.506+0000 7fbcc3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 0x5652925b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54004/0 (socket says 172.21.15.1:54004) 2024-08-28T20:19:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.506+0000 7fbcc3e00640 1 -- 172.21.15.1:0/719231625 learned_addr learned my addr 172.21.15.1:0/719231625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.506+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921d32f0 0x5652925b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.506+0000 7fbcc9600640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.507+0000 7fbcc8c00640 1 -- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 msgr2=0x5652925b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.507+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.507+0000 7fbcc8c00640 1 -- 172.21.15.1:0/719231625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 msgr2=0x5652925b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.507+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 0x5652925b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.507+0000 7fbcc8c00640 1 -- 172.21.15.1:0/719231625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652925b2550 con 0x5652921d32f0 2024-08-28T20:19:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.507+0000 7fbcc3e00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 0x5652925b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:19:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.508+0000 7fbcc9600640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:19:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.508+0000 7fbcc8c00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921d32f0 0x5652925b2ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00c7b50 tx=0x7fbcb0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7fea8cce00130b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.508+0000 7fbcaa000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.508+0000 7fbcaa000640 1 -- 172.21.15.1:0/719231625 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00c7990 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcaa000640 1 -- 172.21.15.1:0/719231625 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbcb0102c20 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcbc023070 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcaa000640 1 -- 172.21.15.1:0/719231625 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcb00c7260 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcd2851740 10 client.25324 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5652925b1370 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcaa000640 1 -- 172.21.15.1:0/719231625 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcbc023070 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcaa000640 1 -- 172.21.15.1:0/719231625 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbcb00c7d60 con 0x5652921d32f0 2024-08-28T20:19:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcd2851740 10 client.25324 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.509+0000 7fbcd2851740 10 client.25324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.510+0000 7fbcd2851740 20 client.25324 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.510+0000 7fbcd2851740 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921901c0 0x565292625b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.510+0000 7fbcd2851740 4 client.25324 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:19:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.510+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565292512960 con 0x5652921901c0 2024-08-28T20:19:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.511+0000 7fbcc3e00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921901c0 0x565292625b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.511+0000 7fbcc3e00640 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921901c0 0x565292625b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c918a310bc93f308 server_cookie=1864cc3fa1a8252d in_seq=0 out_seq=0 2024-08-28T20:19:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.511+0000 7fbcaa000640 10 client.25324 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.525+0000 7fbcaa000640 1 -- 172.21.15.1:0/719231625 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565292512960 con 0x5652921901c0 2024-08-28T20:19:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.525+0000 7fbcaa000640 10 client.25324 handle_command_reply: tid=0 2024-08-28T20:19:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.525+0000 7fbcd2851740 1 client.25324 shutdown 2024-08-28T20:19:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.525+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921d32f0 msgr2=0x5652925b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.525+0000 7fbcd2851740 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921d32f0 0x5652925b2ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00c7b50 tx=0x7fbcb0031400 comp rx=0 tx=0).stop 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 shutdown_connections 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5652921901c0 0x565292625b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5652921db4d0 0x5652925b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5652921fc1b0 0x5652925b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 --2- 172.21.15.1:0/719231625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652921d32f0 0x5652925b2ce0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 >> 172.21.15.1:0/719231625 conn(0x5652921f0300 msgr2=0x5652925a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcaa000640 0 client.25324 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 shutdown_connections 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.526+0000 7fbcd2851740 1 -- 172.21.15.1:0/719231625 wait complete. 2024-08-28T20:19:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.527+0000 7fbcd2851740 20 client.25324 trim_cache size 0 max 16384 2024-08-28T20:19:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:19:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:19:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:19:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.528+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbcac0b4bb0 msgr2=0x7fbcac0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.528+0000 7fbccb600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbcac0b4bb0 0x7fbcac0b70c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009270 tx=0x7fbcbc004a40 comp rx=0 tx=0).stop 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.528+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc406b450 msgr2=0x7fbcc40720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.528+0000 7fbccb600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc406b450 0x7fbcc40720a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcb002a9e0 tx=0x7fbcb0003d50 comp rx=0 tx=0).stop 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.529+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 shutdown_connections 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.529+0000 7fbccb600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbcac0b4bb0 0x7fbcac0b70c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.529+0000 7fbccb600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcc410b3c0 0x7fbcc40732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.529+0000 7fbccb600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc41089e0 0x7fbcc4072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.529+0000 7fbccb600640 1 --2- 172.21.15.1:0/3898874773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc406b450 0x7fbcc40720a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.529+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 >> 172.21.15.1:0/3898874773 conn(0x7fbcc40fdca0 msgr2=0x7fbcc4109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.530+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 shutdown_connections 2024-08-28T20:19:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:40.530+0000 7fbccb600640 1 -- 172.21.15.1:0/3898874773 wait complete. 2024-08-28T20:19:42.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:41 smithi001 ceph-mon[20984]: pgmap v412: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 858 op/s 2024-08-28T20:19:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:41 smithi121 ceph-mon[25248]: pgmap v412: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 858 op/s 2024-08-28T20:19:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:41 smithi007 ceph-mon[25357]: pgmap v412: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 858 op/s 2024-08-28T20:19:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 75.0 s, 3933.7 tps, lat 25.388 ms stddev 27.097 2024-08-28T20:19:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:43 smithi001 ceph-mon[20984]: pgmap v413: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 770 op/s 2024-08-28T20:19:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:43 smithi121 ceph-mon[25248]: pgmap v413: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 770 op/s 2024-08-28T20:19:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:43 smithi007 ceph-mon[25357]: pgmap v413: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 770 op/s 2024-08-28T20:19:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:45 smithi001 ceph-mon[20984]: pgmap v414: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-08-28T20:19:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:45 smithi121 ceph-mon[25248]: pgmap v414: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-08-28T20:19:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:45 smithi007 ceph-mon[25357]: pgmap v414: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-08-28T20:19:48.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:47 smithi001 ceph-mon[20984]: pgmap v415: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-08-28T20:19:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:47 smithi121 ceph-mon[25248]: pgmap v415: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-08-28T20:19:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:47 smithi007 ceph-mon[25357]: pgmap v415: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-08-28T20:19:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 80.0 s, 4253.6 tps, lat 23.545 ms stddev 25.328 2024-08-28T20:19:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:49 smithi001 ceph-mon[20984]: pgmap v416: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 896 op/s 2024-08-28T20:19:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:49 smithi121 ceph-mon[25248]: pgmap v416: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 896 op/s 2024-08-28T20:19:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:49 smithi007 ceph-mon[25357]: pgmap v416: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 896 op/s 2024-08-28T20:19:52.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:51 smithi001 ceph-mon[20984]: pgmap v417: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 889 op/s 2024-08-28T20:19:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:51 smithi121 ceph-mon[25248]: pgmap v417: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 889 op/s 2024-08-28T20:19:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:51 smithi007 ceph-mon[25357]: pgmap v417: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 889 op/s 2024-08-28T20:19:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 85.0 s, 3193.4 tps, lat 31.143 ms stddev 33.547 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 -- 172.21.15.1:0/349574750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d410a160 msgr2=0x7f32d410a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 --2- 172.21.15.1:0/349574750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d410a160 0x7f32d410a570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009900 tx=0x7f32c402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 -- 172.21.15.1:0/349574750 shutdown_connections 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 --2- 172.21.15.1:0/349574750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32d41119e0 0x7f32d4113e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 --2- 172.21.15.1:0/349574750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 --2- 172.21.15.1:0/349574750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d410a160 0x7f32d410a570 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.824+0000 7f32d3e00640 1 -- 172.21.15.1:0/349574750 >> 172.21.15.1:0/349574750 conn(0x7f32d4070440 msgr2=0x7f32d4072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.825+0000 7f32d3e00640 1 -- 172.21.15.1:0/349574750 shutdown_connections 2024-08-28T20:19:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.825+0000 7f32d3e00640 1 -- 172.21.15.1:0/349574750 wait complete. 2024-08-28T20:19:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.828+0000 7f32d3e00640 1 Processor -- start 2024-08-28T20:19:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.829+0000 7f32d3e00640 1 -- start start 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d41119e0 0x7f32d41a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32d41a3630 0x7f32d41a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d3e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4117760 con 0x7f32d41119e0 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41175e0 con 0x7f32d410aab0 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d3e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41178e0 con 0x7f32d41a3630 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41a2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58760/0 (socket says 172.21.15.1:58760) 2024-08-28T20:19:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.830+0000 7f32d2a00640 1 -- 172.21.15.1:0/2873724447 learned_addr learned my addr 172.21.15.1:0/2873724447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.831+0000 7f32d3400640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32d41a3630 0x7f32d41a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.831+0000 7f32d2a00640 1 -- 172.21.15.1:0/2873724447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32d41a3630 msgr2=0x7f32d41a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.831+0000 7f32d2a00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32d41a3630 0x7f32d41a3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.831+0000 7f32d2a00640 1 -- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d41119e0 msgr2=0x7f32d41a2b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-28T20:19:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.832+0000 7f32ca000640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d41119e0 0x7f32d41a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.834+0000 7f32d2a00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d41119e0 0x7f32d41a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.834+0000 7f32d2a00640 1 -- 172.21.15.1:0/2873724447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d41a4170 con 0x7f32d410aab0 2024-08-28T20:19:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.834+0000 7f32ca000640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d41119e0 0x7f32d41a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.834+0000 7f32d2a00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41a2500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32c4006010 tx=0x7f32c4003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.835+0000 7f32d8a00640 1 -- 172.21.15.1:0/2873724447 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c403f020 con 0x7f32d410aab0 2024-08-28T20:19:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.835+0000 7f32d8a00640 1 -- 172.21.15.1:0/2873724447 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32c4003e70 con 0x7f32d410aab0 2024-08-28T20:19:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.835+0000 7f32d8a00640 1 -- 172.21.15.1:0/2873724447 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4035070 con 0x7f32d410aab0 2024-08-28T20:19:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.836+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d41a4400 con 0x7f32d410aab0 2024-08-28T20:19:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.836+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d41a89c0 con 0x7f32d410aab0 2024-08-28T20:19:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.840+0000 7f32e0e8b740 1 Processor -- start 2024-08-28T20:19:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 -- start start 2024-08-28T20:19:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e30140cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e30140d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e30140df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e30137ff70 con 0x55e3010671b0 2024-08-28T20:19:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e30136f500 con 0x55e3010464d0 2024-08-28T20:19:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.841+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e3013734b0 con 0x55e30103e2f0 2024-08-28T20:19:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.842+0000 7f32d3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e30140cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e30140cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45466/0 (socket says 172.21.15.1:45466) 2024-08-28T20:19:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 -- 172.21.15.1:0/3753534982 learned_addr learned my addr 172.21.15.1:0/3753534982 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.842+0000 7f32ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e30140df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 -- 172.21.15.1:0/3753534982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 msgr2=0x55e30140d3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:19:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e30140d3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 -- 172.21.15.1:0/3753534982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 msgr2=0x55e30140df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e30140df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.843+0000 7f32d3400640 1 -- 172.21.15.1:0/3753534982 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e301329c10 con 0x55e3010671b0 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.844+0000 7f32d8a00640 1 -- 172.21.15.1:0/2873724447 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f32c4042020 con 0x7f32d410aab0 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.844+0000 7f32ca000640 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e30140df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.845+0000 7f32d3400640 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e30140cd40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009f20 tx=0x7f32cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d638c0baf72ebb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.846+0000 7f32c3e00640 1 -- 172.21.15.1:0/3753534982 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc01a070 con 0x55e3010671b0 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.846+0000 7f32c3e00640 1 -- 172.21.15.1:0/3753534982 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32cc0158c0 con 0x55e3010671b0 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.846+0000 7f32c3e00640 1 -- 172.21.15.1:0/3753534982 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00a820 con 0x55e3010671b0 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 -- 172.21.15.1:0/3753534982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 msgr2=0x55e30140cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e30140cd40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009f20 tx=0x7f32cc00c8b0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 -- 172.21.15.1:0/3753534982 shutdown_connections 2024-08-28T20:19:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e30140df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e30140d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/3753534982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e30140cd40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 -- 172.21.15.1:0/3753534982 >> 172.21.15.1:0/3753534982 conn(0x55e30105b300 msgr2=0x55e3014087d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 -- 172.21.15.1:0/3753534982 shutdown_connections 2024-08-28T20:19:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.847+0000 7f32e0e8b740 1 -- 172.21.15.1:0/3753534982 wait complete. 2024-08-28T20:19:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.848+0000 7f32e0e8b740 1 -- start start 2024-08-28T20:19:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.851+0000 7f32e0e8b740 1 Processor -- start 2024-08-28T20:19:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.852+0000 7f32d8a00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32b80b4ae0 0x7f32b80b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.852+0000 7f32d8a00640 1 -- 172.21.15.1:0/2873724447 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f32c4105bb0 con 0x7f32d410aab0 2024-08-28T20:19:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.853+0000 7f32d3400640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32b80b4ae0 0x7f32b80b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e3014274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32d3400640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32b80b4ae0 0x7f32b80b6ff0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009d30 tx=0x7f32cc004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301427bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e301428690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e3012a8ab0 con 0x55e3010671b0 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e301316320 con 0x55e3010464d0 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.855+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e30140ea20 con 0x55e30103e2f0 2024-08-28T20:19:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.856+0000 7f32e0e8b740 10 client.0 _ll_register_callbacks cb 0x55e30134fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.856+0000 7f32ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301427bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.856+0000 7f32ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301427bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58774/0 (socket says 172.21.15.1:58774) 2024-08-28T20:19:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.856+0000 7f32ca000640 1 -- 172.21.15.1:0/4151574665 learned_addr learned my addr 172.21.15.1:0/4151574665 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32d3400640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e301428690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32d2a00640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e3014274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32ca000640 1 -- 172.21.15.1:0/4151574665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 msgr2=0x55e3014274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32ca000640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e3014274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32ca000640 1 -- 172.21.15.1:0/4151574665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 msgr2=0x55e301428690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32ca000640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e301428690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32ca000640 1 -- 172.21.15.1:0/4151574665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3010d2790 con 0x55e3010464d0 2024-08-28T20:19:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.857+0000 7f32d2a00640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e3014274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.858+0000 7f32ca000640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301427bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00e690 tx=0x7f32bc00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f86d30712f5de645 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.858+0000 7f32c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.858+0000 7f32c0c00640 1 -- 172.21.15.1:0/4151574665 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc01c060 con 0x55e3010464d0 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.858+0000 7f32c0c00640 1 -- 172.21.15.1:0/4151574665 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f32bc009a80 con 0x55e3010464d0 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.858+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32cc0158c0 con 0x55e3010464d0 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.858+0000 7f32c0c00640 1 -- 172.21.15.1:0/4151574665 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32bc009c80 con 0x55e3010464d0 2024-08-28T20:19:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.859+0000 7f32e0e8b740 10 client.25352 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.859+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e30114b620 con 0x55e3010464d0 2024-08-28T20:19:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32c0c00640 1 -- 172.21.15.1:0/4151574665 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32cc0158c0 con 0x55e3010464d0 2024-08-28T20:19:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32c0c00640 1 -- 172.21.15.1:0/4151574665 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f32bc00f420 con 0x55e3010464d0 2024-08-28T20:19:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32e0e8b740 10 client.25352 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32e0e8b740 10 client.25352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32e0e8b740 20 client.25352 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e301025d80 0x55e301434cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32e0e8b740 4 client.25352 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:19:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.860+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e301381ec0 con 0x55e301025d80 2024-08-28T20:19:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.861+0000 7f32d2a00640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e301025d80 0x55e301434cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.862+0000 7f32d2a00640 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e301025d80 0x55e301434cc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae3555f9a6a3ec4 server_cookie=6b3692e66af42059 in_seq=0 out_seq=0 2024-08-28T20:19:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.862+0000 7f32c0c00640 10 client.25352 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32c0c00640 1 -- 172.21.15.1:0/4151574665 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e301381ec0 con 0x55e301025d80 2024-08-28T20:19:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32c0c00640 10 client.25352 handle_command_reply: tid=0 2024-08-28T20:19:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 client.25352 shutdown 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 msgr2=0x55e301427bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301427bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00e690 tx=0x7f32bc00eb50 comp rx=0 tx=0).stop 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 shutdown_connections 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e301025d80 0x55e301434cc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010671b0 0x55e301428690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301427bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/4151574665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e30103e2f0 0x55e3014274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32c0c00640 0 client.25352 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.863+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 >> 172.21.15.1:0/4151574665 conn(0x55e30105b300 msgr2=0x55e301406d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.864+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 shutdown_connections 2024-08-28T20:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.864+0000 7f32e0e8b740 1 -- 172.21.15.1:0/4151574665 wait complete. 2024-08-28T20:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.864+0000 7f32e0e8b740 20 client.25352 trim_cache size 0 max 16384 2024-08-28T20:19:53.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.904+0000 7f32e0e8b740 1 Processor -- start 2024-08-28T20:19:53.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.904+0000 7f32e0e8b740 1 -- start start 2024-08-28T20:19:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e30103e2f0 0x55e301408110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301426750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e301426c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0010dd0 con 0x55e30103e2f0 2024-08-28T20:19:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32b000e640 con 0x55e3010464d0 2024-08-28T20:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32b000c490 con 0x55e3010671b0 2024-08-28T20:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301426750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32d3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e301426c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301426750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58776/0 (socket says 172.21.15.1:58776) 2024-08-28T20:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32d3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e301426c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34224/0 (socket says 172.21.15.1:34224) 2024-08-28T20:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 -- 172.21.15.1:0/160685218 learned_addr learned my addr 172.21.15.1:0/160685218 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32d2a00640 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e30103e2f0 0x55e301408110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 -- 172.21.15.1:0/160685218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 msgr2=0x55e301426c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e301426c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 -- 172.21.15.1:0/160685218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e30103e2f0 msgr2=0x55e301408110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e30103e2f0 0x55e301408110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32ca000640 1 -- 172.21.15.1:0/160685218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e301428270 con 0x55e3010464d0 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.905+0000 7f32d2a00640 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e30103e2f0 0x55e301408110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.906+0000 7f32ca000640 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301426750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00f010 tx=0x7f32bc004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc26349b3020f2b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.907+0000 7f32c3400640 1 -- 172.21.15.1:0/160685218 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc00c4d0 con 0x55e3010464d0 2024-08-28T20:19:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.907+0000 7f32c3400640 1 -- 172.21.15.1:0/160685218 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32bc00f420 con 0x55e3010464d0 2024-08-28T20:19:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.907+0000 7f32c3400640 1 -- 172.21.15.1:0/160685218 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc009ae0 con 0x55e3010464d0 2024-08-28T20:19:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.908+0000 7f32e0e8b740 1 -- 172.21.15.1:0/160685218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 msgr2=0x55e301426750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.908+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301426750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00f010 tx=0x7f32bc004660 comp rx=0 tx=0).stop 2024-08-28T20:19:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 -- 172.21.15.1:0/160685218 shutdown_connections 2024-08-28T20:19:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e301426c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3010464d0 0x55e301426750 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/160685218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e30103e2f0 0x55e301408110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 -- 172.21.15.1:0/160685218 >> 172.21.15.1:0/160685218 conn(0x55e30105b300 msgr2=0x55e301403490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 -- 172.21.15.1:0/160685218 shutdown_connections 2024-08-28T20:19:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.909+0000 7f32e0e8b740 1 -- 172.21.15.1:0/160685218 wait complete. 2024-08-28T20:19:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.910+0000 7f32e0e8b740 1 -- start start 2024-08-28T20:19:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.910+0000 7f32e0e8b740 1 Processor -- start 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e30103e2f0 0x55e30142e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010464d0 0x55e30142ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e30142d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32b000cb00 con 0x55e3010464d0 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32b000df70 con 0x55e30103e2f0 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32b000d1d0 con 0x55e3010671b0 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.911+0000 7f32e0e8b740 10 client.0 _ll_register_callbacks cb 0x7f32bc00c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e30103e2f0 0x55e30142e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e30142d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e30103e2f0 0x55e30142e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58778/0 (socket says 172.21.15.1:58778) 2024-08-28T20:19:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e30142d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34230/0 (socket says 172.21.15.1:34230) 2024-08-28T20:19:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d2a00640 1 -- 172.21.15.1:0/2353642006 learned_addr learned my addr 172.21.15.1:0/2353642006 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:19:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32ca000640 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010464d0 0x55e30142ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 -- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e30103e2f0 msgr2=0x55e30142e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e30103e2f0 0x55e30142e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 -- 172.21.15.1:0/2353642006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010464d0 msgr2=0x55e30142ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010464d0 0x55e30142ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.912+0000 7f32d3400640 1 -- 172.21.15.1:0/2353642006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30142d940 con 0x55e3010671b0 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.913+0000 7f32d3400640 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e30142d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009ef0 tx=0x7f32cc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf2f9b44a049e88 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.913+0000 7f32c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.914+0000 7f32c0c00640 1 -- 172.21.15.1:0/2353642006 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc031060 con 0x55e3010671b0 2024-08-28T20:19:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.914+0000 7f32c0c00640 1 -- 172.21.15.1:0/2353642006 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f32cc02c440 con 0x55e3010671b0 2024-08-28T20:19:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.914+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32bc00f420 con 0x55e3010671b0 2024-08-28T20:19:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.921+0000 7f32c0c00640 1 -- 172.21.15.1:0/2353642006 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32cc01a040 con 0x55e3010671b0 2024-08-28T20:19:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.922+0000 7f32e0e8b740 10 client.25336 fetch_fsmap learned FSMap version 30 2024-08-28T20:19:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.922+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e30149fdc0 con 0x55e3010671b0 2024-08-28T20:19:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.922+0000 7f32c0c00640 1 -- 172.21.15.1:0/2353642006 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32cc020e40 con 0x55e3010671b0 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.922+0000 7f32c0c00640 1 -- 172.21.15.1:0/2353642006 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f32cc01d030 con 0x55e3010671b0 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32e0e8b740 10 client.25336 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32e0e8b740 10 client.25336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32e0e8b740 20 client.25336 populate_metadata read hostname 'smithi001' 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e300ffb1c0 0x55e3014a2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32e0e8b740 4 client.25336 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:19:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f32bc00f420 con 0x55e300ffb1c0 2024-08-28T20:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.923+0000 7f32d2a00640 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e300ffb1c0 0x55e3014a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.924+0000 7f32d2a00640 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e300ffb1c0 0x55e3014a2520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149e2c5ee66dc743 server_cookie=15216941348548c3 in_seq=0 out_seq=0 2024-08-28T20:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.924+0000 7f32c0c00640 10 client.25336 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.937+0000 7f32c0c00640 1 -- 172.21.15.1:0/2353642006 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f32bc00f420 con 0x55e300ffb1c0 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32c0c00640 10 client.25336 handle_command_reply: tid=0 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 client.25336 shutdown 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 msgr2=0x55e30142d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e30142d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009ef0 tx=0x7f32cc00c8b0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 shutdown_connections 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e300ffb1c0 0x55e3014a2520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e3010464d0 0x55e30142ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32c0c00640 0 client.25336 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e3010671b0 0x55e30142d400 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 --2- 172.21.15.1:0/2353642006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e30103e2f0 0x55e30142e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.938+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 >> 172.21.15.1:0/2353642006 conn(0x55e30105b300 msgr2=0x55e301403490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.940+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 shutdown_connections 2024-08-28T20:19:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.940+0000 7f32e0e8b740 1 -- 172.21.15.1:0/2353642006 wait complete. 2024-08-28T20:19:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.940+0000 7f32e0e8b740 20 client.25336 trim_cache size 0 max 16384 2024-08-28T20:19:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:19:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:19:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:19:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:19:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32b80b4ae0 msgr2=0x7f32b80b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32b80b4ae0 0x7f32b80b6ff0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009d30 tx=0x7f32cc004b50 comp rx=0 tx=0).stop 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 msgr2=0x7f32d41a2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41a2500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32c4006010 tx=0x7f32c4003c80 comp rx=0 tx=0).stop 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 shutdown_connections 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f32b80b4ae0 0x7f32b80b6ff0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d41119e0 0x7f32d41a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32d41a3630 0x7f32d41a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 --2- 172.21.15.1:0/2873724447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32d410aab0 0x7f32d41a2500 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:19:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 >> 172.21.15.1:0/2873724447 conn(0x7f32d4070440 msgr2=0x7f32d4071210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:19:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.941+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 shutdown_connections 2024-08-28T20:19:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:19:53.942+0000 7f32d3e00640 1 -- 172.21.15.1:0/2873724447 wait complete. 2024-08-28T20:19:54.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:53 smithi001 ceph-mon[20984]: pgmap v418: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 776 op/s 2024-08-28T20:19:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:53 smithi121 ceph-mon[25248]: pgmap v418: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 776 op/s 2024-08-28T20:19:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:53 smithi007 ceph-mon[25357]: pgmap v418: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 776 op/s 2024-08-28T20:19:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:55 smithi001 ceph-mon[20984]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 868 op/s 2024-08-28T20:19:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:55 smithi121 ceph-mon[25248]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 868 op/s 2024-08-28T20:19:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:55 smithi007 ceph-mon[25357]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 868 op/s 2024-08-28T20:19:58.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:57 smithi001 ceph-mon[20984]: pgmap v420: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 846 op/s 2024-08-28T20:19:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:57 smithi121 ceph-mon[25248]: pgmap v420: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 846 op/s 2024-08-28T20:19:58.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:57 smithi007 ceph-mon[25357]: pgmap v420: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 846 op/s 2024-08-28T20:19:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 90.0 s, 3236.6 tps, lat 30.953 ms stddev 36.407 2024-08-28T20:20:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:19:59 smithi001 ceph-mon[20984]: pgmap v421: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 783 op/s 2024-08-28T20:20:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:19:59 smithi121 ceph-mon[25248]: pgmap v421: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 783 op/s 2024-08-28T20:20:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:19:59 smithi007 ceph-mon[25357]: pgmap v421: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 783 op/s 2024-08-28T20:20:01.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:00 smithi001 ceph-mon[20984]: overall HEALTH_OK 2024-08-28T20:20:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:00 smithi121 ceph-mon[25248]: overall HEALTH_OK 2024-08-28T20:20:01.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:00 smithi007 ceph-mon[25357]: overall HEALTH_OK 2024-08-28T20:20:02.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:01 smithi001 ceph-mon[20984]: pgmap v422: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 764 op/s 2024-08-28T20:20:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:01 smithi121 ceph-mon[25248]: pgmap v422: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 764 op/s 2024-08-28T20:20:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:01 smithi007 ceph-mon[25357]: pgmap v422: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 764 op/s 2024-08-28T20:20:03.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:02 smithi001 ceph-mon[20984]: pgmap v423: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 730 op/s 2024-08-28T20:20:03.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:02 smithi121 ceph-mon[25248]: pgmap v423: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 730 op/s 2024-08-28T20:20:03.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:02 smithi007 ceph-mon[25357]: pgmap v423: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 730 op/s 2024-08-28T20:20:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 95.0 s, 3804.4 tps, lat 26.281 ms stddev 28.314 2024-08-28T20:20:05.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:05 smithi007 ceph-mon[25357]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 841 op/s 2024-08-28T20:20:05.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:05 smithi001 ceph-mon[20984]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 841 op/s 2024-08-28T20:20:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:05 smithi121 ceph-mon[25248]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 841 op/s 2024-08-28T20:20:07.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 -- 172.21.15.1:0/2410681495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c102170 msgr2=0x7f3d1c1025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 --2- 172.21.15.1:0/2410681495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c102170 0x7f3d1c1025e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009860 tx=0x7f3d0c02a340 comp rx=0 tx=0).stop 2024-08-28T20:20:07.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 -- 172.21.15.1:0/2410681495 shutdown_connections 2024-08-28T20:20:07.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 --2- 172.21.15.1:0/2410681495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d1c1031f0 0x7f3d1c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 --2- 172.21.15.1:0/2410681495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c103b90 0x7f3d1c10a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 --2- 172.21.15.1:0/2410681495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c102170 0x7f3d1c1025e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.243+0000 7f3d21c00640 1 -- 172.21.15.1:0/2410681495 >> 172.21.15.1:0/2410681495 conn(0x7f3d1c0fdab0 msgr2=0x7f3d1c0fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:07.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.244+0000 7f3d21c00640 1 -- 172.21.15.1:0/2410681495 shutdown_connections 2024-08-28T20:20:07.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.244+0000 7f3d21c00640 1 -- 172.21.15.1:0/2410681495 wait complete. 2024-08-28T20:20:07.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.246+0000 7f3d21c00640 1 Processor -- start 2024-08-28T20:20:07.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.246+0000 7f3d21c00640 1 -- start start 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d21c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 0x7f3d1c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d21c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d1c1031f0 0x7f3d1c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d21c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c103b90 0x7f3d1c19ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 0x7f3d1c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 0x7f3d1c199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58482/0 (socket says 172.21.15.1:58482) 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d1b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d1c1031f0 0x7f3d1c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.247+0000 7f3d21200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c103b90 0x7f3d1c19ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d21200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c103b90 0x7f3d1c19ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34862/0 (socket says 172.21.15.1:34862) 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d21c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10de40 con 0x7f3d1c1031f0 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10dcc0 con 0x7f3d1c102170 2024-08-28T20:20:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d1be00640 1 -- 172.21.15.1:0/1014177971 learned_addr learned my addr 172.21.15.1:0/1014177971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10dfc0 con 0x7f3d1c103b90 2024-08-28T20:20:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d1be00640 1 -- 172.21.15.1:0/1014177971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c103b90 msgr2=0x7f3d1c19ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d1be00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c103b90 0x7f3d1c19ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d1be00640 1 -- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d1c1031f0 msgr2=0x7f3d1c19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d1be00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d1c1031f0 0x7f3d1c19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.248+0000 7f3d1be00640 1 -- 172.21.15.1:0/1014177971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c19b5a0 con 0x7f3d1c102170 2024-08-28T20:20:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.249+0000 7f3d1be00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 0x7f3d1c199b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009980 tx=0x7f3d0c02ae30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.250+0000 7f3d18c00640 1 -- 172.21.15.1:0/1014177971 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c037040 con 0x7f3d1c102170 2024-08-28T20:20:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.250+0000 7f3d18c00640 1 -- 172.21.15.1:0/1014177971 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d0c041070 con 0x7f3d1c102170 2024-08-28T20:20:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.250+0000 7f3d18c00640 1 -- 172.21.15.1:0/1014177971 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c004d00 con 0x7f3d1c102170 2024-08-28T20:20:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.250+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c19b830 con 0x7f3d1c102170 2024-08-28T20:20:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.250+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c104500 con 0x7f3d1c102170 2024-08-28T20:20:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.255+0000 7f3d2a1c8740 1 Processor -- start 2024-08-28T20:20:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.255+0000 7f3d2a1c8740 1 -- start start 2024-08-28T20:20:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.256+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1781b0 0x555dbb51dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.256+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb14f2f0 0x555dbb51e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.256+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb1574d0 0x555dbb51f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.256+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555dbb490f70 con 0x555dbb14f2f0 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.256+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555dbb480500 con 0x555dbb1574d0 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.256+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555dbb4844b0 con 0x555dbb1781b0 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d21200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1781b0 0x555dbb51dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d21200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1781b0 0x555dbb51dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34864/0 (socket says 172.21.15.1:34864) 2024-08-28T20:20:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d21200640 1 -- 172.21.15.1:0/3936671490 learned_addr learned my addr 172.21.15.1:0/3936671490 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d1b400640 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb1574d0 0x555dbb51f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d1b400640 1 -- 172.21.15.1:0/3936671490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1781b0 msgr2=0x555dbb51dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d1b400640 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1781b0 0x555dbb51dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d1b400640 1 -- 172.21.15.1:0/3936671490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb14f2f0 msgr2=0x555dbb51e610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d1b400640 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb14f2f0 0x555dbb51e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.257+0000 7f3d1b400640 1 -- 172.21.15.1:0/3936671490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb43ac10 con 0x555dbb1574d0 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.258+0000 7f3d1b400640 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb1574d0 0x555dbb51f160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009c20 tx=0x7f3d08011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d412c20ee6bd2f5c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.258+0000 7f3d11600640 1 -- 172.21.15.1:0/3936671490 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08004050 con 0x555dbb1574d0 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.258+0000 7f3d11600640 1 -- 172.21.15.1:0/3936671490 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d080054d0 con 0x555dbb1574d0 2024-08-28T20:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.258+0000 7f3d11600640 1 -- 172.21.15.1:0/3936671490 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08004cb0 con 0x555dbb1574d0 2024-08-28T20:20:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.259+0000 7f3d18c00640 1 -- 172.21.15.1:0/1014177971 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f3d0c005050 con 0x7f3d1c102170 2024-08-28T20:20:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.259+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3936671490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb1574d0 msgr2=0x555dbb51f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.259+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb1574d0 0x555dbb51f160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009c20 tx=0x7f3d08011810 comp rx=0 tx=0).stop 2024-08-28T20:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.260+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3936671490 shutdown_connections 2024-08-28T20:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.260+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb14f2f0 0x555dbb51e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.260+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb1574d0 0x555dbb51f160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.260+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3936671490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1781b0 0x555dbb51dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.260+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3936671490 >> 172.21.15.1:0/3936671490 conn(0x555dbb16c300 msgr2=0x555dbb519a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.261+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3936671490 shutdown_connections 2024-08-28T20:20:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.262+0000 7f3d18c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3d000b8fd0 0x7f3d000bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.263+0000 7f3d1b400640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3d000b8fd0 0x7f3d000bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.264+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3936671490 wait complete. 2024-08-28T20:20:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.265+0000 7f3d2a1c8740 1 -- start start 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.265+0000 7f3d2a1c8740 1 Processor -- start 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb538600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb538cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb539830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555dbb3b9ab0 con 0x555dbb1781b0 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555dbb427320 con 0x555dbb14f2f0 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555dbb51fcd0 con 0x555dbb1574d0 2024-08-28T20:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.266+0000 7f3d2a1c8740 10 client.0 _ll_register_callbacks cb 0x555dbb42d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.268+0000 7f3d18c00640 1 -- 172.21.15.1:0/1014177971 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3d0c104c50 con 0x7f3d1c102170 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.268+0000 7f3d1b400640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3d000b8fd0 0x7f3d000bb4e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3d080057c0 tx=0x7f3d08000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.268+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb538600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.268+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb538600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58496/0 (socket says 172.21.15.1:58496) 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.268+0000 7f3d1be00640 1 -- 172.21.15.1:0/3339402018 learned_addr learned my addr 172.21.15.1:0/3339402018 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.268+0000 7f3d1b400640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb538cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.269+0000 7f3d21200640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb539830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.270+0000 7f3d21200640 1 -- 172.21.15.1:0/3339402018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 msgr2=0x555dbb538cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.270+0000 7f3d21200640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb538cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.270+0000 7f3d21200640 1 -- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 msgr2=0x555dbb538600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.270+0000 7f3d21200640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb538600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.270+0000 7f3d21200640 1 -- 172.21.15.1:0/3339402018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb1e3790 con 0x555dbb1781b0 2024-08-28T20:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.273+0000 7f3d21200640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb539830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400ee90 tx=0x7f3d1400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85f3067e14beff6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.273+0000 7f3d06000640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.274+0000 7f3d06000640 1 -- 172.21.15.1:0/3339402018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14003d80 con 0x555dbb1781b0 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.274+0000 7f3d06000640 1 -- 172.21.15.1:0/3339402018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3d14004050 con 0x555dbb1781b0 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.274+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d080054d0 con 0x555dbb1781b0 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.274+0000 7f3d06000640 1 -- 172.21.15.1:0/3339402018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d14009e30 con 0x555dbb1781b0 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.274+0000 7f3d2a1c8740 10 client.15285 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.274+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555dbb25c620 con 0x555dbb1781b0 2024-08-28T20:20:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.275+0000 7f3d06000640 1 -- 172.21.15.1:0/3339402018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d080054d0 con 0x555dbb1781b0 2024-08-28T20:20:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d06000640 1 -- 172.21.15.1:0/3339402018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3d1400b040 con 0x555dbb1781b0 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d2a1c8740 10 client.15285 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d2a1c8740 10 client.15285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d2a1c8740 20 client.15285 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb136d80 0x555dbb545f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d2a1c8740 4 client.15285 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dbb492ec0 con 0x555dbb136d80 2024-08-28T20:20:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.279+0000 7f3d1be00640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb136d80 0x555dbb545f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.280+0000 7f3d1be00640 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb136d80 0x555dbb545f00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2a03bde60f7925b server_cookie=6a2ff22dbacafed1 in_seq=0 out_seq=0 2024-08-28T20:20:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.281+0000 7f3d06000640 10 client.15285 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.281+0000 7f3d06000640 1 -- 172.21.15.1:0/3339402018 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555dbb492ec0 con 0x555dbb136d80 2024-08-28T20:20:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.281+0000 7f3d06000640 10 client.15285 handle_command_reply: tid=0 2024-08-28T20:20:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.281+0000 7f3d2a1c8740 1 client.15285 shutdown 2024-08-28T20:20:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 msgr2=0x555dbb539830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb539830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400ee90 tx=0x7f3d1400d7b0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 shutdown_connections 2024-08-28T20:20:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb136d80 0x555dbb545f00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d06000640 0 client.15285 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb539830 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb538cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/3339402018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb538600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.282+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 >> 172.21.15.1:0/3339402018 conn(0x555dbb16c300 msgr2=0x555dbb517f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.283+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 shutdown_connections 2024-08-28T20:20:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.284+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/3339402018 wait complete. 2024-08-28T20:20:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.284+0000 7f3d2a1c8740 20 client.15285 trim_cache size 0 max 16384 2024-08-28T20:20:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.314+0000 7f3d2a1c8740 1 Processor -- start 2024-08-28T20:20:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.314+0000 7f3d2a1c8740 1 -- start start 2024-08-28T20:20:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb526b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb521fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb522520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1a2a40 con 0x555dbb1781b0 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c0738a0 con 0x555dbb14f2f0 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c0716f0 con 0x555dbb1574d0 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb526b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d1b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb521fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb526b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58506/0 (socket says 172.21.15.1:58506) 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d1be00640 1 -- 172.21.15.1:0/892396106 learned_addr learned my addr 172.21.15.1:0/892396106 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.315+0000 7f3d21200640 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb522520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1be00640 1 -- 172.21.15.1:0/892396106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 msgr2=0x555dbb521fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1be00640 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb521fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1be00640 1 -- 172.21.15.1:0/892396106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 msgr2=0x555dbb522520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1be00640 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb522520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1be00640 1 -- 172.21.15.1:0/892396106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb51a3b0 con 0x555dbb14f2f0 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d21200640 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb522520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1b400640 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb521fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:07.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.316+0000 7f3d1be00640 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb526b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0cb000 tx=0x7f3d0c1025b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab94768e1197ac3c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:07.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.319+0000 7f3d10c00640 1 -- 172.21.15.1:0/892396106 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0cb1a0 con 0x555dbb14f2f0 2024-08-28T20:20:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.319+0000 7f3d10c00640 1 -- 172.21.15.1:0/892396106 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d0c0cbd90 con 0x555dbb14f2f0 2024-08-28T20:20:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.319+0000 7f3d10c00640 1 -- 172.21.15.1:0/892396106 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0c7890 con 0x555dbb14f2f0 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/892396106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 msgr2=0x555dbb526b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb526b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0cb000 tx=0x7f3d0c1025b0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/892396106 shutdown_connections 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb522520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb521fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/892396106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb526b60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.320+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/892396106 >> 172.21.15.1:0/892396106 conn(0x555dbb16c300 msgr2=0x555dbb51ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.321+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/892396106 shutdown_connections 2024-08-28T20:20:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.321+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/892396106 wait complete. 2024-08-28T20:20:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.321+0000 7f3d2a1c8740 1 -- start start 2024-08-28T20:20:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.322+0000 7f3d2a1c8740 1 Processor -- start 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb53f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb53fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb53ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c071d60 con 0x555dbb1781b0 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c0731d0 con 0x555dbb14f2f0 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c072430 con 0x555dbb1574d0 2024-08-28T20:20:07.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.323+0000 7f3d2a1c8740 10 client.0 _ll_register_callbacks cb 0x7f3d1400ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.324+0000 7f3d1b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb53fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.324+0000 7f3d21200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb53ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.324+0000 7f3d21200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb53ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43218/0 (socket says 172.21.15.1:43218) 2024-08-28T20:20:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.324+0000 7f3d21200640 1 -- 172.21.15.1:0/857436811 learned_addr learned my addr 172.21.15.1:0/857436811 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:07.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.324+0000 7f3d1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb53f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.325+0000 7f3d1be00640 1 -- 172.21.15.1:0/857436811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 msgr2=0x555dbb53fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.325+0000 7f3d1be00640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb53fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.326+0000 7f3d1be00640 1 -- 172.21.15.1:0/857436811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 msgr2=0x555dbb53ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.326+0000 7f3d1be00640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb53ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.326+0000 7f3d1be00640 1 -- 172.21.15.1:0/857436811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb53e230 con 0x555dbb14f2f0 2024-08-28T20:20:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.326+0000 7f3d1b400640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb53fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:20:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.326+0000 7f3d21200640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb53ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.327+0000 7f3d1be00640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb53f540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0cb620 tx=0x7f3d0c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=868d8b83d350f412 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.327+0000 7f3d06000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.327+0000 7f3d06000640 1 -- 172.21.15.1:0/857436811 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0cb1a0 con 0x555dbb14f2f0 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.327+0000 7f3d06000640 1 -- 172.21.15.1:0/857436811 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3d0c0c7bf0 con 0x555dbb14f2f0 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.327+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d0c0cbd90 con 0x555dbb14f2f0 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.328+0000 7f3d06000640 1 -- 172.21.15.1:0/857436811 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d0c0f2330 con 0x555dbb14f2f0 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.328+0000 7f3d2a1c8740 10 client.25376 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.328+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555dbb5aac40 con 0x555dbb14f2f0 2024-08-28T20:20:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d06000640 1 -- 172.21.15.1:0/857436811 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d0c0cbd90 con 0x555dbb14f2f0 2024-08-28T20:20:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d06000640 1 -- 172.21.15.1:0/857436811 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3d0c0c95e0 con 0x555dbb14f2f0 2024-08-28T20:20:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d2a1c8740 10 client.25376 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d2a1c8740 10 client.25376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d2a1c8740 20 client.25376 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb10c1c0 0x555dbb5ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d2a1c8740 4 client.25376 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:20:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.329+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555dbb48e960 con 0x555dbb10c1c0 2024-08-28T20:20:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.330+0000 7f3d1b400640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb10c1c0 0x555dbb5ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.331+0000 7f3d1b400640 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb10c1c0 0x555dbb5ad450 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56547ff6321a7ad server_cookie=69e8e04248144df5 in_seq=0 out_seq=0 2024-08-28T20:20:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.331+0000 7f3d06000640 10 client.25376 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.344+0000 7f3d06000640 1 -- 172.21.15.1:0/857436811 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555dbb48e960 con 0x555dbb10c1c0 2024-08-28T20:20:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.344+0000 7f3d06000640 10 client.25376 handle_command_reply: tid=0 2024-08-28T20:20:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.344+0000 7f3d2a1c8740 1 client.25376 shutdown 2024-08-28T20:20:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.344+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 msgr2=0x555dbb53f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.344+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb53f540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0cb620 tx=0x7f3d0c005f90 comp rx=0 tx=0).stop 2024-08-28T20:20:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 shutdown_connections 2024-08-28T20:20:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555dbb10c1c0 0x555dbb5ad450 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555dbb1781b0 0x555dbb53ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555dbb1574d0 0x555dbb53fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d2a1c8740 1 --2- 172.21.15.1:0/857436811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dbb14f2f0 0x555dbb53f540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 >> 172.21.15.1:0/857436811 conn(0x555dbb16c300 msgr2=0x555dbb521fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.345+0000 7f3d06000640 0 client.25376 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.347+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 shutdown_connections 2024-08-28T20:20:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.347+0000 7f3d2a1c8740 1 -- 172.21.15.1:0/857436811 wait complete. 2024-08-28T20:20:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.347+0000 7f3d2a1c8740 20 client.25376 trim_cache size 0 max 16384 2024-08-28T20:20:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:20:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3d000b8fd0 msgr2=0x7f3d000bb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3d000b8fd0 0x7f3d000bb4e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3d080057c0 tx=0x7f3d08000bc0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 msgr2=0x7f3d1c199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 0x7f3d1c199b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009980 tx=0x7f3d0c02ae30 comp rx=0 tx=0).stop 2024-08-28T20:20:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 shutdown_connections 2024-08-28T20:20:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3d000b8fd0 0x7f3d000bb4e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d1c1031f0 0x7f3d1c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c103b90 0x7f3d1c19ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 --2- 172.21.15.1:0/1014177971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d1c102170 0x7f3d1c199b60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 >> 172.21.15.1:0/1014177971 conn(0x7f3d1c0fdab0 msgr2=0x7f3d1c06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 shutdown_connections 2024-08-28T20:20:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:07.349+0000 7f3d21c00640 1 -- 172.21.15.1:0/1014177971 wait complete. 2024-08-28T20:20:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:07 smithi001 ceph-mon[20984]: pgmap v425: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-08-28T20:20:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:07 smithi121 ceph-mon[25248]: pgmap v425: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-08-28T20:20:07.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:07 smithi007 ceph-mon[25357]: pgmap v425: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-08-28T20:20:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 100.0 s, 2933.0 tps, lat 34.017 ms stddev 40.097 2024-08-28T20:20:09.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:09 smithi001 ceph-mon[20984]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 696 op/s 2024-08-28T20:20:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:09 smithi121 ceph-mon[25248]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 696 op/s 2024-08-28T20:20:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:09 smithi007 ceph-mon[25357]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 696 op/s 2024-08-28T20:20:11.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:11 smithi001 ceph-mon[20984]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-08-28T20:20:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:11 smithi121 ceph-mon[25248]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-08-28T20:20:11.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:11 smithi007 ceph-mon[25357]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 10 MiB/s wr, 774 op/s 2024-08-28T20:20:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:13 smithi001 ceph-mon[20984]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-08-28T20:20:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:13 smithi121 ceph-mon[25248]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-08-28T20:20:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 105.0 s, 3679.6 tps, lat 27.184 ms stddev 30.853 2024-08-28T20:20:13.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:13 smithi007 ceph-mon[25357]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-08-28T20:20:15.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:15 smithi001 ceph-mon[20984]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 794 op/s 2024-08-28T20:20:15.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:15 smithi121 ceph-mon[25248]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 794 op/s 2024-08-28T20:20:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:15 smithi007 ceph-mon[25357]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 794 op/s 2024-08-28T20:20:17.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:17 smithi001 ceph-mon[20984]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 MiB/s wr, 766 op/s 2024-08-28T20:20:17.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:17 smithi121 ceph-mon[25248]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 MiB/s wr, 766 op/s 2024-08-28T20:20:17.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:17 smithi007 ceph-mon[25357]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 MiB/s wr, 766 op/s 2024-08-28T20:20:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 110.0 s, 3307.6 tps, lat 30.301 ms stddev 34.419 2024-08-28T20:20:19.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:19 smithi001 ceph-mon[20984]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 678 op/s 2024-08-28T20:20:19.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:19 smithi121 ceph-mon[25248]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 678 op/s 2024-08-28T20:20:19.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:19 smithi007 ceph-mon[25357]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 678 op/s 2024-08-28T20:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.678+0000 7f8d09c00640 1 -- 172.21.15.1:0/3501804624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d04075a90 msgr2=0x7f8d04075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.678+0000 7f8d09c00640 1 --2- 172.21.15.1:0/3501804624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d04075a90 0x7f8d04075ea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009900 tx=0x7f8cf002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.678+0000 7f8d09c00640 1 -- 172.21.15.1:0/3501804624 shutdown_connections 2024-08-28T20:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.678+0000 7f8d09c00640 1 --2- 172.21.15.1:0/3501804624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d0410fbd0 0x7f8d04111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.679+0000 7f8d09c00640 1 --2- 172.21.15.1:0/3501804624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d04075a90 0x7f8d04075ea0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.679+0000 7f8d09c00640 1 --2- 172.21.15.1:0/3501804624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04076e90 0x7f8d04075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.679+0000 7f8d09c00640 1 -- 172.21.15.1:0/3501804624 >> 172.21.15.1:0/3501804624 conn(0x7f8d040fed90 msgr2=0x7f8d04101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.679+0000 7f8d09c00640 1 -- 172.21.15.1:0/3501804624 shutdown_connections 2024-08-28T20:20:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.679+0000 7f8d09c00640 1 -- 172.21.15.1:0/3501804624 wait complete. 2024-08-28T20:20:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.681+0000 7f8d09c00640 1 Processor -- start 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.681+0000 7f8d09c00640 1 -- start start 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.682+0000 7f8d09c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04075a90 0x7f8d040720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.682+0000 7f8d09c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 0x7f8d04072730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.682+0000 7f8d09c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d0410fbd0 0x7f8d040732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.682+0000 7f8d09c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041156d0 con 0x7f8d04075a90 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.682+0000 7f8d09c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d04115550 con 0x7f8d04076e90 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.682+0000 7f8d09c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d04115850 con 0x7f8d0410fbd0 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.683+0000 7f8d02000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 0x7f8d04072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.683+0000 7f8d02000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 0x7f8d04072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56124/0 (socket says 172.21.15.1:56124) 2024-08-28T20:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.683+0000 7f8d02000640 1 -- 172.21.15.1:0/341784693 learned_addr learned my addr 172.21.15.1:0/341784693 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.683+0000 7f8d02a00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04075a90 0x7f8d040720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.683+0000 7f8d03400640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d0410fbd0 0x7f8d040732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.683+0000 7f8d02a00640 1 -- 172.21.15.1:0/341784693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d0410fbd0 msgr2=0x7f8d040732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d02a00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d0410fbd0 0x7f8d040732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d02a00640 1 -- 172.21.15.1:0/341784693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 msgr2=0x7f8d04072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d02a00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 0x7f8d04072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d02a00640 1 -- 172.21.15.1:0/341784693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d04073b00 con 0x7f8d04075a90 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d02000640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 0x7f8d04072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d02a00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04075a90 0x7f8d040720c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400d6d0 tx=0x7f8cf400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8cfb400640 1 -- 172.21.15.1:0/341784693 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4017070 con 0x7f8d04075a90 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d04073df0 con 0x7f8d04075a90 2024-08-28T20:20:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8cfb400640 1 -- 172.21.15.1:0/341784693 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf4009820 con 0x7f8d04075a90 2024-08-28T20:20:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.684+0000 7f8cfb400640 1 -- 172.21.15.1:0/341784693 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4004c40 con 0x7f8d04075a90 2024-08-28T20:20:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.685+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d040744b0 con 0x7f8d04075a90 2024-08-28T20:20:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.689+0000 7f8d10c9b740 1 Processor -- start 2024-08-28T20:20:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.689+0000 7f8d10c9b740 1 -- start start 2024-08-28T20:20:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 0x55fe92c0ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c0e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c0ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fe92b80f70 con 0x55fe928474d0 2024-08-28T20:20:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe92b70500 con 0x55fe9283f2f0 2024-08-28T20:20:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fe92b744b0 con 0x55fe928681b0 2024-08-28T20:20:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8cfb400640 1 -- 172.21.15.1:0/341784693 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f8cf4005220 con 0x7f8d04075a90 2024-08-28T20:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.690+0000 7f8d03400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 0x55fe92c0ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d03400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 0x55fe92c0ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53102/0 (socket says 172.21.15.1:53102) 2024-08-28T20:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d03400640 1 -- 172.21.15.1:0/830556048 learned_addr learned my addr 172.21.15.1:0/830556048 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c0e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02000640 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c0ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02a00640 1 -- 172.21.15.1:0/830556048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 msgr2=0x55fe92c0ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02a00640 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 0x55fe92c0ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02a00640 1 -- 172.21.15.1:0/830556048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 msgr2=0x55fe92c0ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02a00640 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c0ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02a00640 1 -- 172.21.15.1:0/830556048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe92b2ac10 con 0x55fe9283f2f0 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d03400640 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 0x55fe92c0ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.691+0000 7f8d02000640 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c0ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.692+0000 7f8d02a00640 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c0e430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40e22a0 tx=0x7f8cf40ec670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f88dae46593fe9d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.692+0000 7f8cefe00640 1 -- 172.21.15.1:0/830556048 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40f3070 con 0x55fe9283f2f0 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.692+0000 7f8cefe00640 1 -- 172.21.15.1:0/830556048 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf40e6780 con 0x55fe9283f2f0 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.692+0000 7f8cefe00640 1 -- 172.21.15.1:0/830556048 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40efc30 con 0x55fe9283f2f0 2024-08-28T20:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.692+0000 7f8cfb400640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8ce80b4bf0 0x7f8ce80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.692+0000 7f8cfb400640 1 -- 172.21.15.1:0/341784693 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8cf40e4870 con 0x7f8d04075a90 2024-08-28T20:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.693+0000 7f8d03400640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8ce80b4bf0 0x7f8ce80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.694+0000 7f8d10c9b740 1 -- 172.21.15.1:0/830556048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 msgr2=0x55fe92c0e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.694+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c0e430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40e22a0 tx=0x7f8cf40ec670 comp rx=0 tx=0).stop 2024-08-28T20:20:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.694+0000 7f8d10c9b740 1 -- 172.21.15.1:0/830556048 shutdown_connections 2024-08-28T20:20:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.694+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c0ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.695+0000 7f8d03400640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8ce80b4bf0 0x7f8ce80b7100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc005f40 tx=0x7f8cfc009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.695+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c0e430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.695+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/830556048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928681b0 0x55fe92c0ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.695+0000 7f8d10c9b740 1 -- 172.21.15.1:0/830556048 >> 172.21.15.1:0/830556048 conn(0x55fe9285c300 msgr2=0x55fe92c09850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.695+0000 7f8d10c9b740 1 -- 172.21.15.1:0/830556048 shutdown_connections 2024-08-28T20:20:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.695+0000 7f8d10c9b740 1 -- 172.21.15.1:0/830556048 wait complete. 2024-08-28T20:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.697+0000 7f8d10c9b740 1 -- start start 2024-08-28T20:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.697+0000 7f8d10c9b740 1 Processor -- start 2024-08-28T20:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c17480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928474d0 0x55fe92c17b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928681b0 0x55fe92c186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fe92aa9ab0 con 0x55fe928681b0 2024-08-28T20:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe92b17320 con 0x55fe9283f2f0 2024-08-28T20:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fe92c0faa0 con 0x55fe928474d0 2024-08-28T20:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d10c9b740 10 client.0 _ll_register_callbacks cb 0x55fe92b1d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c17480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c17480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56134/0 (socket says 172.21.15.1:56134) 2024-08-28T20:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d02a00640 1 -- 172.21.15.1:0/3161196596 learned_addr learned my addr 172.21.15.1:0/3161196596 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d02000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928474d0 0x55fe92c17b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.698+0000 7f8d03400640 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928681b0 0x55fe92c186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d02a00640 1 -- 172.21.15.1:0/3161196596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928474d0 msgr2=0x55fe92c17b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d02a00640 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928474d0 0x55fe92c17b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d02a00640 1 -- 172.21.15.1:0/3161196596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928681b0 msgr2=0x55fe92c186b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d02a00640 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928681b0 0x55fe92c186b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d02a00640 1 -- 172.21.15.1:0/3161196596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe928d3790 con 0x55fe9283f2f0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d02a00640 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c17480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40aafe0 tx=0x7f8cf4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeaa7ebc3c2596b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8cecc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8cecc00640 1 -- 172.21.15.1:0/3161196596 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4020030 con 0x55fe9283f2f0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8cecc00640 1 -- 172.21.15.1:0/3161196596 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8cf40e2410 con 0x55fe9283f2f0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf40e6780 con 0x55fe9283f2f0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.699+0000 7f8cecc00640 1 -- 172.21.15.1:0/3161196596 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8cf40f3070 con 0x55fe9283f2f0 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 10 client.25388 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fe9294c620 con 0x55fe9283f2f0 2024-08-28T20:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8cecc00640 1 -- 172.21.15.1:0/3161196596 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf40e6780 con 0x55fe9283f2f0 2024-08-28T20:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8cecc00640 1 -- 172.21.15.1:0/3161196596 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8cf4023060 con 0x55fe9283f2f0 2024-08-28T20:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 10 client.25388 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 10 client.25388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 20 client.25388 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe92826d80 0x55fe92c24790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 4 client.25388 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.700+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe92b82ec0 con 0x55fe92826d80 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.701+0000 7f8d02000640 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe92826d80 0x55fe92c24790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.702+0000 7f8cecc00640 10 client.25388 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.701+0000 7f8d02000640 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe92826d80 0x55fe92c24790 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f489a9792234ce server_cookie=e124238e92a9f90 in_seq=0 out_seq=0 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.702+0000 7f8cecc00640 1 -- 172.21.15.1:0/3161196596 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe92b82ec0 con 0x55fe92826d80 2024-08-28T20:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.702+0000 7f8cecc00640 10 client.25388 handle_command_reply: tid=0 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.703+0000 7f8d10c9b740 1 client.25388 shutdown 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.703+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 msgr2=0x55fe92c17480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.703+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c17480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40aafe0 tx=0x7f8cf4000bc0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 shutdown_connections 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe92826d80 0x55fe92c24790 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928681b0 0x55fe92c186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe928474d0 0x55fe92c17b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/3161196596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9283f2f0 0x55fe92c17480 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 >> 172.21.15.1:0/3161196596 conn(0x55fe9285c300 msgr2=0x55fe92c07cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8cecc00640 0 client.25388 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 shutdown_connections 2024-08-28T20:20:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 1 -- 172.21.15.1:0/3161196596 wait complete. 2024-08-28T20:20:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.704+0000 7f8d10c9b740 20 client.25388 trim_cache size 0 max 16384 2024-08-28T20:20:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.723+0000 7f8d10c9b740 1 Processor -- start 2024-08-28T20:20:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.723+0000 7f8d10c9b740 1 -- start start 2024-08-28T20:20:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.723+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c0aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c08bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041bc460 con 0x55fe928474d0 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041b9cd0 con 0x55fe9285c300 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041b7b20 con 0x55fe9283f2f0 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c0aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c08bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c0aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56136/0 (socket says 172.21.15.1:56136) 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 -- 172.21.15.1:0/2953130232 learned_addr learned my addr 172.21.15.1:0/2953130232 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d03400640 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:20 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 -- 172.21.15.1:0/2953130232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 msgr2=0x55fe92c08bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c08bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 -- 172.21.15.1:0/2953130232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 msgr2=0x55fe92c090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.724+0000 7f8d02a00640 1 -- 172.21.15.1:0/2953130232 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe92c1f950 con 0x55fe9285c300 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.725+0000 7f8d02a00640 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c0aca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40ea210 tx=0x7f8cf40ecfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e12c3d58bd5a0b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.725+0000 7f8cef400640 1 -- 172.21.15.1:0/2953130232 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4020030 con 0x55fe9285c300 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.725+0000 7f8cef400640 1 -- 172.21.15.1:0/2953130232 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf40aadf0 con 0x55fe9285c300 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.725+0000 7f8cef400640 1 -- 172.21.15.1:0/2953130232 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40ea3c0 con 0x55fe9285c300 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 -- 172.21.15.1:0/2953130232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 msgr2=0x55fe92c0aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c0aca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40ea210 tx=0x7f8cf40ecfd0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 -- 172.21.15.1:0/2953130232 shutdown_connections 2024-08-28T20:20:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c08bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/2953130232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c0aca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.726+0000 7f8d10c9b740 1 -- 172.21.15.1:0/2953130232 >> 172.21.15.1:0/2953130232 conn(0x55fe92c049c0 msgr2=0x55fe92c084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.727+0000 7f8d10c9b740 1 -- 172.21.15.1:0/2953130232 shutdown_connections 2024-08-28T20:20:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.727+0000 7f8d10c9b740 1 -- 172.21.15.1:0/2953130232 wait complete. 2024-08-28T20:20:20.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:20 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.727+0000 7f8d10c9b740 1 -- start start 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.727+0000 7f8d10c9b740 1 Processor -- start 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c1f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c1d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041b8190 con 0x55fe928474d0 2024-08-28T20:20:20.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041b9600 con 0x55fe9285c300 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d041b8860 con 0x55fe9283f2f0 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d10c9b740 10 client.0 _ll_register_callbacks cb 0x7f8cf40057f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c1d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c1d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56150/0 (socket says 172.21.15.1:56150) 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d03400640 1 -- 172.21.15.1:0/1837770802 learned_addr learned my addr 172.21.15.1:0/1837770802 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d02000640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c1f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d02a00640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d03400640 1 -- 172.21.15.1:0/1837770802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 msgr2=0x55fe92c1eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.728+0000 7f8d03400640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c1eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.729+0000 7f8d03400640 1 -- 172.21.15.1:0/1837770802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 msgr2=0x55fe92c1f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.729+0000 7f8d03400640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c1f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.729+0000 7f8d03400640 1 -- 172.21.15.1:0/1837770802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe92c1db20 con 0x55fe9285c300 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.729+0000 7f8d02000640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c1f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:20.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.729+0000 7f8d03400640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c1d4b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc01d6a0 tx=0x7f8cfc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15842aff5a358414 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.729+0000 7f8cecc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8cecc00640 1 -- 172.21.15.1:0/1837770802 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc004b20 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8cecc00640 1 -- 172.21.15.1:0/1837770802 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8cfc004cc0 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf40aadf0 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8cecc00640 1 -- 172.21.15.1:0/1837770802 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8cfc01c6b0 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8d10c9b740 10 client.25394 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fe92c8fad0 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.730+0000 7f8cecc00640 1 -- 172.21.15.1:0/1837770802 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cf40aadf0 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8cecc00640 1 -- 172.21.15.1:0/1837770802 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8cfc01a040 con 0x55fe9285c300 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d10c9b740 10 client.25394 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d10c9b740 10 client.25394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d10c9b740 20 client.25394 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe928681b0 0x55fe92c925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:20.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d10c9b740 4 client.25394 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:20:20.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe92b7e960 con 0x55fe928681b0 2024-08-28T20:20:20.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.731+0000 7f8d02a00640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe928681b0 0x55fe92c925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:20.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.732+0000 7f8d02a00640 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe928681b0 0x55fe92c925d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=740a8696edebebec server_cookie=63b527808595db2a in_seq=0 out_seq=0 2024-08-28T20:20:20.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.732+0000 7f8cecc00640 10 client.25394 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.802+0000 7f8cecc00640 1 -- 172.21.15.1:0/1837770802 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe92b7e960 con 0x55fe928681b0 2024-08-28T20:20:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.802+0000 7f8cecc00640 10 client.25394 handle_command_reply: tid=0 2024-08-28T20:20:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.802+0000 7f8d10c9b740 1 client.25394 shutdown 2024-08-28T20:20:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 msgr2=0x55fe92c1d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c1d4b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc01d6a0 tx=0x7f8cfc004a40 comp rx=0 tx=0).stop 2024-08-28T20:20:20.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 shutdown_connections 2024-08-28T20:20:20.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fe928681b0 0x55fe92c925d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fe928474d0 0x55fe92c1f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9285c300 0x55fe92c1d4b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 --2- 172.21.15.1:0/1837770802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fe9283f2f0 0x55fe92c1eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.805+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 >> 172.21.15.1:0/1837770802 conn(0x55fe92c049c0 msgr2=0x55fe92c08e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.806+0000 7f8cecc00640 0 client.25394 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.806+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 shutdown_connections 2024-08-28T20:20:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.806+0000 7f8d10c9b740 1 -- 172.21.15.1:0/1837770802 wait complete. 2024-08-28T20:20:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.806+0000 7f8d10c9b740 20 client.25394 trim_cache size 0 max 16384 2024-08-28T20:20:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:20:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:20:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:20:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:20:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.808+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8ce80b4bf0 msgr2=0x7f8ce80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.808+0000 7f8d09c00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8ce80b4bf0 0x7f8ce80b7100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc005f40 tx=0x7f8cfc009600 comp rx=0 tx=0).stop 2024-08-28T20:20:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.808+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04075a90 msgr2=0x7f8d040720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.808+0000 7f8d09c00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04075a90 0x7f8d040720c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400d6d0 tx=0x7f8cf400db90 comp rx=0 tx=0).stop 2024-08-28T20:20:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 shutdown_connections 2024-08-28T20:20:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f8ce80b4bf0 0x7f8ce80b7100 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d0410fbd0 0x7f8d040732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d04076e90 0x7f8d04072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 --2- 172.21.15.1:0/341784693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d04075a90 0x7f8d040720c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 >> 172.21.15.1:0/341784693 conn(0x7f8d040fed90 msgr2=0x7f8d04102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 shutdown_connections 2024-08-28T20:20:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:20.809+0000 7f8d09c00640 1 -- 172.21.15.1:0/341784693 wait complete. 2024-08-28T20:20:20.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:20 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:20:21.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:21 smithi001 ceph-mon[20984]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 739 op/s 2024-08-28T20:20:21.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:21 smithi121 ceph-mon[25248]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 739 op/s 2024-08-28T20:20:21.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:21 smithi007 ceph-mon[25357]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 739 op/s 2024-08-28T20:20:22.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:20:22.629 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:20:22.629 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:20:22.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:20:22.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:20:22.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:20:22.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:20:22.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:20:22.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:20:23.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:23 smithi001 ceph-mon[20984]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.2 MiB/s wr, 715 op/s 2024-08-28T20:20:23.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:23 smithi121 ceph-mon[25248]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.2 MiB/s wr, 715 op/s 2024-08-28T20:20:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 115.0 s, 3299.3 tps, lat 30.196 ms stddev 33.711 2024-08-28T20:20:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:23 smithi007 ceph-mon[25357]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.2 MiB/s wr, 715 op/s 2024-08-28T20:20:25.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:25 smithi001 ceph-mon[20984]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.1 MiB/s wr, 754 op/s 2024-08-28T20:20:25.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:25 smithi121 ceph-mon[25248]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.1 MiB/s wr, 754 op/s 2024-08-28T20:20:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:25 smithi007 ceph-mon[25357]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.1 MiB/s wr, 754 op/s 2024-08-28T20:20:27.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:27 smithi001 ceph-mon[20984]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 802 op/s 2024-08-28T20:20:27.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:27 smithi121 ceph-mon[25248]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 802 op/s 2024-08-28T20:20:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:27 smithi007 ceph-mon[25357]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 802 op/s 2024-08-28T20:20:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 120.0 s, 2852.4 tps, lat 35.191 ms stddev 40.230 2024-08-28T20:20:29.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:29 smithi001 ceph-mon[20984]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 768 op/s 2024-08-28T20:20:29.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:29 smithi121 ceph-mon[25248]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 768 op/s 2024-08-28T20:20:29.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:29 smithi007 ceph-mon[25357]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 768 op/s 2024-08-28T20:20:31.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:31 smithi001 ceph-mon[20984]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-08-28T20:20:31.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:31 smithi121 ceph-mon[25248]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-08-28T20:20:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:31 smithi007 ceph-mon[25357]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-08-28T20:20:33.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:33 smithi001 ceph-mon[20984]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 764 op/s 2024-08-28T20:20:33.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:33 smithi121 ceph-mon[25248]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 764 op/s 2024-08-28T20:20:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 125.0 s, 4046.6 tps, lat 24.516 ms stddev 25.979 2024-08-28T20:20:33.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:33 smithi007 ceph-mon[25357]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 764 op/s 2024-08-28T20:20:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.130+0000 7f5f94600640 1 -- 172.21.15.1:0/3450231037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c1033e0 msgr2=0x7f5f8c1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.130+0000 7f5f94600640 1 --2- 172.21.15.1:0/3450231037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c1033e0 0x7f5f8c1037f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009900 tx=0x7f5f7802a410 comp rx=0 tx=0).stop 2024-08-28T20:20:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.131+0000 7f5f94600640 1 -- 172.21.15.1:0/3450231037 shutdown_connections 2024-08-28T20:20:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.131+0000 7f5f94600640 1 --2- 172.21.15.1:0/3450231037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c103d80 0x7f5f8c10a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.131+0000 7f5f94600640 1 --2- 172.21.15.1:0/3450231037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c1033e0 0x7f5f8c1037f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.131+0000 7f5f94600640 1 --2- 172.21.15.1:0/3450231037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f8c102360 0x7f5f8c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.131+0000 7f5f94600640 1 -- 172.21.15.1:0/3450231037 >> 172.21.15.1:0/3450231037 conn(0x7f5f8c0fdca0 msgr2=0x7f5f8c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:34.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.135+0000 7f5f94600640 1 -- 172.21.15.1:0/3450231037 shutdown_connections 2024-08-28T20:20:34.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.135+0000 7f5f94600640 1 -- 172.21.15.1:0/3450231037 wait complete. 2024-08-28T20:20:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.139+0000 7f5f94600640 1 Processor -- start 2024-08-28T20:20:34.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.139+0000 7f5f94600640 1 -- start start 2024-08-28T20:20:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.141+0000 7f5f94600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f8c102360 0x7f5f8c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.142+0000 7f5f94600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c103d80 0x7f5f8c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.142+0000 7f5f94600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c19b110 0x7f5f8c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.142+0000 7f5f94600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c10e0f0 con 0x7f5f8c19b110 2024-08-28T20:20:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.142+0000 7f5f94600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c10df70 con 0x7f5f8c102360 2024-08-28T20:20:34.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.142+0000 7f5f94600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c10e270 con 0x7f5f8c103d80 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.143+0000 7f5f91200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c103d80 0x7f5f8c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.143+0000 7f5f91200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c103d80 0x7f5f8c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33790/0 (socket says 172.21.15.1:33790) 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.143+0000 7f5f91200640 1 -- 172.21.15.1:0/676126708 learned_addr learned my addr 172.21.15.1:0/676126708 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.143+0000 7f5f92600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c19b110 0x7f5f8c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.144+0000 7f5f91c00640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f8c102360 0x7f5f8c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.144+0000 7f5f92600640 1 -- 172.21.15.1:0/676126708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c103d80 msgr2=0x7f5f8c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.144+0000 7f5f92600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c103d80 0x7f5f8c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.144+0000 7f5f92600640 1 -- 172.21.15.1:0/676126708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f8c102360 msgr2=0x7f5f8c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.144+0000 7f5f92600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f8c102360 0x7f5f8c199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.144+0000 7f5f92600640 1 -- 172.21.15.1:0/676126708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8c19be30 con 0x7f5f8c19b110 2024-08-28T20:20:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.145+0000 7f5f92600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c19b110 0x7f5f8c19b610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400be20 tx=0x7f5f8400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:34.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.146+0000 7f5f8a000640 1 -- 172.21.15.1:0/676126708 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84019070 con 0x7f5f8c19b110 2024-08-28T20:20:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.146+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8c104750 con 0x7f5f8c19b110 2024-08-28T20:20:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.146+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8c104d70 con 0x7f5f8c19b110 2024-08-28T20:20:34.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.150+0000 7f5f8a000640 1 -- 172.21.15.1:0/676126708 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f840148f0 con 0x7f5f8c19b110 2024-08-28T20:20:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.152+0000 7f5f8a000640 1 -- 172.21.15.1:0/676126708 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84023060 con 0x7f5f8c19b110 2024-08-28T20:20:34.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.156+0000 7f5f9b641740 1 Processor -- start 2024-08-28T20:20:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.157+0000 7f5f8a000640 1 -- 172.21.15.1:0/676126708 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f5f8401c070 con 0x7f5f8c19b110 2024-08-28T20:20:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 -- start start 2024-08-28T20:20:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73562dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f73563430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73563f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f734d5f70 con 0x562f7319c4d0 2024-08-28T20:20:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f734c5500 con 0x562f731bd1b0 2024-08-28T20:20:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.158+0000 7f5f9b641740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f734c94b0 con 0x562f731942f0 2024-08-28T20:20:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.159+0000 7f5f91200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73562dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.159+0000 7f5f91200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73562dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:56426/0 (socket says 172.21.15.1:56426) 2024-08-28T20:20:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.159+0000 7f5f91200640 1 -- 172.21.15.1:0/3347597799 learned_addr learned my addr 172.21.15.1:0/3347597799 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.159+0000 7f5f91200640 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73563f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.160+0000 7f5f91c00640 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f73563430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.160+0000 7f5f8a000640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f740b4d60 0x7f5f740b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f91200640 1 -- 172.21.15.1:0/3347597799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 msgr2=0x562f73563430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f91200640 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f73563430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f91200640 1 -- 172.21.15.1:0/3347597799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 msgr2=0x562f73563f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f91200640 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73563f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f91200640 1 -- 172.21.15.1:0/3347597799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7347fc10 con 0x562f731bd1b0 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f8a000640 1 -- 172.21.15.1:0/676126708 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5f840e4420 con 0x7f5f8c19b110 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.161+0000 7f5f91200640 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73562dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f78033000 tx=0x7f5f78009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703c221c36d7eb76 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.162+0000 7f5f7ea00640 1 -- 172.21.15.1:0/3347597799 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78045070 con 0x562f731bd1b0 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.162+0000 7f5f92600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f740b4d60 0x7f5f740b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.162+0000 7f5f7ea00640 1 -- 172.21.15.1:0/3347597799 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f78003dd0 con 0x562f731bd1b0 2024-08-28T20:20:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.162+0000 7f5f7ea00640 1 -- 172.21.15.1:0/3347597799 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78035070 con 0x562f731bd1b0 2024-08-28T20:20:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.163+0000 7f5f9b641740 1 -- 172.21.15.1:0/3347597799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 msgr2=0x562f73562dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.163+0000 7f5f9b641740 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73562dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f78033000 tx=0x7f5f78009600 comp rx=0 tx=0).stop 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.163+0000 7f5f92600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f740b4d60 0x7f5f740b7270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f84013000 tx=0x7f5f84007040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 -- 172.21.15.1:0/3347597799 shutdown_connections 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73563f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f73563430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 --2- 172.21.15.1:0/3347597799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73562dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 -- 172.21.15.1:0/3347597799 >> 172.21.15.1:0/3347597799 conn(0x562f731b1300 msgr2=0x562f7355e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 -- 172.21.15.1:0/3347597799 shutdown_connections 2024-08-28T20:20:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.164+0000 7f5f9b641740 1 -- 172.21.15.1:0/3347597799 wait complete. 2024-08-28T20:20:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.165+0000 7f5f9b641740 1 -- start start 2024-08-28T20:20:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.165+0000 7f5f9b641740 1 Processor -- start 2024-08-28T20:20:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f7356ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f7356d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f733feab0 con 0x562f731942f0 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f7346c320 con 0x562f731bd1b0 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f73564a40 con 0x562f7319c4d0 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.166+0000 7f5f9b641740 10 client.0 _ll_register_callbacks cb 0x562f734726a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.167+0000 7f5f91200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.167+0000 7f5f91200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44480/0 (socket says 172.21.15.1:44480) 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.167+0000 7f5f91200640 1 -- 172.21.15.1:0/1030466866 learned_addr learned my addr 172.21.15.1:0/1030466866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.167+0000 7f5f91200640 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f7356d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f91200640 1 -- 172.21.15.1:0/1030466866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 msgr2=0x562f7356ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:20:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f91200640 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f7356ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f91200640 1 -- 172.21.15.1:0/1030466866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 msgr2=0x562f7356c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f91200640 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f91200640 1 -- 172.21.15.1:0/1030466866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f73228790 con 0x562f731bd1b0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f91200640 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f7356d600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031fd0 tx=0x7f5f78000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1831aa01685a4367 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f73400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f73400640 1 -- 172.21.15.1:0/1030466866 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78045050 con 0x562f731bd1b0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f73400640 1 -- 172.21.15.1:0/1030466866 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5f7803d650 con 0x562f731bd1b0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.168+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78003dd0 con 0x562f731bd1b0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.169+0000 7f5f73400640 1 -- 172.21.15.1:0/1030466866 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f78035040 con 0x562f731bd1b0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.169+0000 7f5f9b641740 10 client.25403 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.169+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562f732a1620 con 0x562f731bd1b0 2024-08-28T20:20:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.169+0000 7f5f73400640 1 -- 172.21.15.1:0/1030466866 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f78003dd0 con 0x562f731bd1b0 2024-08-28T20:20:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.169+0000 7f5f73400640 1 -- 172.21.15.1:0/1030466866 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5f7804a7e0 con 0x562f731bd1b0 2024-08-28T20:20:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.170+0000 7f5f9b641740 10 client.25403 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.170+0000 7f5f9b641740 10 client.25403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.170+0000 7f5f9b641740 20 client.25403 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.170+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7317bd80 0x562f73581f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.170+0000 7f5f9b641740 4 client.25403 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:20:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.170+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f734d7ec0 con 0x562f7317bd80 2024-08-28T20:20:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.171+0000 7f5f91c00640 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7317bd80 0x562f73581f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.172+0000 7f5f91c00640 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7317bd80 0x562f73581f30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41165bc541951d3 server_cookie=e5167349b57facde in_seq=0 out_seq=0 2024-08-28T20:20:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.172+0000 7f5f73400640 10 client.25403 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.173+0000 7f5f73400640 1 -- 172.21.15.1:0/1030466866 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f734d7ec0 con 0x562f7317bd80 2024-08-28T20:20:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.173+0000 7f5f73400640 10 client.25403 handle_command_reply: tid=0 2024-08-28T20:20:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.173+0000 7f5f9b641740 1 client.25403 shutdown 2024-08-28T20:20:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.173+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 msgr2=0x562f7356d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.173+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f7356d600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031fd0 tx=0x7f5f78000bc0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 shutdown_connections 2024-08-28T20:20:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7317bd80 0x562f73581f30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f7356d600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f7356ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1030466866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 >> 172.21.15.1:0/1030466866 conn(0x562f731b1300 msgr2=0x562f7355ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f73400640 0 client.25403 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.174+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 shutdown_connections 2024-08-28T20:20:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.175+0000 7f5f9b641740 1 -- 172.21.15.1:0/1030466866 wait complete. 2024-08-28T20:20:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.175+0000 7f5f9b641740 20 client.25403 trim_cache size 0 max 16384 2024-08-28T20:20:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.202+0000 7f5f9b641740 1 Processor -- start 2024-08-28T20:20:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.202+0000 7f5f9b641740 1 -- start start 2024-08-28T20:20:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f73561cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73566f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f9b641740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c010dd0 con 0x562f731942f0 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f9b641740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c00e640 con 0x562f731bd1b0 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f9b641740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c00c490 con 0x562f7319c4d0 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f91200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f91200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44486/0 (socket says 172.21.15.1:44486) 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.203+0000 7f5f91200640 1 -- 172.21.15.1:0/1158848350 learned_addr learned my addr 172.21.15.1:0/1158848350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f73561cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 -- 172.21.15.1:0/1158848350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 msgr2=0x562f73566f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73566f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 -- 172.21.15.1:0/1158848350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 msgr2=0x562f7356bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 -- 172.21.15.1:0/1158848350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f73563840 con 0x562f7319c4d0 2024-08-28T20:20:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.204+0000 7f5f91c00640 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f73561cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f80000c00 tx=0x7f5f800046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a9957ea0863f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.205+0000 7f5f7e000640 1 -- 172.21.15.1:0/1158848350 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000f040 con 0x562f7319c4d0 2024-08-28T20:20:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.205+0000 7f5f7e000640 1 -- 172.21.15.1:0/1158848350 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f80009bf0 con 0x562f7319c4d0 2024-08-28T20:20:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.205+0000 7f5f7e000640 1 -- 172.21.15.1:0/1158848350 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8001bd10 con 0x562f7319c4d0 2024-08-28T20:20:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.206+0000 7f5f9b641740 1 -- 172.21.15.1:0/1158848350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 msgr2=0x562f73561cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.206+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f73561cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f80000c00 tx=0x7f5f800046e0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.207+0000 7f5f9b641740 1 -- 172.21.15.1:0/1158848350 shutdown_connections 2024-08-28T20:20:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.207+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73566f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.207+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7319c4d0 0x562f73561cb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.207+0000 7f5f9b641740 1 --2- 172.21.15.1:0/1158848350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f731942f0 0x562f7356bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.207+0000 7f5f9b641740 1 -- 172.21.15.1:0/1158848350 >> 172.21.15.1:0/1158848350 conn(0x562f731b1300 msgr2=0x562f7356b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.207+0000 7f5f9b641740 1 -- 172.21.15.1:0/1158848350 shutdown_connections 2024-08-28T20:20:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.208+0000 7f5f9b641740 1 -- 172.21.15.1:0/1158848350 wait complete. 2024-08-28T20:20:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.209+0000 7f5f9b641740 1 -- start start 2024-08-28T20:20:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.209+0000 7f5f9b641740 1 Processor -- start 2024-08-28T20:20:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f735741f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73572eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f91200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f735741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f91200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f735741f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33822/0 (socket says 172.21.15.1:33822) 2024-08-28T20:20:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f91200640 1 -- 172.21.15.1:0/2615454420 learned_addr learned my addr 172.21.15.1:0/2615454420 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73573410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c00cb00 con 0x562f7319c4d0 2024-08-28T20:20:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c00df70 con 0x562f731bd1b0 2024-08-28T20:20:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c00d1d0 con 0x562f731942f0 2024-08-28T20:20:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.211+0000 7f5f9b641740 10 client.0 _ll_register_callbacks cb 0x7f5f780316c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.212+0000 7f5f91c00640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73572eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.213+0000 7f5f91200640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73573410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.213+0000 7f5f91200640 1 -- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 msgr2=0x562f73573410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.213+0000 7f5f91200640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73573410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.213+0000 7f5f91200640 1 -- 172.21.15.1:0/2615454420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 msgr2=0x562f73572eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.213+0000 7f5f91200640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73572eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.213+0000 7f5f91200640 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f73573ba0 con 0x562f731942f0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f91200640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f735741f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f7804ada0 tx=0x7f5f78031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f8b31f4b8cde65d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f73400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f73400640 1 -- 172.21.15.1:0/2615454420 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7805c070 con 0x562f731942f0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f73400640 1 -- 172.21.15.1:0/2615454420 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5f7804a680 con 0x562f731942f0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f80009bf0 con 0x562f731942f0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f73400640 1 -- 172.21.15.1:0/2615454420 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f78045040 con 0x562f731942f0 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f9b641740 10 client.25384 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:34.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.214+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562f735ec960 con 0x562f731942f0 2024-08-28T20:20:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.215+0000 7f5f73400640 1 -- 172.21.15.1:0/2615454420 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f7804a880 con 0x562f731942f0 2024-08-28T20:20:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.217+0000 7f5f73400640 1 -- 172.21.15.1:0/2615454420 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5f7803c470 con 0x562f731942f0 2024-08-28T20:20:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.217+0000 7f5f9b641740 10 client.25384 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.217+0000 7f5f9b641740 10 client.25384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.217+0000 7f5f9b641740 20 client.25384 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.218+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f731511c0 0x562f735ef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.218+0000 7f5f9b641740 4 client.25384 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:20:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.218+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5f80009bf0 con 0x562f731511c0 2024-08-28T20:20:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.218+0000 7f5f91c00640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f731511c0 0x562f735ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.219+0000 7f5f91c00640 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f731511c0 0x562f735ef230 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec13272c0a989b02 server_cookie=c01363e0f1ba15e7 in_seq=0 out_seq=0 2024-08-28T20:20:34.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.219+0000 7f5f73400640 10 client.25384 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.233+0000 7f5f73400640 1 -- 172.21.15.1:0/2615454420 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5f80009bf0 con 0x562f731511c0 2024-08-28T20:20:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.233+0000 7f5f73400640 10 client.25384 handle_command_reply: tid=0 2024-08-28T20:20:34.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.233+0000 7f5f9b641740 1 client.25384 shutdown 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 msgr2=0x562f735741f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f735741f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f7804ada0 tx=0x7f5f78031400 comp rx=0 tx=0).stop 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 shutdown_connections 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f731511c0 0x562f735ef230 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7319c4d0 0x562f73572eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f731bd1b0 0x562f73573410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 --2- 172.21.15.1:0/2615454420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f731942f0 0x562f735741f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 >> 172.21.15.1:0/2615454420 conn(0x562f731b1300 msgr2=0x562f73566f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.234+0000 7f5f73400640 0 client.25384 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.235+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 shutdown_connections 2024-08-28T20:20:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.235+0000 7f5f9b641740 1 -- 172.21.15.1:0/2615454420 wait complete. 2024-08-28T20:20:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.235+0000 7f5f9b641740 20 client.25384 trim_cache size 0 max 16384 2024-08-28T20:20:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:20:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:20:34.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:20:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:20:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.236+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f740b4d60 msgr2=0x7f5f740b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.236+0000 7f5f94600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f740b4d60 0x7f5f740b7270 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f84013000 tx=0x7f5f84007040 comp rx=0 tx=0).stop 2024-08-28T20:20:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.236+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c19b110 msgr2=0x7f5f8c19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.236+0000 7f5f94600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c19b110 0x7f5f8c19b610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400be20 tx=0x7f5f8400bf10 comp rx=0 tx=0).stop 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 shutdown_connections 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f740b4d60 0x7f5f740b7270 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f8c19b110 0x7f5f8c19b610 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f8c103d80 0x7f5f8c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 --2- 172.21.15.1:0/676126708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f8c102360 0x7f5f8c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 >> 172.21.15.1:0/676126708 conn(0x7f5f8c0fdca0 msgr2=0x7f5f8c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.237+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 shutdown_connections 2024-08-28T20:20:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:34.238+0000 7f5f94600640 1 -- 172.21.15.1:0/676126708 wait complete. 2024-08-28T20:20:35.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:35 smithi001 ceph-mon[20984]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 900 op/s 2024-08-28T20:20:35.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:35 smithi121 ceph-mon[25248]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 900 op/s 2024-08-28T20:20:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:35 smithi007 ceph-mon[25357]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 900 op/s 2024-08-28T20:20:37.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:37 smithi001 ceph-mon[20984]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 798 op/s 2024-08-28T20:20:37.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:37 smithi121 ceph-mon[25248]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 798 op/s 2024-08-28T20:20:37.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:37 smithi007 ceph-mon[25357]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 798 op/s 2024-08-28T20:20:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 130.0 s, 3052.6 tps, lat 32.901 ms stddev 40.647 2024-08-28T20:20:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:39 smithi001 ceph-mon[20984]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.9 MiB/s wr, 693 op/s 2024-08-28T20:20:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:39 smithi121 ceph-mon[25248]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.9 MiB/s wr, 693 op/s 2024-08-28T20:20:39.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:39 smithi007 ceph-mon[25357]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.9 MiB/s wr, 693 op/s 2024-08-28T20:20:41.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:41 smithi001 ceph-mon[20984]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 818 op/s 2024-08-28T20:20:41.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:41 smithi121 ceph-mon[25248]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 818 op/s 2024-08-28T20:20:41.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:41 smithi007 ceph-mon[25357]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 818 op/s 2024-08-28T20:20:43.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:43 smithi001 ceph-mon[20984]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 801 op/s 2024-08-28T20:20:43.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:43 smithi121 ceph-mon[25248]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 801 op/s 2024-08-28T20:20:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 135.0 s, 3666.2 tps, lat 27.305 ms stddev 31.290 2024-08-28T20:20:43.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:43 smithi007 ceph-mon[25357]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 801 op/s 2024-08-28T20:20:45.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:45 smithi001 ceph-mon[20984]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-08-28T20:20:45.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:45 smithi121 ceph-mon[25248]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-08-28T20:20:45.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:45 smithi007 ceph-mon[25357]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-08-28T20:20:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.536+0000 7fae05e00640 1 -- 172.21.15.1:0/3115723328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 msgr2=0x7fae0010b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.536+0000 7fae05e00640 1 --2- 172.21.15.1:0/3115723328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0010b4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009be0 tx=0x7fadf802a6c0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.538+0000 7fae05e00640 1 -- 172.21.15.1:0/3115723328 shutdown_connections 2024-08-28T20:20:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.538+0000 7fae05e00640 1 --2- 172.21.15.1:0/3115723328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0010b4b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.538+0000 7fae05e00640 1 --2- 172.21.15.1:0/3115723328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae001064b0 0x7fae001088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.538+0000 7fae05e00640 1 --2- 172.21.15.1:0/3115723328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae0006b560 0x7fae00105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.538+0000 7fae05e00640 1 -- 172.21.15.1:0/3115723328 >> 172.21.15.1:0/3115723328 conn(0x7fae000fdab0 msgr2=0x7fae000fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.539+0000 7fae05e00640 1 -- 172.21.15.1:0/3115723328 shutdown_connections 2024-08-28T20:20:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.539+0000 7fae05e00640 1 -- 172.21.15.1:0/3115723328 wait complete. 2024-08-28T20:20:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.540+0000 7fae05e00640 1 Processor -- start 2024-08-28T20:20:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.540+0000 7fae05e00640 1 -- start start 2024-08-28T20:20:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae05e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 0x7fae0019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae05e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae001064b0 0x7fae0019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae05e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae05e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae0010eec0 con 0x7fae00108fc0 2024-08-28T20:20:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae05e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae0010ed40 con 0x7fae001064b0 2024-08-28T20:20:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae05e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae0010f040 con 0x7fae0006b560 2024-08-28T20:20:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae04a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 0x7fae0019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae04a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 0x7fae0019bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39594/0 (socket says 172.21.15.1:39594) 2024-08-28T20:20:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.541+0000 7fae04a00640 1 -- 172.21.15.1:0/3463484283 learned_addr learned my addr 172.21.15.1:0/3463484283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.542+0000 7fadffe00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae001064b0 0x7fae0019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.542+0000 7fae05400640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.542+0000 7fae04a00640 1 -- 172.21.15.1:0/3463484283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae001064b0 msgr2=0x7fae0019c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.542+0000 7fae04a00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae001064b0 0x7fae0019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.542+0000 7fae04a00640 1 -- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 msgr2=0x7fae0019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.543+0000 7fae04a00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.543+0000 7fae04a00640 1 -- 172.21.15.1:0/3463484283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0019d710 con 0x7fae0006b560 2024-08-28T20:20:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.543+0000 7fae05400640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:20:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.543+0000 7fae04a00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 0x7fae0019bcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadf000e9c0 tx=0x7fadf000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.544+0000 7fadfd600640 1 -- 172.21.15.1:0/3463484283 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf000cd60 con 0x7fae0006b560 2024-08-28T20:20:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.544+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0019da00 con 0x7fae0006b560 2024-08-28T20:20:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.544+0000 7fadfd600640 1 -- 172.21.15.1:0/3463484283 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf00035f0 con 0x7fae0006b560 2024-08-28T20:20:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.544+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae001a40f0 con 0x7fae0006b560 2024-08-28T20:20:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.544+0000 7fadfd600640 1 -- 172.21.15.1:0/3463484283 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0010670 con 0x7fae0006b560 2024-08-28T20:20:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.549+0000 7fadfd600640 1 -- 172.21.15.1:0/3463484283 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fadf0010810 con 0x7fae0006b560 2024-08-28T20:20:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.554+0000 7fadfd600640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fade40b4c70 0x7fade40b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.555+0000 7fae0e4c2740 1 Processor -- start 2024-08-28T20:20:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.555+0000 7fadfd600640 1 -- 172.21.15.1:0/3463484283 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fadf00e6330 con 0x7fae0006b560 2024-08-28T20:20:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.555+0000 7fadffe00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fade40b4c70 0x7fade40b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.555+0000 7fae0e4c2740 1 -- start start 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a7887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a788e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a789970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562a4a6f2f70 con 0x562a4a3b12f0 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562a4a6e2500 con 0x562a4a3da1b0 2024-08-28T20:20:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562a4a6e64b0 con 0x562a4a3b94d0 2024-08-28T20:20:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae04a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a7887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fadffe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a788e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.556+0000 7fae04a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a7887b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47792/0 (socket says 172.21.15.1:47792) 2024-08-28T20:20:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae04a00640 1 -- 172.21.15.1:0/2506554308 learned_addr learned my addr 172.21.15.1:0/2506554308 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae05400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a789970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae04a00640 1 -- 172.21.15.1:0/2506554308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 msgr2=0x562a4a789970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae04a00640 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a789970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae04a00640 1 -- 172.21.15.1:0/2506554308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 msgr2=0x562a4a788e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae04a00640 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a788e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fae04a00640 1 -- 172.21.15.1:0/2506554308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4a69cc10 con 0x562a4a3da1b0 2024-08-28T20:20:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.557+0000 7fadffe00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fade40b4c70 0x7fade40b7180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fade8005fd0 tx=0x7fade8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.558+0000 7fae04a00640 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a7887b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadf0003e20 tx=0x7fadf00ac460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9de2f329460af3fe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.559+0000 7fadf5c00640 1 -- 172.21.15.1:0/2506554308 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00accf0 con 0x562a4a3da1b0 2024-08-28T20:20:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.559+0000 7fadf5c00640 1 -- 172.21.15.1:0/2506554308 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf00b1560 con 0x562a4a3da1b0 2024-08-28T20:20:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.559+0000 7fadf5c00640 1 -- 172.21.15.1:0/2506554308 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00accf0 con 0x562a4a3da1b0 2024-08-28T20:20:47.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.560+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2506554308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 msgr2=0x562a4a7887b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.560+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a7887b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadf0003e20 tx=0x7fadf00ac460 comp rx=0 tx=0).stop 2024-08-28T20:20:47.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2506554308 shutdown_connections 2024-08-28T20:20:47.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a788e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a789970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2506554308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a7887b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2506554308 >> 172.21.15.1:0/2506554308 conn(0x562a4a3ce300 msgr2=0x562a4a784240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2506554308 shutdown_connections 2024-08-28T20:20:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.561+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2506554308 wait complete. 2024-08-28T20:20:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.563+0000 7fae0e4c2740 1 -- start start 2024-08-28T20:20:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.563+0000 7fae0e4c2740 1 Processor -- start 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.564+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 0x562a4a791e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.564+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.564+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3da1b0 0x562a4a793060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.564+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562a4a61bab0 con 0x562a4a3da1b0 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.564+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562a4a689320 con 0x562a4a3b12f0 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.564+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562a4a78a430 con 0x562a4a3b94d0 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae0e4c2740 10 client.0 _ll_register_callbacks cb 0x562a4a68f6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 0x562a4a791e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 0x562a4a791e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47808/0 (socket says 172.21.15.1:47808) 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 -- 172.21.15.1:0/2542685086 learned_addr learned my addr 172.21.15.1:0/2542685086 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae05400640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3da1b0 0x562a4a793060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fadffe00640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 -- 172.21.15.1:0/2542685086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 msgr2=0x562a4a7924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 -- 172.21.15.1:0/2542685086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3da1b0 msgr2=0x562a4a793060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3da1b0 0x562a4a793060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.565+0000 7fae04a00640 1 -- 172.21.15.1:0/2542685086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4a445790 con 0x562a4a3b12f0 2024-08-28T20:20:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.566+0000 7fae04a00640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 0x562a4a791e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fadf00a8d20 tx=0x7fadf00b1470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907726af3b3f1b50 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.567+0000 7fadee000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:20:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.567+0000 7fadee000640 1 -- 172.21.15.1:0/2542685086 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00b6010 con 0x562a4a3b12f0 2024-08-28T20:20:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.567+0000 7fadee000640 1 -- 172.21.15.1:0/2542685086 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fadf0092b30 con 0x562a4a3b12f0 2024-08-28T20:20:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.568+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf00b1560 con 0x562a4a3b12f0 2024-08-28T20:20:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.568+0000 7fadee000640 1 -- 172.21.15.1:0/2542685086 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fadf00accf0 con 0x562a4a3b12f0 2024-08-28T20:20:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.568+0000 7fae0e4c2740 10 client.25415 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.568+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562a4a4be620 con 0x562a4a3b12f0 2024-08-28T20:20:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fadee000640 1 -- 172.21.15.1:0/2542685086 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf00b1560 con 0x562a4a3b12f0 2024-08-28T20:20:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fadee000640 1 -- 172.21.15.1:0/2542685086 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fadf00a8660 con 0x562a4a3b12f0 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fae0e4c2740 10 client.25415 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fae0e4c2740 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fae0e4c2740 20 client.25415 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a398d80 0x562a4a79f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fae0e4c2740 4 client.25415 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.569+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a4a6f4ec0 con 0x562a4a398d80 2024-08-28T20:20:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.570+0000 7fadffe00640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a398d80 0x562a4a79f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.571+0000 7fadffe00640 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a398d80 0x562a4a79f140 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f424324818352d60 server_cookie=e1be898841781301 in_seq=0 out_seq=0 2024-08-28T20:20:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.571+0000 7fadee000640 10 client.25415 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.572+0000 7fadee000640 1 -- 172.21.15.1:0/2542685086 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a4a6f4ec0 con 0x562a4a398d80 2024-08-28T20:20:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.572+0000 7fadee000640 10 client.25415 handle_command_reply: tid=0 2024-08-28T20:20:47.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.572+0000 7fae0e4c2740 1 client.25415 shutdown 2024-08-28T20:20:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.573+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 msgr2=0x562a4a791e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.573+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 0x562a4a791e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fadf00a8d20 tx=0x7fadf00b1470 comp rx=0 tx=0).stop 2024-08-28T20:20:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 shutdown_connections 2024-08-28T20:20:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a398d80 0x562a4a79f140 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3da1b0 0x562a4a793060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2542685086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b12f0 0x562a4a791e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 >> 172.21.15.1:0/2542685086 conn(0x562a4a3ce300 msgr2=0x562a4a779f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fadee000640 0 client.25415 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 shutdown_connections 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2542685086 wait complete. 2024-08-28T20:20:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.574+0000 7fae0e4c2740 20 client.25415 trim_cache size 0 max 16384 2024-08-28T20:20:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.614+0000 7fae0e4c2740 1 Processor -- start 2024-08-28T20:20:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.615+0000 7fae0e4c2740 1 -- start start 2024-08-28T20:20:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.616+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a78c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.616+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b94d0 0x562a4a78ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.616+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 0x562a4a78d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.616+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae001ab2a0 con 0x562a4a3b12f0 2024-08-28T20:20:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.616+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae001a8b10 con 0x562a4a3b94d0 2024-08-28T20:20:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.616+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae001a6980 con 0x562a4a3da1b0 2024-08-28T20:20:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.617+0000 7fae05400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 0x562a4a78d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.617+0000 7fae05400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 0x562a4a78d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39620/0 (socket says 172.21.15.1:39620) 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.617+0000 7fae05400640 1 -- 172.21.15.1:0/2465253789 learned_addr learned my addr 172.21.15.1:0/2465253789 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.617+0000 7fae04a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a78c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fadffe00640 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b94d0 0x562a4a78ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fae05400640 1 -- 172.21.15.1:0/2465253789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b94d0 msgr2=0x562a4a78ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fae05400640 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b94d0 0x562a4a78ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fae05400640 1 -- 172.21.15.1:0/2465253789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 msgr2=0x562a4a78c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fae05400640 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a78c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fae05400640 1 -- 172.21.15.1:0/2465253789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4a788c40 con 0x562a4a3da1b0 2024-08-28T20:20:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fadffe00640 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b94d0 0x562a4a78ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:20:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.618+0000 7fae05400640 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 0x562a4a78d340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadf8033000 tx=0x7fadf8030d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0246dc42edbccf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.620+0000 7fadf5200640 1 -- 172.21.15.1:0/2465253789 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8036040 con 0x562a4a3da1b0 2024-08-28T20:20:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.620+0000 7fadf5200640 1 -- 172.21.15.1:0/2465253789 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf8003b70 con 0x562a4a3da1b0 2024-08-28T20:20:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.620+0000 7fadf5200640 1 -- 172.21.15.1:0/2465253789 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf803f6b0 con 0x562a4a3da1b0 2024-08-28T20:20:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.621+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2465253789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 msgr2=0x562a4a78d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.621+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 0x562a4a78d340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadf8033000 tx=0x7fadf8030d40 comp rx=0 tx=0).stop 2024-08-28T20:20:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2465253789 shutdown_connections 2024-08-28T20:20:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3da1b0 0x562a4a78d340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3b94d0 0x562a4a78ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2465253789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a78c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2465253789 >> 172.21.15.1:0/2465253789 conn(0x562a4a3ce300 msgr2=0x562a4a7903c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2465253789 shutdown_connections 2024-08-28T20:20:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.623+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2465253789 wait complete. 2024-08-28T20:20:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.624+0000 7fae0e4c2740 1 -- start start 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.626+0000 7fae0e4c2740 1 Processor -- start 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a799c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a798e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae001a6fd0 con 0x562a4a3b12f0 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae001a8440 con 0x562a4a3da1b0 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae001a76a0 con 0x562a4a3b94d0 2024-08-28T20:20:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.627+0000 7fae0e4c2740 10 client.0 _ll_register_callbacks cb 0x7fadf00ad4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:20:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.628+0000 7fadffe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.628+0000 7fadffe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39632/0 (socket says 172.21.15.1:39632) 2024-08-28T20:20:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.628+0000 7fadffe00640 1 -- 172.21.15.1:0/2245195111 learned_addr learned my addr 172.21.15.1:0/2245195111 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:20:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.628+0000 7fae05400640 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a798e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.629+0000 7fadffe00640 1 -- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 msgr2=0x562a4a798e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.629+0000 7fadffe00640 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a798e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.629+0000 7fadffe00640 1 -- 172.21.15.1:0/2245195111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 msgr2=0x562a4a799c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:20:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.629+0000 7fadffe00640 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a799c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.629+0000 7fadffe00640 1 -- 172.21.15.1:0/2245195111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4a799570 con 0x562a4a3b94d0 2024-08-28T20:20:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.629+0000 7fadffe00640 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7988c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fade800ef30 tx=0x7fade801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c634987a3554f17 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:20:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.630+0000 7fadee000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:20:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.630+0000 7fadee000640 1 -- 172.21.15.1:0/2245195111 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade802e060 con 0x562a4a3b94d0 2024-08-28T20:20:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.630+0000 7fadee000640 1 -- 172.21.15.1:0/2245195111 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fade8004cc0 con 0x562a4a3b94d0 2024-08-28T20:20:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.630+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf8003b70 con 0x562a4a3b94d0 2024-08-28T20:20:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.631+0000 7fadee000640 1 -- 172.21.15.1:0/2245195111 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fade8011470 con 0x562a4a3b94d0 2024-08-28T20:20:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.631+0000 7fae0e4c2740 10 client.25402 fetch_fsmap learned FSMap version 30 2024-08-28T20:20:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.631+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562a4a81aa00 con 0x562a4a3b94d0 2024-08-28T20:20:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.631+0000 7fadee000640 1 -- 172.21.15.1:0/2245195111 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf8003b70 con 0x562a4a3b94d0 2024-08-28T20:20:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.632+0000 7fadee000640 1 -- 172.21.15.1:0/2245195111 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fade800f040 con 0x562a4a3b94d0 2024-08-28T20:20:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.632+0000 7fae0e4c2740 10 client.25402 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:20:47.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.632+0000 7fae0e4c2740 10 client.25402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:20:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.632+0000 7fae0e4c2740 20 client.25402 populate_metadata read hostname 'smithi001' 2024-08-28T20:20:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.632+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a36e1c0 0x562a4a81d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:20:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.632+0000 7fae0e4c2740 4 client.25402 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:20:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.633+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a4a6f0960 con 0x562a4a36e1c0 2024-08-28T20:20:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.633+0000 7fae04a00640 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a36e1c0 0x562a4a81d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:20:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.635+0000 7fadee000640 10 client.25402 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.635+0000 7fae04a00640 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a36e1c0 0x562a4a81d210 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49c1e5c10a9f7f0b server_cookie=ada7015727f8a776 in_seq=0 out_seq=0 2024-08-28T20:20:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fadee000640 1 -- 172.21.15.1:0/2245195111 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a4a6f0960 con 0x562a4a36e1c0 2024-08-28T20:20:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fadee000640 10 client.25402 handle_command_reply: tid=0 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 client.25402 shutdown 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 msgr2=0x562a4a7988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7988c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fade800ef30 tx=0x7fade801b000 comp rx=0 tx=0).stop 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 shutdown_connections 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562a4a36e1c0 0x562a4a81d210 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a4a3da1b0 0x562a4a798e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562a4a3b94d0 0x562a4a7988c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 --2- 172.21.15.1:0/2245195111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a4a3b12f0 0x562a4a799c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 >> 172.21.15.1:0/2245195111 conn(0x562a4a3ce300 msgr2=0x562a4a78c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fadee000640 0 client.25402 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:20:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 shutdown_connections 2024-08-28T20:20:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.649+0000 7fae0e4c2740 1 -- 172.21.15.1:0/2245195111 wait complete. 2024-08-28T20:20:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.650+0000 7fae0e4c2740 20 client.25402 trim_cache size 0 max 16384 2024-08-28T20:20:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:20:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:20:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:20:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fade40b4c70 msgr2=0x7fade40b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fade40b4c70 0x7fade40b7180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fade8005fd0 tx=0x7fade8005850 comp rx=0 tx=0).stop 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 msgr2=0x7fae0019bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 0x7fae0019bcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadf000e9c0 tx=0x7fadf000ee80 comp rx=0 tx=0).stop 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 shutdown_connections 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fade40b4c70 0x7fade40b7180 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae00108fc0 0x7fae0019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae001064b0 0x7fae0019c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 --2- 172.21.15.1:0/3463484283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae0006b560 0x7fae0019bcd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:20:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.652+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 >> 172.21.15.1:0/3463484283 conn(0x7fae000fdab0 msgr2=0x7fae000ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:20:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.653+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 shutdown_connections 2024-08-28T20:20:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:20:47.653+0000 7fae05e00640 1 -- 172.21.15.1:0/3463484283 wait complete. 2024-08-28T20:20:47.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:47 smithi001 ceph-mon[20984]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 766 op/s 2024-08-28T20:20:47.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:47 smithi121 ceph-mon[25248]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 766 op/s 2024-08-28T20:20:47.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:47 smithi007 ceph-mon[25357]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 766 op/s 2024-08-28T20:20:48.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 140.0 s, 2913.9 tps, lat 34.138 ms stddev 42.478 2024-08-28T20:20:49.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:49 smithi001 ceph-mon[20984]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 759 op/s 2024-08-28T20:20:49.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:49 smithi121 ceph-mon[25248]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 759 op/s 2024-08-28T20:20:49.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:49 smithi007 ceph-mon[25357]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 759 op/s 2024-08-28T20:20:51.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:51 smithi001 ceph-mon[20984]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-08-28T20:20:51.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:51 smithi121 ceph-mon[25248]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-08-28T20:20:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:51 smithi007 ceph-mon[25357]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 11 MiB/s wr, 841 op/s 2024-08-28T20:20:53.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:53 smithi001 ceph-mon[20984]: pgmap v448: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 744 op/s 2024-08-28T20:20:53.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:53 smithi121 ceph-mon[25248]: pgmap v448: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 744 op/s 2024-08-28T20:20:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 145.0 s, 3703.1 tps, lat 27.065 ms stddev 32.303 2024-08-28T20:20:53.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:53 smithi007 ceph-mon[25357]: pgmap v448: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 744 op/s 2024-08-28T20:20:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:55 smithi001 ceph-mon[20984]: pgmap v449: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 828 op/s 2024-08-28T20:20:55.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:55 smithi121 ceph-mon[25248]: pgmap v449: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 828 op/s 2024-08-28T20:20:55.814 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:55 smithi007 ceph-mon[25357]: pgmap v449: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 828 op/s 2024-08-28T20:20:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:57 smithi121 ceph-mon[25248]: pgmap v450: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 851 op/s 2024-08-28T20:20:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:57 smithi007 ceph-mon[25357]: pgmap v450: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 851 op/s 2024-08-28T20:20:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:57 smithi001 ceph-mon[20984]: pgmap v450: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 851 op/s 2024-08-28T20:20:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 150.0 s, 4159.2 tps, lat 23.901 ms stddev 25.412 2024-08-28T20:20:59.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:20:59 smithi007 ceph-mon[25357]: pgmap v451: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 731 op/s 2024-08-28T20:20:59.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:20:59 smithi001 ceph-mon[20984]: pgmap v451: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 731 op/s 2024-08-28T20:20:59.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:20:59 smithi121 ceph-mon[25248]: pgmap v451: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 731 op/s 2024-08-28T20:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1998990646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c10b3a0 msgr2=0x7fc39c10d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1998990646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c10b3a0 0x7fc39c10d8b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc394009ca0 tx=0x7fc39402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1998990646 shutdown_connections 2024-08-28T20:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1998990646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c10b3a0 0x7fc39c10d8b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1998990646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc39c108a40 0x7fc39c10ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1998990646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c06b3f0 0x7fc39c108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1998990646 >> 172.21.15.1:0/1998990646 conn(0x7fc39c0fdca0 msgr2=0x7fc39c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1998990646 shutdown_connections 2024-08-28T20:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.959+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1998990646 wait complete. 2024-08-28T20:21:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 Processor -- start 2024-08-28T20:21:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 -- start start 2024-08-28T20:21:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 0x7fc39c19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c108a40 0x7fc39c19c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc39c10b3a0 0x7fc39c19d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1112e0 con 0x7fc39c108a40 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c111160 con 0x7fc39c10b3a0 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.961+0000 7fc3a0c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c111460 con 0x7fc39c06b3f0 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc399e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 0x7fc39c19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc399e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 0x7fc39c19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:48046/0 (socket says 172.21.15.1:48046) 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc399e00640 1 -- 172.21.15.1:0/1721439600 learned_addr learned my addr 172.21.15.1:0/1721439600 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc39a800640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc39c10b3a0 0x7fc39c19d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc399400640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c108a40 0x7fc39c19c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc399e00640 1 -- 172.21.15.1:0/1721439600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc39c10b3a0 msgr2=0x7fc39c19d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.962+0000 7fc399e00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc39c10b3a0 0x7fc39c19d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.963+0000 7fc399e00640 1 -- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c108a40 msgr2=0x7fc39c19c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.963+0000 7fc399e00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c108a40 0x7fc39c19c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.963+0000 7fc399e00640 1 -- 172.21.15.1:0/1721439600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c19d8c0 con 0x7fc39c06b3f0 2024-08-28T20:21:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.964+0000 7fc399e00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 0x7fc39c19be80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00d950 tx=0x7fc38c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.965+0000 7fc392a00640 1 -- 172.21.15.1:0/1721439600 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c017070 con 0x7fc39c06b3f0 2024-08-28T20:21:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.965+0000 7fc392a00640 1 -- 172.21.15.1:0/1721439600 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c009c30 con 0x7fc39c06b3f0 2024-08-28T20:21:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.965+0000 7fc392a00640 1 -- 172.21.15.1:0/1721439600 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00f620 con 0x7fc39c06b3f0 2024-08-28T20:21:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.965+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c19dbb0 con 0x7fc39c06b3f0 2024-08-28T20:21:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.965+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1a42a0 con 0x7fc39c06b3f0 2024-08-28T20:21:00.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.973+0000 7fc3a7c6b740 1 Processor -- start 2024-08-28T20:21:00.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.973+0000 7fc3a7c6b740 1 -- start start 2024-08-28T20:21:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.973+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806216bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x55806216c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061da54d0 0x55806216ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5580620def70 con 0x558061dc61b0 2024-08-28T20:21:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5580620ce500 con 0x558061da54d0 2024-08-28T20:21:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5580620d24b0 con 0x558061d9d2f0 2024-08-28T20:21:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc39a800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806216bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc39a800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806216bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50056/0 (socket says 172.21.15.1:50056) 2024-08-28T20:21:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.974+0000 7fc39a800640 1 -- 172.21.15.1:0/607441541 learned_addr learned my addr 172.21.15.1:0/607441541 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.975+0000 7fc399400640 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061da54d0 0x55806216ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.976+0000 7fc39a800640 1 -- 172.21.15.1:0/607441541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 msgr2=0x55806216c1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:21:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.976+0000 7fc39a800640 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x55806216c1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.976+0000 7fc39a800640 1 -- 172.21.15.1:0/607441541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061da54d0 msgr2=0x55806216ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.976+0000 7fc39a800640 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061da54d0 0x55806216ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.976+0000 7fc39a800640 1 -- 172.21.15.1:0/607441541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558062088c10 con 0x558061dc61b0 2024-08-28T20:21:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.977+0000 7fc392a00640 1 -- 172.21.15.1:0/1721439600 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fc38c010460 con 0x7fc39c06b3f0 2024-08-28T20:21:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.977+0000 7fc39a800640 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806216bb30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc394035000 tx=0x7fc39402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd6276b6a172fb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.978+0000 7fc387000640 1 -- 172.21.15.1:0/607441541 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394031650 con 0x558061dc61b0 2024-08-28T20:21:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.978+0000 7fc387000640 1 -- 172.21.15.1:0/607441541 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc394036030 con 0x558061dc61b0 2024-08-28T20:21:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.978+0000 7fc387000640 1 -- 172.21.15.1:0/607441541 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394004790 con 0x558061dc61b0 2024-08-28T20:21:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.980+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/607441541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 msgr2=0x55806216bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.980+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806216bb30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc394035000 tx=0x7fc39402f450 comp rx=0 tx=0).stop 2024-08-28T20:21:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.981+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/607441541 shutdown_connections 2024-08-28T20:21:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.981+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061da54d0 0x55806216ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.981+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x55806216c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.981+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/607441541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806216bb30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.981+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/607441541 >> 172.21.15.1:0/607441541 conn(0x558061dba300 msgr2=0x5580621675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.983+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/607441541 shutdown_connections 2024-08-28T20:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.983+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/607441541 wait complete. 2024-08-28T20:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.983+0000 7fc392a00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3800b4b40 0x7fc3800b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.984+0000 7fc3a7c6b740 1 -- start start 2024-08-28T20:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.984+0000 7fc3a7c6b740 1 Processor -- start 2024-08-28T20:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.985+0000 7fc392a00640 1 -- 172.21.15.1:0/1721439600 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc38c0e4cc0 con 0x7fc39c06b3f0 2024-08-28T20:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.985+0000 7fc39a800640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3800b4b40 0x7fc3800b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc39a800640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3800b4b40 0x7fc3800b7050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc394004270 tx=0x7fc394005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 0x55806217d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061da54d0 0x55806217df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806217ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558062007ab0 con 0x558061dc61b0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558062075320 con 0x558061d9d2f0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55806216d630 con 0x558061da54d0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.986+0000 7fc3a7c6b740 10 client.0 _ll_register_callbacks cb 0x5580620aee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 0x55806217d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 0x55806217d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:46084/0 (socket says 172.21.15.1:46084) 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 -- 172.21.15.1:0/51807486 learned_addr learned my addr 172.21.15.1:0/51807486 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399400640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061da54d0 0x55806217df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc39a800640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806217ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 -- 172.21.15.1:0/51807486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061da54d0 msgr2=0x55806217df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061da54d0 0x55806217df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 -- 172.21.15.1:0/51807486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 msgr2=0x55806217ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806217ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc399e00640 1 -- 172.21.15.1:0/51807486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558061e31790 con 0x558061d9d2f0 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.987+0000 7fc39a800640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806217ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.988+0000 7fc399e00640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 0x55806217d8a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0a89a0 tx=0x7fc38c0aaf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b02c52a19e7200 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.988+0000 7fc37b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.988+0000 7fc37b400640 1 -- 172.21.15.1:0/51807486 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c020040 con 0x558061d9d2f0 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.988+0000 7fc37b400640 1 -- 172.21.15.1:0/51807486 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc38c0aa990 con 0x558061d9d2f0 2024-08-28T20:21:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.988+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc394036030 con 0x558061d9d2f0 2024-08-28T20:21:00.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.989+0000 7fc37b400640 1 -- 172.21.15.1:0/51807486 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc38c009de0 con 0x558061d9d2f0 2024-08-28T20:21:00.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.989+0000 7fc3a7c6b740 10 client.25430 fetch_fsmap learned FSMap version 30 2024-08-28T20:21:00.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.989+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558061eaa620 con 0x558061d9d2f0 2024-08-28T20:21:00.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.990+0000 7fc37b400640 1 -- 172.21.15.1:0/51807486 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc394036030 con 0x558061d9d2f0 2024-08-28T20:21:00.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.990+0000 7fc37b400640 1 -- 172.21.15.1:0/51807486 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc38c0d21a0 con 0x558061d9d2f0 2024-08-28T20:21:00.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc3a7c6b740 10 client.25430 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc3a7c6b740 10 client.25430 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc3a7c6b740 20 client.25430 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061d84d80 0x55806218aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc3a7c6b740 4 client.25430 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580620e0ec0 con 0x558061d84d80 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.991+0000 7fc399400640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061d84d80 0x55806218aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.992+0000 7fc399400640 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061d84d80 0x55806218aff0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e0a784bcab90b8 server_cookie=189bfd27efa30075 in_seq=0 out_seq=0 2024-08-28T20:21:00.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.992+0000 7fc37b400640 10 client.25430 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.993+0000 7fc37b400640 1 -- 172.21.15.1:0/51807486 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580620e0ec0 con 0x558061d84d80 2024-08-28T20:21:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.993+0000 7fc37b400640 10 client.25430 handle_command_reply: tid=0 2024-08-28T20:21:00.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.993+0000 7fc3a7c6b740 1 client.25430 shutdown 2024-08-28T20:21:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 msgr2=0x55806217d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 0x55806217d8a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0a89a0 tx=0x7fc38c0aaf60 comp rx=0 tx=0).stop 2024-08-28T20:21:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 shutdown_connections 2024-08-28T20:21:00.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061d84d80 0x55806218aff0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061dc61b0 0x55806217ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061da54d0 0x55806217df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc37b400640 0 client.25430 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/51807486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d9d2f0 0x55806217d8a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.994+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 >> 172.21.15.1:0/51807486 conn(0x558061dba300 msgr2=0x558062165b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.995+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 shutdown_connections 2024-08-28T20:21:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.995+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/51807486 wait complete. 2024-08-28T20:21:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:00.995+0000 7fc3a7c6b740 20 client.25430 trim_cache size 0 max 16384 2024-08-28T20:21:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.033+0000 7fc3a7c6b740 1 Processor -- start 2024-08-28T20:21:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 -- start start 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x558062178ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062165b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 0x558062166060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1ab460 con 0x558061da54d0 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1a8cd0 con 0x558061d84d80 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.034+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1a6b20 con 0x558061d9d2f0 2024-08-28T20:21:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.035+0000 7fc399400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062165b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.035+0000 7fc399400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062165b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:48062/0 (socket says 172.21.15.1:48062) 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.035+0000 7fc399400640 1 -- 172.21.15.1:0/753115592 learned_addr learned my addr 172.21.15.1:0/753115592 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.035+0000 7fc399e00640 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x558062178ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.036+0000 7fc399e00640 1 -- 172.21.15.1:0/753115592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 msgr2=0x558062165b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.036+0000 7fc399e00640 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062165b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.036+0000 7fc399e00640 1 -- 172.21.15.1:0/753115592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 msgr2=0x558062166060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.036+0000 7fc399e00640 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 0x558062166060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.036+0000 7fc399e00640 1 -- 172.21.15.1:0/753115592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55806218b560 con 0x558061d84d80 2024-08-28T20:21:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.036+0000 7fc399e00640 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x558062178ba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0a7760 tx=0x7fc38c0aafd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba0414d45bd98eec server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.037+0000 7fc386600640 1 -- 172.21.15.1:0/753115592 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c020030 con 0x558061d84d80 2024-08-28T20:21:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.037+0000 7fc386600640 1 -- 172.21.15.1:0/753115592 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c05b040 con 0x558061d84d80 2024-08-28T20:21:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.037+0000 7fc386600640 1 -- 172.21.15.1:0/753115592 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c020030 con 0x558061d84d80 2024-08-28T20:21:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/753115592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 msgr2=0x558062178ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x558062178ba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0a7760 tx=0x7fc38c0aafd0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/753115592 shutdown_connections 2024-08-28T20:21:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 0x558062166060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062165b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/753115592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x558062178ba0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.039+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/753115592 >> 172.21.15.1:0/753115592 conn(0x558061dba300 msgr2=0x558062178490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.040+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/753115592 shutdown_connections 2024-08-28T20:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.040+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/753115592 wait complete. 2024-08-28T20:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.041+0000 7fc3a7c6b740 1 -- start start 2024-08-28T20:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.042+0000 7fc3a7c6b740 1 Processor -- start 2024-08-28T20:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x5580621f3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062183a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 0x558062183fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1a7190 con 0x558061da54d0 2024-08-28T20:21:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1a8600 con 0x558061d84d80 2024-08-28T20:21:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1a7860 con 0x558061d9d2f0 2024-08-28T20:21:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.043+0000 7fc3a7c6b740 10 client.0 _ll_register_callbacks cb 0x7fc38c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x5580621f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x5580621f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:46104/0 (socket says 172.21.15.1:46104) 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399e00640 1 -- 172.21.15.1:0/2168166625 learned_addr learned my addr 172.21.15.1:0/2168166625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399e00640 1 -- 172.21.15.1:0/2168166625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 msgr2=0x558062183a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399400640 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062183a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399e00640 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062183a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.044+0000 7fc399e00640 1 -- 172.21.15.1:0/2168166625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 msgr2=0x558062183fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:21:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.045+0000 7fc399e00640 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 0x558062183fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.045+0000 7fc399e00640 1 -- 172.21.15.1:0/2168166625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558062185d70 con 0x558061d84d80 2024-08-28T20:21:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.046+0000 7fc399e00640 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x5580621f3160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0107a0 tx=0x7fc38c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20be80d572fee174 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.046+0000 7fc37b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:21:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.047+0000 7fc37b400640 1 -- 172.21.15.1:0/2168166625 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0c4030 con 0x558061d84d80 2024-08-28T20:21:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.047+0000 7fc37b400640 1 -- 172.21.15.1:0/2168166625 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc38c0a7d20 con 0x558061d84d80 2024-08-28T20:21:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.048+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc38c05b040 con 0x558061d84d80 2024-08-28T20:21:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.049+0000 7fc37b400640 1 -- 172.21.15.1:0/2168166625 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc38c020070 con 0x558061d84d80 2024-08-28T20:21:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.049+0000 7fc3a7c6b740 10 client.25436 fetch_fsmap learned FSMap version 30 2024-08-28T20:21:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.049+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558062185810 con 0x558061d84d80 2024-08-28T20:21:01.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.050+0000 7fc37b400640 1 -- 172.21.15.1:0/2168166625 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc38c05b040 con 0x558061d84d80 2024-08-28T20:21:01.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.050+0000 7fc37b400640 1 -- 172.21.15.1:0/2168166625 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc38c0a72a0 con 0x558061d84d80 2024-08-28T20:21:01.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.050+0000 7fc3a7c6b740 10 client.25436 fetch_fsmap finished waiting for FSMap version 30 2024-08-28T20:21:01.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.050+0000 7fc3a7c6b740 10 client.25436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:01.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.050+0000 7fc3a7c6b740 20 client.25436 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:01.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.051+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061dc61b0 0x558062208f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:01.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.051+0000 7fc3a7c6b740 4 client.25436 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:21:01.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.051+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580620dc960 con 0x558061dc61b0 2024-08-28T20:21:01.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.051+0000 7fc399400640 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061dc61b0 0x558062208f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.053+0000 7fc399400640 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061dc61b0 0x558062208f40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6e0da940cdc4745 server_cookie=e4dc9b6b0b506ad2 in_seq=0 out_seq=0 2024-08-28T20:21:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.053+0000 7fc37b400640 10 client.25436 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:01.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.073+0000 7fc37b400640 1 -- 172.21.15.1:0/2168166625 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580620dc960 con 0x558061dc61b0 2024-08-28T20:21:01.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.073+0000 7fc37b400640 10 client.25436 handle_command_reply: tid=0 2024-08-28T20:21:01.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.073+0000 7fc3a7c6b740 1 client.25436 shutdown 2024-08-28T20:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.073+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 msgr2=0x5580621f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.073+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x5580621f3160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0107a0 tx=0x7fc38c005880 comp rx=0 tx=0).stop 2024-08-28T20:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 shutdown_connections 2024-08-28T20:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558061dc61b0 0x558062208f40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558061da54d0 0x558062183fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558061d9d2f0 0x558062183a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 --2- 172.21.15.1:0/2168166625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558061d84d80 0x5580621f3160 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 >> 172.21.15.1:0/2168166625 conn(0x558061dba300 msgr2=0x558062178c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:01.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc37b400640 0 client.25436 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:01.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 shutdown_connections 2024-08-28T20:21:01.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 1 -- 172.21.15.1:0/2168166625 wait complete. 2024-08-28T20:21:01.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.074+0000 7fc3a7c6b740 20 client.25436 trim_cache size 0 max 16384 2024-08-28T20:21:01.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:21:01.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:21:01.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:21:01.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:21:01.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3800b4b40 msgr2=0x7fc3800b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3800b4b40 0x7fc3800b7050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc394004270 tx=0x7fc394005fd0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 msgr2=0x7fc39c19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 0x7fc39c19be80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00d950 tx=0x7fc38c00de10 comp rx=0 tx=0).stop 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 shutdown_connections 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc3800b4b40 0x7fc3800b7050 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c108a40 0x7fc39c19c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc39c10b3a0 0x7fc39c19d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 --2- 172.21.15.1:0/1721439600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc39c06b3f0 0x7fc39c19be80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 >> 172.21.15.1:0/1721439600 conn(0x7fc39c0fdca0 msgr2=0x7fc39c109810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 shutdown_connections 2024-08-28T20:21:01.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:01.075+0000 7fc3a0c00640 1 -- 172.21.15.1:0/1721439600 wait complete. 2024-08-28T20:21:01.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:01 smithi007 ceph-mon[25357]: pgmap v452: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 762 op/s 2024-08-28T20:21:01.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:01 smithi001 ceph-mon[20984]: pgmap v452: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 762 op/s 2024-08-28T20:21:01.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:01 smithi121 ceph-mon[25248]: pgmap v452: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 762 op/s 2024-08-28T20:21:03.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 155.0 s, 3091.6 tps, lat 32.523 ms stddev 40.700 2024-08-28T20:21:03.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:03 smithi007 ceph-mon[25357]: pgmap v453: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.7 MiB/s wr, 719 op/s 2024-08-28T20:21:03.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:03 smithi001 ceph-mon[20984]: pgmap v453: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.7 MiB/s wr, 719 op/s 2024-08-28T20:21:03.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:03 smithi121 ceph-mon[25248]: pgmap v453: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.7 MiB/s wr, 719 op/s 2024-08-28T20:21:05.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:05 smithi007 ceph-mon[25357]: pgmap v454: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 863 op/s 2024-08-28T20:21:05.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:05 smithi001 ceph-mon[20984]: pgmap v454: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 863 op/s 2024-08-28T20:21:05.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:05 smithi121 ceph-mon[25248]: pgmap v454: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 863 op/s 2024-08-28T20:21:07.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:07 smithi007 ceph-mon[25357]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 MiB/s wr, 778 op/s 2024-08-28T20:21:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:07 smithi001 ceph-mon[20984]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 MiB/s wr, 778 op/s 2024-08-28T20:21:07.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:07 smithi121 ceph-mon[25248]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 MiB/s wr, 778 op/s 2024-08-28T20:21:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 160.0 s, 3609.4 tps, lat 27.715 ms stddev 31.102 2024-08-28T20:21:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:09 smithi007 ceph-mon[25357]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.8 MiB/s wr, 719 op/s 2024-08-28T20:21:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:09 smithi001 ceph-mon[20984]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.8 MiB/s wr, 719 op/s 2024-08-28T20:21:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:09 smithi121 ceph-mon[25248]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.8 MiB/s wr, 719 op/s 2024-08-28T20:21:10.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:10 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:10.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:10 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:10.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:10 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:11.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:11 smithi007 ceph-mon[25357]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 822 op/s 2024-08-28T20:21:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:11 smithi001 ceph-mon[20984]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 822 op/s 2024-08-28T20:21:11.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:11 smithi121 ceph-mon[25248]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 822 op/s 2024-08-28T20:21:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 165.0 s, 4052.6 tps, lat 24.639 ms stddev 26.614 2024-08-28T20:21:13.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:13 smithi007 ceph-mon[25357]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-08-28T20:21:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:13 smithi001 ceph-mon[20984]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-08-28T20:21:13.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:13 smithi121 ceph-mon[25248]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 823 op/s 2024-08-28T20:21:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 -- 172.21.15.1:0/2182513923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410b4c0 msgr2=0x7f8104111e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 --2- 172.21.15.1:0/2182513923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410b4c0 0x7f8104111e60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009860 tx=0x7f80f402a340 comp rx=0 tx=0).stop 2024-08-28T20:21:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 -- 172.21.15.1:0/2182513923 shutdown_connections 2024-08-28T20:21:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 --2- 172.21.15.1:0/2182513923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410b4c0 0x7f8104111e60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 --2- 172.21.15.1:0/2182513923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f810410ab20 0x7f810410af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 --2- 172.21.15.1:0/2182513923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8104109aa0 0x7f8104109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 -- 172.21.15.1:0/2182513923 >> 172.21.15.1:0/2182513923 conn(0x7f8104078e00 msgr2=0x7f8104107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.397+0000 7f810ba00640 1 -- 172.21.15.1:0/2182513923 shutdown_connections 2024-08-28T20:21:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.398+0000 7f810ba00640 1 -- 172.21.15.1:0/2182513923 wait complete. 2024-08-28T20:21:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 Processor -- start 2024-08-28T20:21:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 -- start start 2024-08-28T20:21:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 0x7f8104080e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410ab20 0x7f8104081500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810410b4c0 0x7f81040820b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81041156d0 con 0x7f810410b4c0 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8104115550 con 0x7f810410ab20 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.400+0000 7f810ba00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8104115850 con 0x7f8104109aa0 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 0x7f8104080e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 0x7f8104080e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44168/0 (socket says 172.21.15.1:44168) 2024-08-28T20:21:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 -- 172.21.15.1:0/3590383061 learned_addr learned my addr 172.21.15.1:0/3590383061 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8103e00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410ab20 0x7f8104081500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 -- 172.21.15.1:0/3590383061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410ab20 msgr2=0x7f8104081500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109a00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810410b4c0 0x7f81040820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410ab20 0x7f8104081500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 -- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810410b4c0 msgr2=0x7f81040820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810410b4c0 0x7f81040820b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.401+0000 7f8109000640 1 -- 172.21.15.1:0/3590383061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81040828d0 con 0x7f8104109aa0 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.402+0000 7f8103e00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410ab20 0x7f8104081500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.402+0000 7f8109a00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810410b4c0 0x7f81040820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.402+0000 7f8109000640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 0x7f8104080e90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00ebc0 tx=0x7f80fc00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.403+0000 7f8101600640 1 -- 172.21.15.1:0/3590383061 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc010630 con 0x7f8104109aa0 2024-08-28T20:21:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.403+0000 7f8101600640 1 -- 172.21.15.1:0/3590383061 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80fc010c80 con 0x7f8104109aa0 2024-08-28T20:21:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.403+0000 7f8101600640 1 -- 172.21.15.1:0/3590383061 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc018b60 con 0x7f8104109aa0 2024-08-28T20:21:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.404+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8104082bc0 con 0x7f8104109aa0 2024-08-28T20:21:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.404+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8104083280 con 0x7f8104109aa0 2024-08-28T20:21:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.410+0000 7f8101600640 1 -- 172.21.15.1:0/3590383061 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f80fc01f020 con 0x7f8104109aa0 2024-08-28T20:21:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.410+0000 7f8112aab740 1 Processor -- start 2024-08-28T20:21:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.410+0000 7f8112aab740 1 -- start start 2024-08-28T20:21:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.411+0000 7f8112aab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973281b0 0x55aa976cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.411+0000 7f8112aab740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.411+0000 7f8112aab740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 0x55aa976cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.411+0000 7f8112aab740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55aa97640f70 con 0x55aa973074d0 2024-08-28T20:21:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.411+0000 7f8112aab740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aa97630500 con 0x55aa972ff2f0 2024-08-28T20:21:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.411+0000 7f8112aab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55aa976344b0 con 0x55aa973281b0 2024-08-28T20:21:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.412+0000 7f8103e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 0x55aa976cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.412+0000 7f8103e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 0x55aa976cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58298/0 (socket says 172.21.15.1:58298) 2024-08-28T20:21:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.412+0000 7f8103e00640 1 -- 172.21.15.1:0/696085922 learned_addr learned my addr 172.21.15.1:0/696085922 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.412+0000 7f8101600640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f80e80b4c80 0x7f80e80b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.412+0000 7f8109a00640 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973281b0 0x55aa976cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8103e00640 1 -- 172.21.15.1:0/696085922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973281b0 msgr2=0x55aa976cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8103e00640 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973281b0 0x55aa976cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8103e00640 1 -- 172.21.15.1:0/696085922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 msgr2=0x55aa976ce1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8103e00640 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ce1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8103e00640 1 -- 172.21.15.1:0/696085922 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa975eac10 con 0x55aa973074d0 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8101600640 1 -- 172.21.15.1:0/3590383061 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f80fc0a86c0 con 0x7f8104109aa0 2024-08-28T20:21:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.413+0000 7f8109a00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f80e80b4c80 0x7f80e80b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.414+0000 7f8103e00640 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 0x55aa976cecf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009d20 tx=0x7f80ec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9825a58d3e9bab03 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.415+0000 7f80fa000640 1 -- 172.21.15.1:0/696085922 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec012650 con 0x55aa973074d0 2024-08-28T20:21:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.415+0000 7f80fa000640 1 -- 172.21.15.1:0/696085922 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80ec009e10 con 0x55aa973074d0 2024-08-28T20:21:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.415+0000 7f80fa000640 1 -- 172.21.15.1:0/696085922 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00fc60 con 0x55aa973074d0 2024-08-28T20:21:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.415+0000 7f8109a00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f80e80b4c80 0x7f80e80b7190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009780 tx=0x7f80f4009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 -- 172.21.15.1:0/696085922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 msgr2=0x55aa976cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 0x55aa976cecf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009d20 tx=0x7f80ec0117b0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 -- 172.21.15.1:0/696085922 shutdown_connections 2024-08-28T20:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973074d0 0x55aa976cecf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 --2- 172.21.15.1:0/696085922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973281b0 0x55aa976cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 -- 172.21.15.1:0/696085922 >> 172.21.15.1:0/696085922 conn(0x55aa9731c300 msgr2=0x55aa976c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 -- 172.21.15.1:0/696085922 shutdown_connections 2024-08-28T20:21:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.417+0000 7f8112aab740 1 -- 172.21.15.1:0/696085922 wait complete. 2024-08-28T20:21:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.418+0000 7f8112aab740 1 -- start start 2024-08-28T20:21:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.418+0000 7f8112aab740 1 Processor -- start 2024-08-28T20:21:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.419+0000 7f8112aab740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976e8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.419+0000 7f8112aab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976e8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.419+0000 7f8112aab740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.419+0000 7f8109000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.419+0000 7f8109000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976e8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55160/0 (socket says 172.21.15.1:55160) 2024-08-28T20:21:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8112aab740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55aa97569ab0 con 0x55aa973281b0 2024-08-28T20:21:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8112aab740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aa975d7320 con 0x55aa972ff2f0 2024-08-28T20:21:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8112aab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55aa976cf810 con 0x55aa973074d0 2024-08-28T20:21:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8109a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8112aab740 10 client.0 _ll_register_callbacks cb 0x55aa97610e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8109a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58306/0 (socket says 172.21.15.1:58306) 2024-08-28T20:21:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8109a00640 1 -- 172.21.15.1:0/3843485186 learned_addr learned my addr 172.21.15.1:0/3843485186 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.420+0000 7f8103e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.421+0000 7f8109a00640 1 -- 172.21.15.1:0/3843485186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 msgr2=0x55aa976e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.421+0000 7f8109a00640 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976e8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.421+0000 7f8109a00640 1 -- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 msgr2=0x55aa976e8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.421+0000 7f8109a00640 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976e8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.421+0000 7f8109a00640 1 -- 172.21.15.1:0/3843485186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa97393790 con 0x55aa973281b0 2024-08-28T20:21:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.422+0000 7f8109a00640 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e94c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f80f4034000 tx=0x7f80f403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7d7ff2f2c20fd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.422+0000 7f80f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:21:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.423+0000 7f80f2a00640 1 -- 172.21.15.1:0/3843485186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f404a020 con 0x55aa973281b0 2024-08-28T20:21:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.423+0000 7f80f2a00640 1 -- 172.21.15.1:0/3843485186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f80f4005460 con 0x55aa973281b0 2024-08-28T20:21:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.423+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80ec009e10 con 0x55aa973281b0 2024-08-28T20:21:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.423+0000 7f80f2a00640 1 -- 172.21.15.1:0/3843485186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80f4055050 con 0x55aa973281b0 2024-08-28T20:21:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f8112aab740 10 client.15357 fetch_fsmap learned FSMap version 31 2024-08-28T20:21:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aa9740c620 con 0x55aa973281b0 2024-08-28T20:21:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f80f2a00640 1 -- 172.21.15.1:0/3843485186 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80ec009e10 con 0x55aa973281b0 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f80f2a00640 1 -- 172.21.15.1:0/3843485186 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f80f403d040 con 0x55aa973281b0 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f8112aab740 10 client.15357 fetch_fsmap finished waiting for FSMap version 31 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f8112aab740 10 client.15357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.424+0000 7f8112aab740 20 client.15357 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.425+0000 7f8112aab740 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972e6d80 0x55aa976f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.425+0000 7f8112aab740 4 client.15357 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:21:14.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.425+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa97642ec0 con 0x55aa972e6d80 2024-08-28T20:21:14.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.425+0000 7f8109000640 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972e6d80 0x55aa976f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.425+0000 7f80f2a00640 10 client.15357 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:14.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.426+0000 7f8109000640 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972e6d80 0x55aa976f5ab0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ff97cdbc9050ae server_cookie=31c8b56398d70fa0 in_seq=0 out_seq=0 2024-08-28T20:21:14.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.427+0000 7f80f2a00640 1 -- 172.21.15.1:0/3843485186 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa97642ec0 con 0x55aa972e6d80 2024-08-28T20:21:14.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.427+0000 7f80f2a00640 10 client.15357 handle_command_reply: tid=0 2024-08-28T20:21:14.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 client.15357 shutdown 2024-08-28T20:21:14.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 msgr2=0x55aa976e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e94c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f80f4034000 tx=0x7f80f403e000 comp rx=0 tx=0).stop 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 shutdown_connections 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972e6d80 0x55aa976f5ab0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e94c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 --2- 172.21.15.1:0/3843485186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976e8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 >> 172.21.15.1:0/3843485186 conn(0x55aa9731c300 msgr2=0x55aa976c7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.428+0000 7f80f2a00640 0 client.15357 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.429+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 shutdown_connections 2024-08-28T20:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.429+0000 7f8112aab740 1 -- 172.21.15.1:0/3843485186 wait complete. 2024-08-28T20:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.429+0000 7f8112aab740 20 client.15357 trim_cache size 0 max 16384 2024-08-28T20:21:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.452+0000 7f8112aab740 1 Processor -- start 2024-08-28T20:21:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.452+0000 7f8112aab740 1 -- start start 2024-08-28T20:21:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.452+0000 7f8112aab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa972ff2f0 0x55aa976e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8112aab740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa973074d0 0x55aa976f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8112aab740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8112aab740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81041b3de0 con 0x55aa973281b0 2024-08-28T20:21:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8112aab740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8104074c20 con 0x55aa973074d0 2024-08-28T20:21:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8112aab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8104072a70 con 0x55aa972ff2f0 2024-08-28T20:21:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8109000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa972ff2f0 0x55aa976e6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8103e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa973074d0 0x55aa976f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8103e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa973074d0 0x55aa976f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55168/0 (socket says 172.21.15.1:55168) 2024-08-28T20:21:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.453+0000 7f8103e00640 1 -- 172.21.15.1:0/64703601 learned_addr learned my addr 172.21.15.1:0/64703601 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.454+0000 7f8109a00640 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.454+0000 7f8109000640 1 -- 172.21.15.1:0/64703601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa973074d0 msgr2=0x55aa976f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.454+0000 7f8109000640 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa973074d0 0x55aa976f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.454+0000 7f8109000640 1 -- 172.21.15.1:0/64703601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 msgr2=0x55aa976e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.454+0000 7f8109000640 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.454+0000 7f8109000640 1 -- 172.21.15.1:0/64703601 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa976c37c0 con 0x55aa972ff2f0 2024-08-28T20:21:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.455+0000 7f8109000640 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa972ff2f0 0x55aa976e6cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0a6750 tx=0x7f80fc0b1a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e032a9f6bc4e51 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.455+0000 7f80f9600640 1 -- 172.21.15.1:0/64703601 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0a88c0 con 0x55aa972ff2f0 2024-08-28T20:21:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.456+0000 7f80f9600640 1 -- 172.21.15.1:0/64703601 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80fc018420 con 0x55aa972ff2f0 2024-08-28T20:21:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.456+0000 7f80f9600640 1 -- 172.21.15.1:0/64703601 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0a8a60 con 0x55aa972ff2f0 2024-08-28T20:21:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.457+0000 7f8112aab740 1 -- 172.21.15.1:0/64703601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa972ff2f0 msgr2=0x55aa976e6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.457+0000 7f8112aab740 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa972ff2f0 0x55aa976e6cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0a6750 tx=0x7f80fc0b1a60 comp rx=0 tx=0).stop 2024-08-28T20:21:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.457+0000 7f8112aab740 1 -- 172.21.15.1:0/64703601 shutdown_connections 2024-08-28T20:21:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.457+0000 7f8112aab740 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.458+0000 7f8112aab740 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa973074d0 0x55aa976f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.458+0000 7f8112aab740 1 --2- 172.21.15.1:0/64703601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa972ff2f0 0x55aa976e6cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.458+0000 7f8112aab740 1 -- 172.21.15.1:0/64703601 >> 172.21.15.1:0/64703601 conn(0x55aa9731c300 msgr2=0x55aa976c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.458+0000 7f8112aab740 1 -- 172.21.15.1:0/64703601 shutdown_connections 2024-08-28T20:21:14.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.458+0000 7f8112aab740 1 -- 172.21.15.1:0/64703601 wait complete. 2024-08-28T20:21:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.459+0000 7f8112aab740 1 -- start start 2024-08-28T20:21:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.460+0000 7f8112aab740 1 Processor -- start 2024-08-28T20:21:14.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.461+0000 7f8112aab740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.461+0000 7f8112aab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.461+0000 7f8112aab740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976efca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.461+0000 7f8112aab740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81040730e0 con 0x55aa973281b0 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.461+0000 7f8112aab740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8104074550 con 0x55aa972ff2f0 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.461+0000 7f8112aab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81040737b0 con 0x55aa973074d0 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55176/0 (socket says 172.21.15.1:55176) 2024-08-28T20:21:14.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 -- 172.21.15.1:0/3130847953 learned_addr learned my addr 172.21.15.1:0/3130847953 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:14.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8103e00640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8112aab740 10 client.0 _ll_register_callbacks cb 0x7f80f4035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109a00640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 -- 172.21.15.1:0/3130847953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 msgr2=0x55aa976ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 -- 172.21.15.1:0/3130847953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 msgr2=0x55aa976efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109000640 1 -- 172.21.15.1:0/3130847953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa976edfd0 con 0x55aa972ff2f0 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.462+0000 7f8109a00640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.463+0000 7f8109000640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ef220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00cde0 tx=0x7f80fc00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3957ad227126039 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.463+0000 7f80f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.463+0000 7f80f2a00640 1 -- 172.21.15.1:0/3130847953 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0a8c30 con 0x55aa972ff2f0 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.464+0000 7f80f2a00640 1 -- 172.21.15.1:0/3130847953 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f80fc01fd90 con 0x55aa972ff2f0 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.464+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aa9763e960 con 0x55aa972ff2f0 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.464+0000 7f80f2a00640 1 -- 172.21.15.1:0/3130847953 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80fc0a8dd0 con 0x55aa972ff2f0 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 10 client.25451 fetch_fsmap learned FSMap version 31 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aa977608a0 con 0x55aa972ff2f0 2024-08-28T20:21:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f80f2a00640 1 -- 172.21.15.1:0/3130847953 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aa9763e960 con 0x55aa972ff2f0 2024-08-28T20:21:14.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f80f2a00640 1 -- 172.21.15.1:0/3130847953 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f80fc0d2070 con 0x55aa972ff2f0 2024-08-28T20:21:14.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 10 client.25451 fetch_fsmap finished waiting for FSMap version 31 2024-08-28T20:21:14.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:14.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 20 client.25451 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:14.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972bc1c0 0x55aa97763240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:14.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 4 client.25451 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:21:14.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.465+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa9763c0a0 con 0x55aa972bc1c0 2024-08-28T20:21:14.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.466+0000 7f8103e00640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972bc1c0 0x55aa97763240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:14.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.467+0000 7f8103e00640 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972bc1c0 0x55aa97763240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d4ed6bb10d06d server_cookie=d76c06928c9a8d0 in_seq=0 out_seq=0 2024-08-28T20:21:14.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.467+0000 7f80f2a00640 10 client.25451 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.482+0000 7f80f2a00640 1 -- 172.21.15.1:0/3130847953 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa9763c0a0 con 0x55aa972bc1c0 2024-08-28T20:21:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.483+0000 7f80f2a00640 10 client.25451 handle_command_reply: tid=0 2024-08-28T20:21:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.483+0000 7f8112aab740 1 client.25451 shutdown 2024-08-28T20:21:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.483+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 msgr2=0x55aa976ef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.483+0000 7f8112aab740 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ef220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00cde0 tx=0x7f80fc00cf90 comp rx=0 tx=0).stop 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 shutdown_connections 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55aa972bc1c0 0x55aa97763240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55aa973281b0 0x55aa976efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55aa973074d0 0x55aa976ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 --2- 172.21.15.1:0/3130847953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa972ff2f0 0x55aa976ef220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 >> 172.21.15.1:0/3130847953 conn(0x55aa9731c300 msgr2=0x55aa976d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f80f2a00640 0 client.25451 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 shutdown_connections 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 1 -- 172.21.15.1:0/3130847953 wait complete. 2024-08-28T20:21:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.484+0000 7f8112aab740 20 client.25451 trim_cache size 0 max 16384 2024-08-28T20:21:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:21:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:21:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:21:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:21:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f80e80b4c80 msgr2=0x7f80e80b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f80e80b4c80 0x7f80e80b7190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009780 tx=0x7f80f4009570 comp rx=0 tx=0).stop 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 msgr2=0x7f8104080e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 0x7f8104080e90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00ebc0 tx=0x7f80fc00c6a0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 shutdown_connections 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f80e80b4c80 0x7f80e80b7190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810410b4c0 0x7f81040820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f810410ab20 0x7f8104081500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 --2- 172.21.15.1:0/3590383061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8104109aa0 0x7f8104080e90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.485+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 >> 172.21.15.1:0/3590383061 conn(0x7f8104078e00 msgr2=0x7f810410de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:14.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.486+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 shutdown_connections 2024-08-28T20:21:14.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:14.486+0000 7f810ba00640 1 -- 172.21.15.1:0/3590383061 wait complete. 2024-08-28T20:21:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:15 smithi007 ceph-mon[25357]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 897 op/s 2024-08-28T20:21:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:15 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:15.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:15 smithi001 ceph-mon[20984]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 897 op/s 2024-08-28T20:21:15.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:15 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:15 smithi121 ceph-mon[25248]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 897 op/s 2024-08-28T20:21:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:15 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:17.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:17 smithi001 ceph-mon[20984]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.1 MiB/s wr, 743 op/s 2024-08-28T20:21:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:17 smithi121 ceph-mon[25248]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.1 MiB/s wr, 743 op/s 2024-08-28T20:21:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:17 smithi007 ceph-mon[25357]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.1 MiB/s wr, 743 op/s 2024-08-28T20:21:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 170.0 s, 2725.2 tps, lat 36.671 ms stddev 54.379 2024-08-28T20:21:19.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:19 smithi001 ceph-mon[20984]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-08-28T20:21:19.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:19 smithi121 ceph-mon[25248]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-08-28T20:21:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:19 smithi007 ceph-mon[25357]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-08-28T20:21:21.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:21 smithi001 ceph-mon[20984]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 896 op/s 2024-08-28T20:21:21.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:21 smithi121 ceph-mon[25248]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 896 op/s 2024-08-28T20:21:22.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:21 smithi007 ceph-mon[25357]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 896 op/s 2024-08-28T20:21:22.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:21:22.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:21:23.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:21:23.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 175.0 s, 1905.3 tps, lat 52.453 ms stddev 69.977 2024-08-28T20:21:23.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:23 smithi001 ceph-mon[20984]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 783 op/s 2024-08-28T20:21:23.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:21:23.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:21:23.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:21:23.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:23 smithi121 ceph-mon[25248]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 783 op/s 2024-08-28T20:21:23.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:21:23.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:21:23.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:21:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:23 smithi007 ceph-mon[25357]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 783 op/s 2024-08-28T20:21:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:21:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:21:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:21:25.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:25 smithi001 ceph-mon[20984]: pgmap v464: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 877 op/s 2024-08-28T20:21:25.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:25 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:25 smithi121 ceph-mon[25248]: pgmap v464: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 877 op/s 2024-08-28T20:21:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:25 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:26.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:25 smithi007 ceph-mon[25357]: pgmap v464: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 877 op/s 2024-08-28T20:21:26.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:25 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:26.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:26 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:26.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:26 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:27.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:26 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.797+0000 7ff2c2400640 1 -- 172.21.15.1:0/1599781134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc1098b0 msgr2=0x7ff2bc109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.797+0000 7ff2c2400640 1 --2- 172.21.15.1:0/1599781134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc109d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009900 tx=0x7ff2b002a400 comp rx=0 tx=0).stop 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.798+0000 7ff2c2400640 1 -- 172.21.15.1:0/1599781134 shutdown_connections 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.798+0000 7ff2c2400640 1 --2- 172.21.15.1:0/1599781134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10b2d0 0x7ff2bc111c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.798+0000 7ff2c2400640 1 --2- 172.21.15.1:0/1599781134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc10a930 0x7ff2bc10ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.798+0000 7ff2c2400640 1 --2- 172.21.15.1:0/1599781134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc109d20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.798+0000 7ff2c2400640 1 -- 172.21.15.1:0/1599781134 >> 172.21.15.1:0/1599781134 conn(0x7ff2bc078c20 msgr2=0x7ff2bc07b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.798+0000 7ff2c2400640 1 -- 172.21.15.1:0/1599781134 shutdown_connections 2024-08-28T20:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.799+0000 7ff2c2400640 1 -- 172.21.15.1:0/1599781134 wait complete. 2024-08-28T20:21:27.802 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.800+0000 7ff2c2400640 1 Processor -- start 2024-08-28T20:21:27.802 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.800+0000 7ff2c2400640 1 -- start start 2024-08-28T20:21:27.803 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc1a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.803 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c2400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10a930 0x7ff2bc1a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c2400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc10b2d0 0x7ff2bc1a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c2400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc115520 con 0x7ff2bc10a930 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1153a0 con 0x7ff2bc1098b0 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c2400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1156a0 con 0x7ff2bc10b2d0 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.801+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc1a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc1a00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43742/0 (socket says 172.21.15.1:43742) 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 -- 172.21.15.1:0/852889727 learned_addr learned my addr 172.21.15.1:0/852889727 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc10b2d0 0x7ff2bc1a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10a930 0x7ff2bc1a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 -- 172.21.15.1:0/852889727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc10b2d0 msgr2=0x7ff2bc1a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc10b2d0 0x7ff2bc1a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 -- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10a930 msgr2=0x7ff2bc1a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10a930 0x7ff2bc1a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1000640 1 -- 172.21.15.1:0/852889727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc1a1af0 con 0x7ff2bc1098b0 2024-08-28T20:21:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc10b2d0 0x7ff2bc1a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:21:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.802+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10a930 0x7ff2bc1a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.803+0000 7ff2c1000640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc1a00b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0031440 tx=0x7ff2b0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.803+0000 7ff2b9600640 1 -- 172.21.15.1:0/852889727 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b003f070 con 0x7ff2bc1098b0 2024-08-28T20:21:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.803+0000 7ff2b9600640 1 -- 172.21.15.1:0/852889727 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b0031c50 con 0x7ff2bc1098b0 2024-08-28T20:21:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.803+0000 7ff2b9600640 1 -- 172.21.15.1:0/852889727 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0035030 con 0x7ff2bc1098b0 2024-08-28T20:21:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.803+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc1a1d80 con 0x7ff2bc1098b0 2024-08-28T20:21:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.803+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1a82f0 con 0x7ff2bc1098b0 2024-08-28T20:21:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.809+0000 7ff2caabb740 1 Processor -- start 2024-08-28T20:21:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.809+0000 7ff2caabb740 1 -- start start 2024-08-28T20:21:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d02fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc99342f0 0x55bcc9d03610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 0x55bcc9d04160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2caabb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcc9c75f70 con 0x55bcc99342f0 2024-08-28T20:21:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2caabb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bcc9c65500 con 0x55bcc995d1b0 2024-08-28T20:21:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2caabb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bcc9c694b0 con 0x55bcc993c4d0 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2bbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 0x55bcc9d04160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2bbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 0x55bcc9d04160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37896/0 (socket says 172.21.15.1:37896) 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.810+0000 7ff2bbe00640 1 -- 172.21.15.1:0/658373473 learned_addr learned my addr 172.21.15.1:0/658373473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d02fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2bbe00640 1 -- 172.21.15.1:0/658373473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 msgr2=0x55bcc9d02fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d02fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2b9600640 1 -- 172.21.15.1:0/852889727 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ff2b0042070 con 0x7ff2bc1098b0 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2bbe00640 1 -- 172.21.15.1:0/658373473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc99342f0 msgr2=0x55bcc9d03610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc99342f0 0x55bcc9d03610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2bbe00640 1 -- 172.21.15.1:0/658373473 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc9c1fc10 con 0x55bcc993c4d0 2024-08-28T20:21:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.811+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d02fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.812+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 0x55bcc9d04160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009c50 tx=0x7ff2a800e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce9fef0791911eb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.812+0000 7ff2ae000640 1 -- 172.21.15.1:0/658373473 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8016070 con 0x55bcc993c4d0 2024-08-28T20:21:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.812+0000 7ff2ae000640 1 -- 172.21.15.1:0/658373473 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a80054d0 con 0x55bcc993c4d0 2024-08-28T20:21:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.812+0000 7ff2ae000640 1 -- 172.21.15.1:0/658373473 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8011470 con 0x55bcc993c4d0 2024-08-28T20:21:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.813+0000 7ff2b9600640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2a40b4ba0 0x7ff2a40b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.813+0000 7ff2b9600640 1 -- 172.21.15.1:0/852889727 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff2b01059f0 con 0x7ff2bc1098b0 2024-08-28T20:21:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.813+0000 7ff2caabb740 1 -- 172.21.15.1:0/658373473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 msgr2=0x55bcc9d04160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.813+0000 7ff2caabb740 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 0x55bcc9d04160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009c50 tx=0x7ff2a800e6c0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 -- 172.21.15.1:0/658373473 shutdown_connections 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc99342f0 0x55bcc9d03610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc993c4d0 0x55bcc9d04160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 --2- 172.21.15.1:0/658373473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d02fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 -- 172.21.15.1:0/658373473 >> 172.21.15.1:0/658373473 conn(0x55bcc9951300 msgr2=0x55bcc9cfea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 -- 172.21.15.1:0/658373473 shutdown_connections 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2a40b4ba0 0x7ff2a40b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.814+0000 7ff2caabb740 1 -- 172.21.15.1:0/658373473 wait complete. 2024-08-28T20:21:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.815+0000 7ff2caabb740 1 -- start start 2024-08-28T20:21:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.815+0000 7ff2caabb740 1 Processor -- start 2024-08-28T20:21:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2a40b4ba0 0x7ff2a40b70b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4005fd0 tx=0x7ff2b4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d1d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d1e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2caabb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bcc9b9eab0 con 0x55bcc993c4d0 2024-08-28T20:21:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2caabb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bcc9c0c320 con 0x55bcc995d1b0 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d1d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2caabb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bcc9d04c80 con 0x55bcc99342f0 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d1d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37912/0 (socket says 172.21.15.1:37912) 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.816+0000 7ff2c1000640 1 -- 172.21.15.1:0/3033967911 learned_addr learned my addr 172.21.15.1:0/3033967911 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d1e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2caabb740 10 client.0 _ll_register_callbacks cb 0x55bcc9c126a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2c1000640 1 -- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 msgr2=0x55bcc9d1e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2c1000640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d1e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2c1000640 1 -- 172.21.15.1:0/3033967911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 msgr2=0x55bcc9d1dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2c1000640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.817+0000 7ff2c1000640 1 -- 172.21.15.1:0/3033967911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc99c8790 con 0x55bcc99342f0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.818+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.818+0000 7ff2c1000640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d1d640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cc110 tx=0x7ff2b00cbb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=783c022676741634 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.818+0000 7ff2a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.818+0000 7ff2a2a00640 1 -- 172.21.15.1:0/3033967911 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0049040 con 0x55bcc99342f0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.818+0000 7ff2a2a00640 1 -- 172.21.15.1:0/3033967911 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff2b003b460 con 0x55bcc99342f0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.818+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a80054d0 con 0x55bcc99342f0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.819+0000 7ff2a2a00640 1 -- 172.21.15.1:0/3033967911 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2b00d5070 con 0x55bcc99342f0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.819+0000 7ff2caabb740 10 client.25441 fetch_fsmap learned FSMap version 34 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.819+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bcc9a41620 con 0x55bcc99342f0 2024-08-28T20:21:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.819+0000 7ff2a2a00640 1 -- 172.21.15.1:0/3033967911 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a80054d0 con 0x55bcc99342f0 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2a2a00640 1 -- 172.21.15.1:0/3033967911 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 34) ==== 8354+0+0 (secure 0 0 0) 0x7ff2b00c86a0 con 0x55bcc99342f0 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2caabb740 10 client.25441 fetch_fsmap finished waiting for FSMap version 34 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2caabb740 10 client.25441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2caabb740 20 client.25441 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2caabb740 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc991bd80 0x55bcc9d2ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2caabb740 4 client.25441 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:21:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.821+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcc9c77ec0 con 0x55bcc991bd80 2024-08-28T20:21:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.822+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc991bd80 0x55bcc9d2ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.822+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc991bd80 0x55bcc9d2ad90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91ac0d7426a0a07f server_cookie=1886ddb19a6e449e in_seq=0 out_seq=0 2024-08-28T20:21:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.822+0000 7ff2a2a00640 10 client.25441 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.823+0000 7ff2a2a00640 1 -- 172.21.15.1:0/3033967911 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcc9c77ec0 con 0x55bcc991bd80 2024-08-28T20:21:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.823+0000 7ff2a2a00640 10 client.25441 handle_command_reply: tid=0 2024-08-28T20:21:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.823+0000 7ff2caabb740 1 client.25441 shutdown 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.824+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 msgr2=0x55bcc9d1d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.824+0000 7ff2caabb740 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d1d640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cc110 tx=0x7ff2b00cbb80 comp rx=0 tx=0).stop 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 shutdown_connections 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc991bd80 0x55bcc9d2ad90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d1e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 --2- 172.21.15.1:0/3033967911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d1d640 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 >> 172.21.15.1:0/3033967911 conn(0x55bcc9951300 msgr2=0x55bcc9cfcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2a2a00640 0 client.25441 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 shutdown_connections 2024-08-28T20:21:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.825+0000 7ff2caabb740 1 -- 172.21.15.1:0/3033967911 wait complete. 2024-08-28T20:21:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.826+0000 7ff2caabb740 20 client.25441 trim_cache size 0 max 16384 2024-08-28T20:21:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 Processor -- start 2024-08-28T20:21:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 -- start start 2024-08-28T20:21:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9cfe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d07090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1ab1a0 con 0x55bcc993c4d0 2024-08-28T20:21:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a8a40 con 0x55bcc995d1b0 2024-08-28T20:21:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.859+0000 7ff2caabb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc073640 con 0x55bcc99342f0 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.860+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9cfe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.860+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9cfe370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37928/0 (socket says 172.21.15.1:37928) 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.860+0000 7ff2c1000640 1 -- 172.21.15.1:0/1832411356 learned_addr learned my addr 172.21.15.1:0/1832411356 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.860+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d07090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.861+0000 7ff2c1000640 1 -- 172.21.15.1:0/1832411356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 msgr2=0x55bcc9d07090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.861+0000 7ff2c1000640 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d07090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.861+0000 7ff2c1000640 1 -- 172.21.15.1:0/1832411356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 msgr2=0x55bcc9d1d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.861+0000 7ff2c1000640 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.861+0000 7ff2c1000640 1 -- 172.21.15.1:0/1832411356 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc9cf8be0 con 0x55bcc99342f0 2024-08-28T20:21:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.861+0000 7ff2c1000640 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9cfe370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cc3a0 tx=0x7ff2b00cbcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dea0bdf89bb7f80 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.862+0000 7ff2ad600640 1 -- 172.21.15.1:0/1832411356 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0049030 con 0x55bcc99342f0 2024-08-28T20:21:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.862+0000 7ff2ad600640 1 -- 172.21.15.1:0/1832411356 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00317a0 con 0x55bcc99342f0 2024-08-28T20:21:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.862+0000 7ff2ad600640 1 -- 172.21.15.1:0/1832411356 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00c86a0 con 0x55bcc99342f0 2024-08-28T20:21:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 -- 172.21.15.1:0/1832411356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 msgr2=0x55bcc9cfe370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9cfe370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cc3a0 tx=0x7ff2b00cbcb0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 -- 172.21.15.1:0/1832411356 shutdown_connections 2024-08-28T20:21:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d1d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d07090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1832411356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9cfe370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.863+0000 7ff2caabb740 1 -- 172.21.15.1:0/1832411356 >> 172.21.15.1:0/1832411356 conn(0x55bcc9951300 msgr2=0x55bcc9cf9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.864+0000 7ff2caabb740 1 -- 172.21.15.1:0/1832411356 shutdown_connections 2024-08-28T20:21:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.864+0000 7ff2caabb740 1 -- 172.21.15.1:0/1832411356 wait complete. 2024-08-28T20:21:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.865+0000 7ff2caabb740 1 -- start start 2024-08-28T20:21:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.865+0000 7ff2caabb740 1 Processor -- start 2024-08-28T20:21:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d255f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d249a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc073cb0 con 0x55bcc993c4d0 2024-08-28T20:21:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc075120 con 0x55bcc995d1b0 2024-08-28T20:21:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc074380 con 0x55bcc99342f0 2024-08-28T20:21:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.866+0000 7ff2caabb740 10 client.0 _ll_register_callbacks cb 0x7ff2b00cc1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d255f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37934/0 (socket says 172.21.15.1:37934) 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 -- 172.21.15.1:0/1096474660 learned_addr learned my addr 172.21.15.1:0/1096474660 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1a00640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 -- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 msgr2=0x55bcc9d249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d249a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 -- 172.21.15.1:0/1096474660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 msgr2=0x55bcc9d242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d242b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.867+0000 7ff2c1000640 1 -- 172.21.15.1:0/1096474660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc9d22ec0 con 0x55bcc99342f0 2024-08-28T20:21:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2c1000640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d255f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cc110 tx=0x7ff2b0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72a095854ef046ea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2a2a00640 1 -- 172.21.15.1:0/1096474660 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00e5020 con 0x55bcc99342f0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b00317a0 con 0x55bcc99342f0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2a2a00640 1 -- 172.21.15.1:0/1096474660 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff2b00d5380 con 0x55bcc99342f0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2a2a00640 1 -- 172.21.15.1:0/1096474660 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2b00d5780 con 0x55bcc99342f0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2caabb740 10 client.25447 fetch_fsmap learned FSMap version 34 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.868+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bcc9d22ec0 con 0x55bcc99342f0 2024-08-28T20:21:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.869+0000 7ff2a2a00640 1 -- 172.21.15.1:0/1096474660 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00317a0 con 0x55bcc99342f0 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.869+0000 7ff2a2a00640 1 -- 172.21.15.1:0/1096474660 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 34) ==== 8354+0+0 (secure 0 0 0) 0x7ff2b00cb810 con 0x55bcc99342f0 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2caabb740 10 client.25447 fetch_fsmap finished waiting for FSMap version 34 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2caabb740 10 client.25447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2caabb740 20 client.25447 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc98f11c0 0x55bcc9d97f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2caabb740 4 client.25447 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bcc9c73960 con 0x55bcc98f11c0 2024-08-28T20:21:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.870+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc98f11c0 0x55bcc9d97f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.871+0000 7ff2a2a00640 10 client.25447 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.871+0000 7ff2bbe00640 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc98f11c0 0x55bcc9d97f10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f262470fdac98563 server_cookie=b40bdc121d0d9913 in_seq=0 out_seq=0 2024-08-28T20:21:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.959+0000 7ff2a2a00640 1 -- 172.21.15.1:0/1096474660 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bcc9c73960 con 0x55bcc98f11c0 2024-08-28T20:21:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.959+0000 7ff2a2a00640 10 client.25447 handle_command_reply: tid=0 2024-08-28T20:21:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.959+0000 7ff2caabb740 1 client.25447 shutdown 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.959+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 msgr2=0x55bcc9d255f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.959+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d255f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cc110 tx=0x7ff2b0009260 comp rx=0 tx=0).stop 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 shutdown_connections 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bcc98f11c0 0x55bcc9d97f10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bcc993c4d0 0x55bcc9d242b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bcc995d1b0 0x55bcc9d249a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 --2- 172.21.15.1:0/1096474660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcc99342f0 0x55bcc9d255f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 >> 172.21.15.1:0/1096474660 conn(0x55bcc9951300 msgr2=0x55bcc9cfd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2a2a00640 0 client.25447 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 shutdown_connections 2024-08-28T20:21:27.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 1 -- 172.21.15.1:0/1096474660 wait complete. 2024-08-28T20:21:27.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.960+0000 7ff2caabb740 20 client.25447 trim_cache size 0 max 16384 2024-08-28T20:21:27.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:21:27.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:21:27.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:21:27.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2a40b4ba0 msgr2=0x7ff2a40b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2a40b4ba0 0x7ff2a40b70b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4005fd0 tx=0x7ff2b4009500 comp rx=0 tx=0).stop 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 msgr2=0x7ff2bc1a00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc1a00b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0031440 tx=0x7ff2b0003c10 comp rx=0 tx=0).stop 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 shutdown_connections 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff2a40b4ba0 0x7ff2a40b70b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.962+0000 7ff2c2400640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2bc10a930 0x7ff2bc1a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.963+0000 7ff2c2400640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2bc10b2d0 0x7ff2bc1a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.963+0000 7ff2c2400640 1 --2- 172.21.15.1:0/852889727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc1098b0 0x7ff2bc1a00b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.963+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 >> 172.21.15.1:0/852889727 conn(0x7ff2bc078c20 msgr2=0x7ff2bc10dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.963+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 shutdown_connections 2024-08-28T20:21:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:27.963+0000 7ff2c2400640 1 -- 172.21.15.1:0/852889727 wait complete. 2024-08-28T20:21:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:27 smithi001 ceph-mon[20984]: pgmap v465: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 809 op/s 2024-08-28T20:21:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:27 smithi121 ceph-mon[25248]: pgmap v465: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 809 op/s 2024-08-28T20:21:28.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:27 smithi007 ceph-mon[25357]: pgmap v465: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 809 op/s 2024-08-28T20:21:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 180.0 s, 2275.1 tps, lat 43.172 ms stddev 57.046 2024-08-28T20:21:29.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:29 smithi001 ceph-mon[20984]: pgmap v466: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 30 MiB/s wr, 795 op/s 2024-08-28T20:21:29.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:29 smithi121 ceph-mon[25248]: pgmap v466: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 30 MiB/s wr, 795 op/s 2024-08-28T20:21:30.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:29 smithi007 ceph-mon[25357]: pgmap v466: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 30 MiB/s wr, 795 op/s 2024-08-28T20:21:30.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:30 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:30.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:30 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:31.064 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:30 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:31.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:31 smithi001 ceph-mon[20984]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 874 op/s 2024-08-28T20:21:31.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:31 smithi121 ceph-mon[25248]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 874 op/s 2024-08-28T20:21:32.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:31 smithi007 ceph-mon[25357]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 874 op/s 2024-08-28T20:21:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 185.0 s, 2478.2 tps, lat 40.956 ms stddev 56.094 2024-08-28T20:21:33.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:33 smithi001 ceph-mon[20984]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 MiB/s wr, 738 op/s 2024-08-28T20:21:33.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:33 smithi121 ceph-mon[25248]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 MiB/s wr, 738 op/s 2024-08-28T20:21:34.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:33 smithi007 ceph-mon[25357]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 MiB/s wr, 738 op/s 2024-08-28T20:21:35.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:35 smithi001 ceph-mon[20984]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 813 op/s 2024-08-28T20:21:35.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:35 smithi121 ceph-mon[25248]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 813 op/s 2024-08-28T20:21:36.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:35 smithi007 ceph-mon[25357]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 813 op/s 2024-08-28T20:21:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:37 smithi001 ceph-mon[20984]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 723 op/s 2024-08-28T20:21:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:37 smithi121 ceph-mon[25248]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 723 op/s 2024-08-28T20:21:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:37 smithi007 ceph-mon[25357]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 723 op/s 2024-08-28T20:21:38.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 190.0 s, 2689.6 tps, lat 37.119 ms stddev 45.966 2024-08-28T20:21:39.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:39 smithi001 ceph-mon[20984]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 720 op/s 2024-08-28T20:21:39.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:39 smithi121 ceph-mon[25248]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 720 op/s 2024-08-28T20:21:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:39 smithi007 ceph-mon[25357]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 720 op/s 2024-08-28T20:21:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 -- 172.21.15.1:0/3361980026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801031f0 msgr2=0x7fa580103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 --2- 172.21.15.1:0/3361980026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801031f0 0x7fa580103600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009900 tx=0x7fa56c02a410 comp rx=0 tx=0).stop 2024-08-28T20:21:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 -- 172.21.15.1:0/3361980026 shutdown_connections 2024-08-28T20:21:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 --2- 172.21.15.1:0/3361980026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801031f0 0x7fa580103600 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 --2- 172.21.15.1:0/3361980026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa580103b90 0x7fa58010a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 --2- 172.21.15.1:0/3361980026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580102170 0x7fa5801025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.238+0000 7fa584c00640 1 -- 172.21.15.1:0/3361980026 >> 172.21.15.1:0/3361980026 conn(0x7fa5800fdab0 msgr2=0x7fa5800fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.239+0000 7fa584c00640 1 -- 172.21.15.1:0/3361980026 shutdown_connections 2024-08-28T20:21:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.239+0000 7fa584c00640 1 -- 172.21.15.1:0/3361980026 wait complete. 2024-08-28T20:21:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.240+0000 7fa584c00640 1 Processor -- start 2024-08-28T20:21:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.240+0000 7fa584c00640 1 -- start start 2024-08-28T20:21:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.241+0000 7fa584c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa580102170 0x7fa5801a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.241+0000 7fa584c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 0x7fa5801a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.241+0000 7fa584c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801a13a0 0x7fa5801a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.241+0000 7fa584c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010cd50 con 0x7fa5801a13a0 2024-08-28T20:21:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.241+0000 7fa584c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010cbd0 con 0x7fa580103b90 2024-08-28T20:21:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.241+0000 7fa584c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010ced0 con 0x7fa580102170 2024-08-28T20:21:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 0x7fa5801a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 0x7fa5801a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43588/0 (socket says 172.21.15.1:43588) 2024-08-28T20:21:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57ea00640 1 -- 172.21.15.1:0/1533633206 learned_addr learned my addr 172.21.15.1:0/1533633206 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57f400640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa580102170 0x7fa5801a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57ea00640 1 -- 172.21.15.1:0/1533633206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa580102170 msgr2=0x7fa5801a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57ea00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa580102170 0x7fa5801a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.242+0000 7fa57ea00640 1 -- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801a13a0 msgr2=0x7fa5801a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.243+0000 7fa57fe00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801a13a0 0x7fa5801a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.243+0000 7fa57ea00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801a13a0 0x7fa5801a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.243+0000 7fa57ea00640 1 -- 172.21.15.1:0/1533633206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5801a20c0 con 0x7fa580103b90 2024-08-28T20:21:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.243+0000 7fa57fe00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801a13a0 0x7fa5801a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.244+0000 7fa57ea00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 0x7fa5801a0910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa56c02aa00 tx=0x7fa56c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.244+0000 7fa577e00640 1 -- 172.21.15.1:0/1533633206 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c03f020 con 0x7fa580103b90 2024-08-28T20:21:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.244+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5801a8410 con 0x7fa580103b90 2024-08-28T20:21:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.244+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5801a8960 con 0x7fa580103b90 2024-08-28T20:21:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.244+0000 7fa577e00640 1 -- 172.21.15.1:0/1533633206 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa56c031c50 con 0x7fa580103b90 2024-08-28T20:21:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.244+0000 7fa577e00640 1 -- 172.21.15.1:0/1533633206 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c035070 con 0x7fa580103b90 2024-08-28T20:21:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.252+0000 7fa577e00640 1 -- 172.21.15.1:0/1533633206 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fa56c042020 con 0x7fa580103b90 2024-08-28T20:21:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.254+0000 7fa58cdfd740 1 Processor -- start 2024-08-28T20:21:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.254+0000 7fa58cdfd740 1 -- start start 2024-08-28T20:21:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.255+0000 7fa577e00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5640b4c50 0x7fa5640b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.255+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 0x558061bf3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.255+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bf43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.256+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061bf4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.256+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558061b66f70 con 0x55806182d4d0 2024-08-28T20:21:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.256+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558061b56500 con 0x5580618252f0 2024-08-28T20:21:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.256+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558061b5a4b0 con 0x55806184e1b0 2024-08-28T20:21:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.256+0000 7fa57f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 0x558061bf3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.257+0000 7fa57f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 0x558061bf3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37956/0 (socket says 172.21.15.1:37956) 2024-08-28T20:21:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.257+0000 7fa57f400640 1 -- 172.21.15.1:0/1043159653 learned_addr learned my addr 172.21.15.1:0/1043159653 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.257+0000 7fa57ea00640 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bf43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.257+0000 7fa577e00640 1 -- 172.21.15.1:0/1533633206 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa56c105940 con 0x7fa580103b90 2024-08-28T20:21:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.257+0000 7fa57fe00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5640b4c50 0x7fa5640b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.258+0000 7fa57f400640 1 -- 172.21.15.1:0/1043159653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 msgr2=0x558061bf43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.258+0000 7fa57f400640 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bf43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.258+0000 7fa57f400640 1 -- 172.21.15.1:0/1043159653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 msgr2=0x558061bf4f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:21:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.258+0000 7fa57fe00640 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061bf4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.258+0000 7fa57f400640 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061bf4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.259+0000 7fa57f400640 1 -- 172.21.15.1:0/1043159653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558061b10c10 con 0x55806184e1b0 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.259+0000 7fa57ea00640 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bf43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.259+0000 7fa57f400640 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 0x558061bf3d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa578010480 tx=0x7fa578010940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c37c84913a1671 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.259+0000 7fa56be00640 1 -- 172.21.15.1:0/1043159653 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578017070 con 0x55806184e1b0 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.259+0000 7fa56be00640 1 -- 172.21.15.1:0/1043159653 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa578011c10 con 0x55806184e1b0 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.259+0000 7fa56be00640 1 -- 172.21.15.1:0/1043159653 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57801bc40 con 0x55806184e1b0 2024-08-28T20:21:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.260+0000 7fa57fe00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5640b4c50 0x7fa5640b7160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa570009dd0 tx=0x7fa570009770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.260+0000 7fa58cdfd740 1 -- 172.21.15.1:0/1043159653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 msgr2=0x558061bf3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.260+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 0x558061bf3d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa578010480 tx=0x7fa578010940 comp rx=0 tx=0).stop 2024-08-28T20:21:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 -- 172.21.15.1:0/1043159653 shutdown_connections 2024-08-28T20:21:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061bf4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bf43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/1043159653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806184e1b0 0x558061bf3d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 -- 172.21.15.1:0/1043159653 >> 172.21.15.1:0/1043159653 conn(0x558061842300 msgr2=0x558061bef7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 -- 172.21.15.1:0/1043159653 shutdown_connections 2024-08-28T20:21:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.261+0000 7fa58cdfd740 1 -- 172.21.15.1:0/1043159653 wait complete. 2024-08-28T20:21:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.262+0000 7fa58cdfd740 1 -- start start 2024-08-28T20:21:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.263+0000 7fa58cdfd740 1 Processor -- start 2024-08-28T20:21:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.265+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061bfd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.265+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 0x558061bfda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.265+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.265+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558061a8fab0 con 0x55806184e1b0 2024-08-28T20:21:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.265+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558061afd320 con 0x55806182d4d0 2024-08-28T20:21:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.265+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558061bf5a20 con 0x5580618252f0 2024-08-28T20:21:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa58cdfd740 10 client.0 _ll_register_callbacks cb 0x558061b36e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061bfd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfe5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53962/0 (socket says 172.21.15.1:53962) 2024-08-28T20:21:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061bfd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:37964/0 (socket says 172.21.15.1:37964) 2024-08-28T20:21:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 0x558061bfda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 0x558061bfda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43606/0 (socket says 172.21.15.1:43606) 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.266+0000 7fa57fe00640 1 -- 172.21.15.1:0/3258030137 learned_addr learned my addr 172.21.15.1:0/3258030137 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.267+0000 7fa57f400640 1 -- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 msgr2=0x558061bfda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.267+0000 7fa57f400640 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 0x558061bfda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.267+0000 7fa57f400640 1 -- 172.21.15.1:0/3258030137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 msgr2=0x558061bfe5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.267+0000 7fa57f400640 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfe5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.267+0000 7fa57f400640 1 -- 172.21.15.1:0/3258030137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580618b9790 con 0x5580618252f0 2024-08-28T20:21:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.267+0000 7fa57ea00640 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 0x558061bfda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:21:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.268+0000 7fa57f400640 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061bfd3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa578009c20 tx=0x7fa578004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89cbc5451adbadd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.268+0000 7fa568c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:21:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.269+0000 7fa568c00640 1 -- 172.21.15.1:0/3258030137 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578017050 con 0x5580618252f0 2024-08-28T20:21:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.270+0000 7fa568c00640 1 -- 172.21.15.1:0/3258030137 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa57801bbd0 con 0x5580618252f0 2024-08-28T20:21:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.270+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa578011c10 con 0x5580618252f0 2024-08-28T20:21:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.270+0000 7fa568c00640 1 -- 172.21.15.1:0/3258030137 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa578011e30 con 0x5580618252f0 2024-08-28T20:21:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.270+0000 7fa58cdfd740 10 client.25459 fetch_fsmap learned FSMap version 35 2024-08-28T20:21:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.270+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558061932620 con 0x5580618252f0 2024-08-28T20:21:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa568c00640 1 -- 172.21.15.1:0/3258030137 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa578011c10 con 0x5580618252f0 2024-08-28T20:21:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa568c00640 1 -- 172.21.15.1:0/3258030137 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 35) ==== 8358+0+0 (secure 0 0 0) 0x7fa5780052b0 con 0x5580618252f0 2024-08-28T20:21:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa58cdfd740 10 client.25459 fetch_fsmap finished waiting for FSMap version 35 2024-08-28T20:21:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa58cdfd740 10 client.25459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa58cdfd740 20 client.25459 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55806180cd80 0x558061c0aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa58cdfd740 4 client.25459 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:21:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.271+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558061b68ec0 con 0x55806180cd80 2024-08-28T20:21:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.272+0000 7fa57ea00640 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55806180cd80 0x558061c0aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.273+0000 7fa57ea00640 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55806180cd80 0x558061c0aab0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f0c26adf15b09c server_cookie=b1b197c7be03fb46 in_seq=0 out_seq=0 2024-08-28T20:21:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.273+0000 7fa568c00640 10 client.25459 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.274+0000 7fa568c00640 1 -- 172.21.15.1:0/3258030137 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558061b68ec0 con 0x55806180cd80 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.274+0000 7fa568c00640 10 client.25459 handle_command_reply: tid=0 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.274+0000 7fa58cdfd740 1 client.25459 shutdown 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 msgr2=0x558061bfd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061bfd3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa578009c20 tx=0x7fa578004c50 comp rx=0 tx=0).stop 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 shutdown_connections 2024-08-28T20:21:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55806180cd80 0x558061c0aab0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfe5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806182d4d0 0x558061bfda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/3258030137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061bfd3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 >> 172.21.15.1:0/3258030137 conn(0x558061842300 msgr2=0x558061bedd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa568c00640 0 client.25459 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 shutdown_connections 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 1 -- 172.21.15.1:0/3258030137 wait complete. 2024-08-28T20:21:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.275+0000 7fa58cdfd740 20 client.25459 trim_cache size 0 max 16384 2024-08-28T20:21:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.300+0000 7fa58cdfd740 1 Processor -- start 2024-08-28T20:21:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.301+0000 7fa58cdfd740 1 -- start start 2024-08-28T20:21:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.301+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.301+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806182d4d0 0x558061c054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.301+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa57f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa57f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bef110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43622/0 (socket says 172.21.15.1:43622) 2024-08-28T20:21:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa57f400640 1 -- 172.21.15.1:0/642802185 learned_addr learned my addr 172.21.15.1:0/642802185 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa560010dd0 con 0x55806184e1b0 2024-08-28T20:21:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa56000e640 con 0x5580618252f0 2024-08-28T20:21:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa56000c490 con 0x55806182d4d0 2024-08-28T20:21:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa57fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.302+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806182d4d0 0x558061c054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.303+0000 7fa57f400640 1 -- 172.21.15.1:0/642802185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806182d4d0 msgr2=0x558061c054d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.303+0000 7fa57f400640 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806182d4d0 0x558061c054d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.303+0000 7fa57f400640 1 -- 172.21.15.1:0/642802185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 msgr2=0x558061bfc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.303+0000 7fa57f400640 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.303+0000 7fa57f400640 1 -- 172.21.15.1:0/642802185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558061bfe960 con 0x5580618252f0 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.303+0000 7fa57f400640 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bef110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa578006010 tx=0x7fa578010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d910d1d8da4222df server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.304+0000 7fa56b400640 1 -- 172.21.15.1:0/642802185 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57803b070 con 0x5580618252f0 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.304+0000 7fa56b400640 1 -- 172.21.15.1:0/642802185 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa578003e20 con 0x5580618252f0 2024-08-28T20:21:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.304+0000 7fa56b400640 1 -- 172.21.15.1:0/642802185 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578017070 con 0x5580618252f0 2024-08-28T20:21:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 msgr2=0x558061bef110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bef110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa578006010 tx=0x7fa578010940 comp rx=0 tx=0).stop 2024-08-28T20:21:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 shutdown_connections 2024-08-28T20:21:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806184e1b0 0x558061bfc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55806182d4d0 0x558061c054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/642802185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580618252f0 0x558061bef110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.306+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 >> 172.21.15.1:0/642802185 conn(0x558061842300 msgr2=0x558061bfbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.307+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 shutdown_connections 2024-08-28T20:21:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.307+0000 7fa58cdfd740 1 -- 172.21.15.1:0/642802185 wait complete. 2024-08-28T20:21:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.307+0000 7fa58cdfd740 1 -- start start 2024-08-28T20:21:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.308+0000 7fa58cdfd740 1 Processor -- start 2024-08-28T20:21:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.309+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061c04e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.309+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061c03b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.309+0000 7fa58cdfd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806184e1b0 0x558061c04040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.309+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa56000cb00 con 0x55806182d4d0 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa56000df70 con 0x55806184e1b0 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa58cdfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa56000d1d0 con 0x5580618252f0 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa58cdfd740 10 client.0 _ll_register_callbacks cb 0x7fa56c0095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061c03b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061c03b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53980/0 (socket says 172.21.15.1:53980) 2024-08-28T20:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 -- 172.21.15.1:0/701303198 learned_addr learned my addr 172.21.15.1:0/701303198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 -- 172.21.15.1:0/701303198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 msgr2=0x558061c04e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061c04e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 -- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806184e1b0 msgr2=0x558061c04040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806184e1b0 0x558061c04040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.310+0000 7fa57ea00640 1 -- 172.21.15.1:0/701303198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558061c04580 con 0x55806182d4d0 2024-08-28T20:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.311+0000 7fa57ea00640 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061c03b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0cd040 tx=0x7fa56c0d6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5238c09acef858be server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.311+0000 7fa568c00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.312+0000 7fa568c00640 1 -- 172.21.15.1:0/701303198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c1034e0 con 0x55806182d4d0 2024-08-28T20:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.312+0000 7fa568c00640 1 -- 172.21.15.1:0/701303198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa56c031e00 con 0x55806182d4d0 2024-08-28T20:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.312+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa578003e20 con 0x55806182d4d0 2024-08-28T20:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.313+0000 7fa568c00640 1 -- 172.21.15.1:0/701303198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa56c07d050 con 0x55806182d4d0 2024-08-28T20:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.313+0000 7fa58cdfd740 10 client.15378 fetch_fsmap learned FSMap version 35 2024-08-28T20:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.313+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558061c033b0 con 0x55806182d4d0 2024-08-28T20:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.314+0000 7fa568c00640 1 -- 172.21.15.1:0/701303198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa578003e20 con 0x55806182d4d0 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa568c00640 1 -- 172.21.15.1:0/701303198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 35) ==== 8358+0+0 (secure 0 0 0) 0x7fa56c038370 con 0x55806182d4d0 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa58cdfd740 10 client.15378 fetch_fsmap finished waiting for FSMap version 35 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa58cdfd740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa58cdfd740 20 client.15378 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5580617e21c0 0x558061c77aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa58cdfd740 4 client.15378 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:21:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.316+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558061b64960 con 0x5580617e21c0 2024-08-28T20:21:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.318+0000 7fa57f400640 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5580617e21c0 0x558061c77aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.321+0000 7fa57f400640 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5580617e21c0 0x558061c77aa0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f925bd185660e3 server_cookie=3a9ee99f437ce609 in_seq=0 out_seq=0 2024-08-28T20:21:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.321+0000 7fa568c00640 10 client.15378 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.352+0000 7fa568c00640 1 -- 172.21.15.1:0/701303198 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558061b64960 con 0x5580617e21c0 2024-08-28T20:21:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.352+0000 7fa568c00640 10 client.15378 handle_command_reply: tid=0 2024-08-28T20:21:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.352+0000 7fa58cdfd740 1 client.15378 shutdown 2024-08-28T20:21:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 msgr2=0x558061c03b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061c03b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0cd040 tx=0x7fa56c0d6040 comp rx=0 tx=0).stop 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 shutdown_connections 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5580617e21c0 0x558061c77aa0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa568c00640 0 client.15378 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55806182d4d0 0x558061c03b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55806184e1b0 0x558061c04040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 --2- 172.21.15.1:0/701303198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580618252f0 0x558061c04e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 >> 172.21.15.1:0/701303198 conn(0x558061842300 msgr2=0x558061bf0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 shutdown_connections 2024-08-28T20:21:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.353+0000 7fa58cdfd740 1 -- 172.21.15.1:0/701303198 wait complete. 2024-08-28T20:21:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.354+0000 7fa58cdfd740 20 client.15378 trim_cache size 0 max 16384 2024-08-28T20:21:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:21:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:21:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:21:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:21:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5640b4c50 msgr2=0x7fa5640b7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5640b4c50 0x7fa5640b7160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa570009dd0 tx=0x7fa570009770 comp rx=0 tx=0).stop 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 msgr2=0x7fa5801a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 0x7fa5801a0910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa56c02aa00 tx=0x7fa56c003c10 comp rx=0 tx=0).stop 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 shutdown_connections 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5640b4c50 0x7fa5640b7160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5801a13a0 0x7fa5801a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa580103b90 0x7fa5801a0910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 --2- 172.21.15.1:0/1533633206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa580102170 0x7fa5801a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.355+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 >> 172.21.15.1:0/1533633206 conn(0x7fa5800fdab0 msgr2=0x7fa58010f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.356+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 shutdown_connections 2024-08-28T20:21:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:41.356+0000 7fa584c00640 1 -- 172.21.15.1:0/1533633206 wait complete. 2024-08-28T20:21:41.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:41 smithi001 ceph-mon[20984]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 MiB/s wr, 781 op/s 2024-08-28T20:21:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:41 smithi121 ceph-mon[25248]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 MiB/s wr, 781 op/s 2024-08-28T20:21:42.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:41 smithi007 ceph-mon[25357]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 MiB/s wr, 781 op/s 2024-08-28T20:21:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 195.0 s, 2454.6 tps, lat 40.816 ms stddev 52.325 2024-08-28T20:21:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:43 smithi001 ceph-mon[20984]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 683 op/s 2024-08-28T20:21:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:43 smithi121 ceph-mon[25248]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 683 op/s 2024-08-28T20:21:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:43 smithi007 ceph-mon[25357]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 683 op/s 2024-08-28T20:21:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:45 smithi001 ceph-mon[20984]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 793 op/s 2024-08-28T20:21:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:45 smithi121 ceph-mon[25248]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 793 op/s 2024-08-28T20:21:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:45 smithi007 ceph-mon[25357]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 793 op/s 2024-08-28T20:21:46.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:46 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:46.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:46 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:47.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:46 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:21:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:47 smithi001 ceph-mon[20984]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 715 op/s 2024-08-28T20:21:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:47 smithi121 ceph-mon[25248]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 715 op/s 2024-08-28T20:21:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:47 smithi007 ceph-mon[25357]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 715 op/s 2024-08-28T20:21:48.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 200.0 s, 914.7 tps, lat 54.827 ms stddev 126.779 2024-08-28T20:21:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:49 smithi001 ceph-mon[20984]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 859 op/s 2024-08-28T20:21:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:49 smithi121 ceph-mon[25248]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 859 op/s 2024-08-28T20:21:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:49 smithi007 ceph-mon[25357]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 859 op/s 2024-08-28T20:21:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:51 smithi001 ceph-mon[20984]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 1.19k op/s 2024-08-28T20:21:52.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:51 smithi007 ceph-mon[25357]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 1.19k op/s 2024-08-28T20:21:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:51 smithi121 ceph-mon[25248]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 1.19k op/s 2024-08-28T20:21:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 205.0 s, 1081.8 tps, lat 137.541 ms stddev 574.245 2024-08-28T20:21:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:53 smithi007 ceph-mon[25357]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 1.25k op/s 2024-08-28T20:21:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:53 smithi001 ceph-mon[20984]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 1.25k op/s 2024-08-28T20:21:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:53 smithi121 ceph-mon[25248]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 1.25k op/s 2024-08-28T20:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.656+0000 7fe42ac00640 1 -- 172.21.15.1:0/3237972611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 msgr2=0x7fe4241060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.656+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3237972611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe4241060a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe414009900 tx=0x7fe41402a400 comp rx=0 tx=0).stop 2024-08-28T20:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 -- 172.21.15.1:0/3237972611 shutdown_connections 2024-08-28T20:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3237972611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4241065e0 0x7fe424108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3237972611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe42410b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3237972611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe4241060a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 -- 172.21.15.1:0/3237972611 >> 172.21.15.1:0/3237972611 conn(0x7fe4240fdca0 msgr2=0x7fe424100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 -- 172.21.15.1:0/3237972611 shutdown_connections 2024-08-28T20:21:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.657+0000 7fe42ac00640 1 -- 172.21.15.1:0/3237972611 wait complete. 2024-08-28T20:21:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.658+0000 7fe42ac00640 1 Processor -- start 2024-08-28T20:21:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.658+0000 7fe42ac00640 1 -- start start 2024-08-28T20:21:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe42ac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe424105570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe42ac00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4241065e0 0x7fe424105be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe42ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe4241a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe42ac00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410f0c0 con 0x7fe4241065e0 2024-08-28T20:21:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe42ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410ef40 con 0x7fe4241091a0 2024-08-28T20:21:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe42ac00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410f240 con 0x7fe42406b620 2024-08-28T20:21:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe423e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe424105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe428c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe4241a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe428c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe4241a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52476/0 (socket says 172.21.15.1:52476) 2024-08-28T20:21:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe428c00640 1 -- 172.21.15.1:0/3611400596 learned_addr learned my addr 172.21.15.1:0/3611400596 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.659+0000 7fe423e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe424105570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40916/0 (socket says 172.21.15.1:40916) 2024-08-28T20:21:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.660+0000 7fe428c00640 1 -- 172.21.15.1:0/3611400596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 msgr2=0x7fe424105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.660+0000 7fe428c00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe424105570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.660+0000 7fe428c00640 1 -- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4241065e0 msgr2=0x7fe424105be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.660+0000 7fe428c00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4241065e0 0x7fe424105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.660+0000 7fe428c00640 1 -- 172.21.15.1:0/3611400596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4241a1d60 con 0x7fe4241091a0 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.660+0000 7fe428c00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe4241a1540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00eb10 tx=0x7fe41c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.661+0000 7fe420c00640 1 -- 172.21.15.1:0/3611400596 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c004b20 con 0x7fe4241091a0 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.661+0000 7fe420c00640 1 -- 172.21.15.1:0/3611400596 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe41c004cc0 con 0x7fe4241091a0 2024-08-28T20:21:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.661+0000 7fe420c00640 1 -- 172.21.15.1:0/3611400596 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c010670 con 0x7fe4241091a0 2024-08-28T20:21:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.661+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4241a2050 con 0x7fe4241091a0 2024-08-28T20:21:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.661+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4241a8740 con 0x7fe4241091a0 2024-08-28T20:21:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.665+0000 7fe4317fd740 1 Processor -- start 2024-08-28T20:21:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.667+0000 7fe420c00640 1 -- 172.21.15.1:0/3611400596 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fe41c005020 con 0x7fe4241091a0 2024-08-28T20:21:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.667+0000 7fe4317fd740 1 -- start start 2024-08-28T20:21:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e1fa2f0 0x55606e5c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2024d0 0x55606e5c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe4317fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55606e53bf70 con 0x55606e1fa2f0 2024-08-28T20:21:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe4317fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55606e52b500 con 0x55606e2231b0 2024-08-28T20:21:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe4317fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55606e52f4b0 con 0x55606e2024d0 2024-08-28T20:21:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.668+0000 7fe423400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52488/0 (socket says 172.21.15.1:52488) 2024-08-28T20:21:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 -- 172.21.15.1:0/3588230735 learned_addr learned my addr 172.21.15.1:0/3588230735 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2024d0 0x55606e5c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423e00640 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e1fa2f0 0x55606e5c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 -- 172.21.15.1:0/3588230735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2024d0 msgr2=0x55606e5c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2024d0 0x55606e5c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 -- 172.21.15.1:0/3588230735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e1fa2f0 msgr2=0x55606e5c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e1fa2f0 0x55606e5c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe423400640 1 -- 172.21.15.1:0/3588230735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606e4e5c10 con 0x55606e2231b0 2024-08-28T20:21:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe420c00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe4080b4bb0 0x7fe4080b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.669+0000 7fe420c00640 1 -- 172.21.15.1:0/3611400596 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe41c0e5750 con 0x7fe4241091a0 2024-08-28T20:21:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.670+0000 7fe423400640 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5c8dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe410013800 tx=0x7fe4100095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e03241e488ae41 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.670+0000 7fe419200640 1 -- 172.21.15.1:0/3588230735 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410013e40 con 0x55606e2231b0 2024-08-28T20:21:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.670+0000 7fe419200640 1 -- 172.21.15.1:0/3588230735 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe41000e750 con 0x55606e2231b0 2024-08-28T20:21:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.670+0000 7fe419200640 1 -- 172.21.15.1:0/3588230735 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410003850 con 0x55606e2231b0 2024-08-28T20:21:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.671+0000 7fe423e00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe4080b4bb0 0x7fe4080b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.671+0000 7fe4317fd740 1 -- 172.21.15.1:0/3588230735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 msgr2=0x55606e5c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.672+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5c8dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe410013800 tx=0x7fe4100095b0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.672+0000 7fe4317fd740 1 -- 172.21.15.1:0/3588230735 shutdown_connections 2024-08-28T20:21:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.672+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e1fa2f0 0x55606e5c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.672+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2024d0 0x55606e5c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.672+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3588230735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5c8dc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.672+0000 7fe4317fd740 1 -- 172.21.15.1:0/3588230735 >> 172.21.15.1:0/3588230735 conn(0x55606e217300 msgr2=0x55606e5c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.673+0000 7fe4317fd740 1 -- 172.21.15.1:0/3588230735 shutdown_connections 2024-08-28T20:21:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.673+0000 7fe423e00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe4080b4bb0 0x7fe4080b70c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe414000c00 tx=0x7fe414031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.673+0000 7fe4317fd740 1 -- 172.21.15.1:0/3588230735 wait complete. 2024-08-28T20:21:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.674+0000 7fe4317fd740 1 -- start start 2024-08-28T20:21:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.674+0000 7fe4317fd740 1 Processor -- start 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2024d0 0x55606e5d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2231b0 0x55606e5d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55606e464ab0 con 0x55606e2231b0 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55606e4d2320 con 0x55606e2024d0 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55606e5caa40 con 0x55606e1fa2f0 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.675+0000 7fe4317fd740 10 client.0 _ll_register_callbacks cb 0x55606e4d86a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5d23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40938/0 (socket says 172.21.15.1:40938) 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 -- 172.21.15.1:0/3307362625 learned_addr learned my addr 172.21.15.1:0/3307362625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423400640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2024d0 0x55606e5d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe428c00640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2231b0 0x55606e5d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 -- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2024d0 msgr2=0x55606e5d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2024d0 0x55606e5d2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 -- 172.21.15.1:0/3307362625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2231b0 msgr2=0x55606e5d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2231b0 0x55606e5d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.676+0000 7fe423e00640 1 -- 172.21.15.1:0/3307362625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606e28e790 con 0x55606e1fa2f0 2024-08-28T20:21:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.677+0000 7fe423e00640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5d23c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe414033000 tx=0x7fe414009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed2abf716e5630b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.677+0000 7fe40d600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:21:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.677+0000 7fe40d600640 1 -- 172.21.15.1:0/3307362625 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41404e070 con 0x55606e1fa2f0 2024-08-28T20:21:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.678+0000 7fe40d600640 1 -- 172.21.15.1:0/3307362625 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe414003a00 con 0x55606e1fa2f0 2024-08-28T20:21:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.678+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe41000e750 con 0x55606e1fa2f0 2024-08-28T20:21:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.678+0000 7fe40d600640 1 -- 172.21.15.1:0/3307362625 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe41405a050 con 0x55606e1fa2f0 2024-08-28T20:21:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.678+0000 7fe4317fd740 10 client.25474 fetch_fsmap learned FSMap version 36 2024-08-28T20:21:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.678+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55606e307620 con 0x55606e1fa2f0 2024-08-28T20:21:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.678+0000 7fe40d600640 1 -- 172.21.15.1:0/3307362625 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe41000e750 con 0x55606e1fa2f0 2024-08-28T20:21:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.679+0000 7fe40d600640 1 -- 172.21.15.1:0/3307362625 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fe41403d450 con 0x55606e1fa2f0 2024-08-28T20:21:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.680+0000 7fe4317fd740 10 client.25474 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:21:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.680+0000 7fe4317fd740 10 client.25474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.680+0000 7fe4317fd740 20 client.25474 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.680+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1e1d80 0x55606e5dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.680+0000 7fe4317fd740 4 client.25474 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:21:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.680+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55606e53dec0 con 0x55606e1e1d80 2024-08-28T20:21:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.681+0000 7fe423400640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1e1d80 0x55606e5dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.682+0000 7fe423400640 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1e1d80 0x55606e5dfba0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b9481fa178b9a1 server_cookie=13b2ac9f9ffbda76 in_seq=0 out_seq=0 2024-08-28T20:21:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.682+0000 7fe40d600640 10 client.25474 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.683+0000 7fe40d600640 1 -- 172.21.15.1:0/3307362625 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55606e53dec0 con 0x55606e1e1d80 2024-08-28T20:21:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.683+0000 7fe40d600640 10 client.25474 handle_command_reply: tid=0 2024-08-28T20:21:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.683+0000 7fe4317fd740 1 client.25474 shutdown 2024-08-28T20:21:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.683+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 msgr2=0x55606e5d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.683+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5d23c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe414033000 tx=0x7fe414009260 comp rx=0 tx=0).stop 2024-08-28T20:21:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 shutdown_connections 2024-08-28T20:21:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1e1d80 0x55606e5dfba0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2231b0 0x55606e5d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2024d0 0x55606e5d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3307362625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5d23c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 >> 172.21.15.1:0/3307362625 conn(0x55606e217300 msgr2=0x55606e5c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe40d600640 0 client.25474 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.684+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 shutdown_connections 2024-08-28T20:21:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.685+0000 7fe4317fd740 1 -- 172.21.15.1:0/3307362625 wait complete. 2024-08-28T20:21:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.685+0000 7fe4317fd740 20 client.25474 trim_cache size 0 max 16384 2024-08-28T20:21:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.707+0000 7fe4317fd740 1 Processor -- start 2024-08-28T20:21:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.707+0000 7fe4317fd740 1 -- start start 2024-08-28T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe428c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe428c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52508/0 (socket says 172.21.15.1:52508) 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe423e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe4317fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241b3cd0 con 0x55606e2024d0 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe4317fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241b1540 con 0x55606e2231b0 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe4317fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241af390 con 0x55606e1fa2f0 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe423e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40944/0 (socket says 172.21.15.1:40944) 2024-08-28T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.708+0000 7fe423e00640 1 -- 172.21.15.1:0/1266368112 learned_addr learned my addr 172.21.15.1:0/1266368112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.709+0000 7fe423400640 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.709+0000 7fe423e00640 1 -- 172.21.15.1:0/1266368112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 msgr2=0x55606e5d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.709+0000 7fe423e00640 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.709+0000 7fe423e00640 1 -- 172.21.15.1:0/1266368112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 msgr2=0x55606e5c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.709+0000 7fe423e00640 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.709+0000 7fe423e00640 1 -- 172.21.15.1:0/1266368112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606e5d0590 con 0x55606e1fa2f0 2024-08-28T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.710+0000 7fe423e00640 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5cd790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe414009900 tx=0x7fe414005a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19940afc269863d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.711+0000 7fe40fe00640 1 -- 172.21.15.1:0/1266368112 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41404e070 con 0x55606e1fa2f0 2024-08-28T20:21:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.711+0000 7fe40fe00640 1 -- 172.21.15.1:0/1266368112 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe414003cb0 con 0x55606e1fa2f0 2024-08-28T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.712+0000 7fe40fe00640 1 -- 172.21.15.1:0/1266368112 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41404e070 con 0x55606e1fa2f0 2024-08-28T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.712+0000 7fe4317fd740 1 -- 172.21.15.1:0/1266368112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 msgr2=0x55606e5cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.712+0000 7fe4317fd740 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5cd790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe414009900 tx=0x7fe414005a40 comp rx=0 tx=0).stop 2024-08-28T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.712+0000 7fe4317fd740 1 -- 172.21.15.1:0/1266368112 shutdown_connections 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.712+0000 7fe4317fd740 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.712+0000 7fe4317fd740 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e2231b0 0x55606e5d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.713+0000 7fe4317fd740 1 --2- 172.21.15.1:0/1266368112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e1fa2f0 0x55606e5cd790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.713+0000 7fe4317fd740 1 -- 172.21.15.1:0/1266368112 >> 172.21.15.1:0/1266368112 conn(0x55606e217300 msgr2=0x55606e5c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.713+0000 7fe4317fd740 1 -- 172.21.15.1:0/1266368112 shutdown_connections 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.713+0000 7fe4317fd740 1 -- 172.21.15.1:0/1266368112 wait complete. 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.714+0000 7fe4317fd740 1 -- start start 2024-08-28T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.714+0000 7fe4317fd740 1 Processor -- start 2024-08-28T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.715+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e1fa2f0 0x55606e5d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.715+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5d60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.715+0000 7fe4317fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 0x55606e5d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.716+0000 7fe423e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e1fa2f0 0x55606e5d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.716+0000 7fe428c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 0x55606e5d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.716+0000 7fe428c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 0x55606e5d9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40960/0 (socket says 172.21.15.1:40960) 2024-08-28T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.716+0000 7fe423e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e1fa2f0 0x55606e5d59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52510/0 (socket says 172.21.15.1:52510) 2024-08-28T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe428c00640 1 -- 172.21.15.1:0/3713477477 learned_addr learned my addr 172.21.15.1:0/3713477477 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241afa00 con 0x55606e2024d0 2024-08-28T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241b0e70 con 0x55606e1fa2f0 2024-08-28T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241b00d0 con 0x55606e2231b0 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe428c00640 1 -- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e1fa2f0 msgr2=0x55606e5d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe428c00640 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e1fa2f0 0x55606e5d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe428c00640 1 -- 172.21.15.1:0/3713477477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 msgr2=0x55606e5d60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe428c00640 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5d60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe428c00640 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606e5da400 con 0x55606e2231b0 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe4317fd740 10 client.0 _ll_register_callbacks cb 0x7fe414031650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.717+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe414003cb0 con 0x55606e2231b0 2024-08-28T20:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.718+0000 7fe428c00640 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 0x55606e5d9ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0abe10 tx=0x7fe41c0abad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6874bc65ee4f13d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.718+0000 7fe40d600640 10 client.25480 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.718+0000 7fe40d600640 1 -- 172.21.15.1:0/3713477477 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0ac110 con 0x55606e2231b0 2024-08-28T20:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.719+0000 7fe40d600640 1 -- 172.21.15.1:0/3713477477 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe41c0b51b0 con 0x55606e2231b0 2024-08-28T20:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.719+0000 7fe40d600640 1 -- 172.21.15.1:0/3713477477 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe41c0b0980 con 0x55606e2231b0 2024-08-28T20:21:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.719+0000 7fe4317fd740 10 client.25480 fetch_fsmap learned FSMap version 36 2024-08-28T20:21:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.719+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55606e5d77c0 con 0x55606e2231b0 2024-08-28T20:21:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe40d600640 1 -- 172.21.15.1:0/3713477477 <== mon.1 v2:172.21.15.121:3300/0 4 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fe41c0ab370 con 0x55606e2231b0 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe4317fd740 10 client.25480 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe4317fd740 10 client.25480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe4317fd740 20 client.25480 populate_metadata read hostname 'smithi001' 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1b71c0 0x55606e64cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe4317fd740 4 client.25480 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55606e539960 con 0x55606e1b71c0 2024-08-28T20:21:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.720+0000 7fe423e00640 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1b71c0 0x55606e64cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:21:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.721+0000 7fe423e00640 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1b71c0 0x55606e64cd10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=493e920730d11cc0 server_cookie=73b219211458e575 in_seq=0 out_seq=0 2024-08-28T20:21:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.721+0000 7fe40d600640 10 client.25480 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.747+0000 7fe40d600640 1 -- 172.21.15.1:0/3713477477 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55606e539960 con 0x55606e1b71c0 2024-08-28T20:21:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.747+0000 7fe40d600640 10 client.25480 handle_command_reply: tid=0 2024-08-28T20:21:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.747+0000 7fe4317fd740 1 client.25480 shutdown 2024-08-28T20:21:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 msgr2=0x55606e5d9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 0x55606e5d9ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0abe10 tx=0x7fe41c0abad0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 shutdown_connections 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55606e1b71c0 0x55606e64cd10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55606e2024d0 0x55606e5d60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55606e2231b0 0x55606e5d9ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 --2- 172.21.15.1:0/3713477477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55606e1fa2f0 0x55606e5d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 >> 172.21.15.1:0/3713477477 conn(0x55606e217300 msgr2=0x55606e5d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe40d600640 0 client.25480 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 shutdown_connections 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.748+0000 7fe4317fd740 1 -- 172.21.15.1:0/3713477477 wait complete. 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.749+0000 7fe4317fd740 20 client.25480 trim_cache size 0 max 16384 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:21:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe4080b4bb0 msgr2=0x7fe4080b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe4080b4bb0 0x7fe4080b70c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe414000c00 tx=0x7fe414031400 comp rx=0 tx=0).stop 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 msgr2=0x7fe4241a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe4241a1540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00eb10 tx=0x7fe41c00c2d0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 shutdown_connections 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe4080b4bb0 0x7fe4080b70c0 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe414000c00 tx=0x7fe414031400 comp rx=0 tx=0).stop 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4241065e0 0x7fe424105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4241091a0 0x7fe4241a1540 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 --2- 172.21.15.1:0/3611400596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42406b620 0x7fe424105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:21:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 >> 172.21.15.1:0/3611400596 conn(0x7fe4240fdca0 msgr2=0x7fe4241000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:21:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 shutdown_connections 2024-08-28T20:21:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:21:54.750+0000 7fe42ac00640 1 -- 172.21.15.1:0/3611400596 wait complete. 2024-08-28T20:21:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:55 smithi007 ceph-mon[25357]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 1.46k op/s 2024-08-28T20:21:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:55 smithi001 ceph-mon[20984]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 1.46k op/s 2024-08-28T20:21:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:55 smithi121 ceph-mon[25248]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 1.46k op/s 2024-08-28T20:21:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:57 smithi007 ceph-mon[25357]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 MiB/s wr, 1.45k op/s 2024-08-28T20:21:58.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:57 smithi001 ceph-mon[20984]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 MiB/s wr, 1.45k op/s 2024-08-28T20:21:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:57 smithi121 ceph-mon[25248]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 MiB/s wr, 1.45k op/s 2024-08-28T20:21:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 210.0 s, 2906.8 tps, lat 34.758 ms stddev 45.097 2024-08-28T20:22:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:21:59 smithi007 ceph-mon[25357]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 39 MiB/s wr, 1.49k op/s 2024-08-28T20:22:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:21:59 smithi001 ceph-mon[20984]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 39 MiB/s wr, 1.49k op/s 2024-08-28T20:22:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:21:59 smithi121 ceph-mon[25248]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 39 MiB/s wr, 1.49k op/s 2024-08-28T20:22:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:01 smithi007 ceph-mon[25357]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 1.40k op/s 2024-08-28T20:22:02.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:01 smithi001 ceph-mon[20984]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 1.40k op/s 2024-08-28T20:22:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:01 smithi121 ceph-mon[25248]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 1.40k op/s 2024-08-28T20:22:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 215.0 s, 2724.0 tps, lat 36.687 ms stddev 44.859 2024-08-28T20:22:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:03 smithi007 ceph-mon[25357]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 1.06k op/s 2024-08-28T20:22:04.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:03 smithi001 ceph-mon[20984]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 1.06k op/s 2024-08-28T20:22:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:03 smithi121 ceph-mon[25248]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 1.06k op/s 2024-08-28T20:22:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:05 smithi007 ceph-mon[25357]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-08-28T20:22:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:05 smithi001 ceph-mon[20984]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-08-28T20:22:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:05 smithi121 ceph-mon[25248]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-08-28T20:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.056+0000 7f2ea4c00640 1 -- 172.21.15.1:0/4176569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0106640 msgr2=0x7f2ea0108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.056+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/4176569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0106640 0x7f2ea0108a60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e9002a400 comp rx=0 tx=0).stop 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.057+0000 7f2ea4c00640 1 -- 172.21.15.1:0/4176569510 shutdown_connections 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.057+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/4176569510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea01091a0 0x7f2ea010b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.057+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/4176569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea0106640 0x7f2ea0108a60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.057+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/4176569510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 0x7f2ea0106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.057+0000 7f2ea4c00640 1 -- 172.21.15.1:0/4176569510 >> 172.21.15.1:0/4176569510 conn(0x7f2ea00fdca0 msgr2=0x7f2ea0100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.058+0000 7f2ea4c00640 1 -- 172.21.15.1:0/4176569510 shutdown_connections 2024-08-28T20:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.058+0000 7f2ea4c00640 1 -- 172.21.15.1:0/4176569510 wait complete. 2024-08-28T20:22:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.059+0000 7f2ea4c00640 1 Processor -- start 2024-08-28T20:22:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.059+0000 7f2ea4c00640 1 -- start start 2024-08-28T20:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2ea4c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 0x7f2ea0199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2ea4c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 0x7f2ea019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2ea4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea01091a0 0x7f2ea019aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2ea4c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea010f110 con 0x7f2ea006b5c0 2024-08-28T20:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2ea4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea010ef90 con 0x7f2ea01091a0 2024-08-28T20:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2ea4c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea010f290 con 0x7f2ea0106640 2024-08-28T20:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 0x7f2ea019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 0x7f2ea019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33260/0 (socket says 172.21.15.1:33260) 2024-08-28T20:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.060+0000 7f2e9d400640 1 -- 172.21.15.1:0/3688193281 learned_addr learned my addr 172.21.15.1:0/3688193281 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9e800640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea01091a0 0x7f2ea019aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9de00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 0x7f2ea0199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9d400640 1 -- 172.21.15.1:0/3688193281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea01091a0 msgr2=0x7f2ea019aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9d400640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea01091a0 0x7f2ea019aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9d400640 1 -- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 msgr2=0x7f2ea0199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9d400640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 0x7f2ea0199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9d400640 1 -- 172.21.15.1:0/3688193281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea019b670 con 0x7f2ea0106640 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.061+0000 7f2e9de00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 0x7f2ea0199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.062+0000 7f2e9d400640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 0x7f2ea019a330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e90031440 tx=0x7f2e90003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.062+0000 7f2e96a00640 1 -- 172.21.15.1:0/3688193281 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9003f070 con 0x7f2ea0106640 2024-08-28T20:22:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.062+0000 7f2e96a00640 1 -- 172.21.15.1:0/3688193281 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e90031c50 con 0x7f2ea0106640 2024-08-28T20:22:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.062+0000 7f2e96a00640 1 -- 172.21.15.1:0/3688193281 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90035030 con 0x7f2ea0106640 2024-08-28T20:22:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.062+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea019b900 con 0x7f2ea0106640 2024-08-28T20:22:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.063+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea0101ee0 con 0x7f2ea0106640 2024-08-28T20:22:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:07 smithi007 ceph-mon[25357]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 829 op/s 2024-08-28T20:22:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.067+0000 7f2eabbcc740 1 Processor -- start 2024-08-28T20:22:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 -- start start 2024-08-28T20:22:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a195c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dc64d0 0x55b19a196790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b19a0fff70 con 0x55b199dc64d0 2024-08-28T20:22:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b19a0ef500 con 0x55b199dbe2f0 2024-08-28T20:22:08.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.068+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b19a0f34b0 con 0x55b199de71b0 2024-08-28T20:22:08.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a1955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33264/0 (socket says 172.21.15.1:33264) 2024-08-28T20:22:08.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 -- 172.21.15.1:0/3041197356 learned_addr learned my addr 172.21.15.1:0/3041197356 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:08.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e96a00640 1 -- 172.21.15.1:0/3688193281 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f2e90042070 con 0x7f2ea0106640 2024-08-28T20:22:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9de00640 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 -- 172.21.15.1:0/3041197356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 msgr2=0x55b19a195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 -- 172.21.15.1:0/3041197356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dc64d0 msgr2=0x55b19a196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.069+0000 7f2e9e800640 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dc64d0 0x55b19a196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.070+0000 7f2e9e800640 1 -- 172.21.15.1:0/3041197356 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19a0a9c10 con 0x55b199de71b0 2024-08-28T20:22:08.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.070+0000 7f2e9e800640 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a1955d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00cbe0 tx=0x7f2e8c00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5943f61194c609b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:08.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.071+0000 7f2e8b000640 1 -- 172.21.15.1:0/3041197356 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c005220 con 0x55b199de71b0 2024-08-28T20:22:08.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.071+0000 7f2e8b000640 1 -- 172.21.15.1:0/3041197356 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e8c004c50 con 0x55b199de71b0 2024-08-28T20:22:08.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.071+0000 7f2e8b000640 1 -- 172.21.15.1:0/3041197356 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c010790 con 0x55b199de71b0 2024-08-28T20:22:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.071+0000 7f2e96a00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bf0 0x7f2e840b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.071+0000 7f2e96a00640 1 -- 172.21.15.1:0/3688193281 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2e90105f60 con 0x7f2ea0106640 2024-08-28T20:22:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.072+0000 7f2e9de00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bf0 0x7f2e840b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.073+0000 7f2eabbcc740 1 -- 172.21.15.1:0/3041197356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 msgr2=0x55b19a1955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.073+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a1955d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00cbe0 tx=0x7f2e8c00e720 comp rx=0 tx=0).stop 2024-08-28T20:22:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.073+0000 7f2e9de00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bf0 0x7f2e840b7100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e98007f70 tx=0x7f2e98007560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 -- 172.21.15.1:0/3041197356 shutdown_connections 2024-08-28T20:22:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dc64d0 0x55b19a196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/3041197356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a1955d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 -- 172.21.15.1:0/3041197356 >> 172.21.15.1:0/3041197356 conn(0x55b199ddb300 msgr2=0x55b19a188850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 -- 172.21.15.1:0/3041197356 shutdown_connections 2024-08-28T20:22:08.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.074+0000 7f2eabbcc740 1 -- 172.21.15.1:0/3041197356 wait complete. 2024-08-28T20:22:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.075+0000 7f2eabbcc740 1 -- start start 2024-08-28T20:22:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.075+0000 7f2eabbcc740 1 Processor -- start 2024-08-28T20:22:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.076+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a18e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.076+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a18e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.076+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199de71b0 0x55b19a18f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a18e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a18e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33278/0 (socket says 172.21.15.1:33278) 2024-08-28T20:22:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b19a028ab0 con 0x55b199de71b0 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a18e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b19a096320 con 0x55b199dbe2f0 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b19a1972b0 con 0x55b199dc64d0 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a18e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47680/0 (socket says 172.21.15.1:47680) 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 -- 172.21.15.1:0/692718087 learned_addr learned my addr 172.21.15.1:0/692718087 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2eabbcc740 10 client.0 _ll_register_callbacks cb 0x55b19a09c6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9e800640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199de71b0 0x55b19a18f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 -- 172.21.15.1:0/692718087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 msgr2=0x55b19a18e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a18e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 -- 172.21.15.1:0/692718087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199de71b0 msgr2=0x55b19a18f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199de71b0 0x55b19a18f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9de00640 1 -- 172.21.15.1:0/692718087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b199e52790 con 0x55b199dbe2f0 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.077+0000 7f2e9d400640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a18e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.078+0000 7f2e9e800640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199de71b0 0x55b19a18f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.078+0000 7f2e9de00640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a18e090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e98007bb0 tx=0x7f2e98004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658acf83e251f6e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.078+0000 7f2e7f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.078+0000 7f2e7f400640 1 -- 172.21.15.1:0/692718087 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9801e620 con 0x55b199dbe2f0 2024-08-28T20:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.078+0000 7f2e7f400640 1 -- 172.21.15.1:0/692718087 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2e9801e7c0 con 0x55b199dbe2f0 2024-08-28T20:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.079+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e8c004c50 con 0x55b199dbe2f0 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.079+0000 7f2e7f400640 1 -- 172.21.15.1:0/692718087 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2e9801e9c0 con 0x55b199dbe2f0 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.079+0000 7f2eabbcc740 10 client.25508 fetch_fsmap learned FSMap version 36 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.079+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b199ecb620 con 0x55b199dbe2f0 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.079+0000 7f2e7f400640 1 -- 172.21.15.1:0/692718087 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e8c004c50 con 0x55b199dbe2f0 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2e7f400640 1 -- 172.21.15.1:0/692718087 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f2e98030bc0 con 0x55b199dbe2f0 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2eabbcc740 10 client.25508 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2eabbcc740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2eabbcc740 20 client.25508 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199da5d80 0x55b19a1b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2eabbcc740 4 client.25508 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b19a101ec0 con 0x55b199da5d80 2024-08-28T20:22:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.080+0000 7f2e9d400640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199da5d80 0x55b19a1b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.081+0000 7f2e7f400640 10 client.25508 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:08.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.081+0000 7f2e9d400640 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199da5d80 0x55b19a1b4ca0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6130909df2382d8 server_cookie=5aa740cb4a8240e9 in_seq=0 out_seq=0 2024-08-28T20:22:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.082+0000 7f2e7f400640 1 -- 172.21.15.1:0/692718087 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b19a101ec0 con 0x55b199da5d80 2024-08-28T20:22:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.082+0000 7f2e7f400640 10 client.25508 handle_command_reply: tid=0 2024-08-28T20:22:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.083+0000 7f2eabbcc740 1 client.25508 shutdown 2024-08-28T20:22:08.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.083+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 msgr2=0x55b19a18e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.083+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a18e090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e98007bb0 tx=0x7f2e98004a40 comp rx=0 tx=0).stop 2024-08-28T20:22:08.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 shutdown_connections 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199da5d80 0x55b19a1b4ca0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199de71b0 0x55b19a18f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a18e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/692718087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dbe2f0 0x55b19a18e090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 >> 172.21.15.1:0/692718087 conn(0x55b199ddb300 msgr2=0x55b19a186cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2e7f400640 0 client.25508 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 shutdown_connections 2024-08-28T20:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.084+0000 7f2eabbcc740 1 -- 172.21.15.1:0/692718087 wait complete. 2024-08-28T20:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.085+0000 7f2eabbcc740 20 client.25508 trim_cache size 0 max 16384 2024-08-28T20:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.118+0000 7f2eabbcc740 1 Processor -- start 2024-08-28T20:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.119+0000 7f2eabbcc740 1 -- start start 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.119+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a186cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.119+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 0x55b19a188190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.119+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a18dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01ab3a0 con 0x55b199dbe2f0 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01a8c10 con 0x55b199dc64d0 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01a6a60 con 0x55b199de71b0 2024-08-28T20:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 0x55b19a188190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 0x55b19a188190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47682/0 (socket says 172.21.15.1:47682) 2024-08-28T20:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2e9d400640 1 -- 172.21.15.1:0/1111353202 learned_addr learned my addr 172.21.15.1:0/1111353202 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2e9e800640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a18dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.120+0000 7f2e9de00640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a186cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9d400640 1 -- 172.21.15.1:0/1111353202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 msgr2=0x55b19a18dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9d400640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a18dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9d400640 1 -- 172.21.15.1:0/1111353202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 msgr2=0x55b19a186cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9d400640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a186cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9d400640 1 -- 172.21.15.1:0/1111353202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19a196bd0 con 0x55b199dc64d0 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9e800640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a18dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9de00640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a186cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.121+0000 7f2e9d400640 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 0x55b19a188190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e900c9b00 tx=0x7f2e900c8870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac6e90006bcc44e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.122+0000 7f2e8a600640 1 -- 172.21.15.1:0/1111353202 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90049040 con 0x55b199dc64d0 2024-08-28T20:22:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.122+0000 7f2e8a600640 1 -- 172.21.15.1:0/1111353202 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e900cd020 con 0x55b199dc64d0 2024-08-28T20:22:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.122+0000 7f2e8a600640 1 -- 172.21.15.1:0/1111353202 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9003b560 con 0x55b199dc64d0 2024-08-28T20:22:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1111353202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 msgr2=0x55b19a188190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 0x55b19a188190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e900c9b00 tx=0x7f2e900c8870 comp rx=0 tx=0).stop 2024-08-28T20:22:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1111353202 shutdown_connections 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199de71b0 0x55b19a18dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199dc64d0 0x55b19a188190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1111353202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a186cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.123+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1111353202 >> 172.21.15.1:0/1111353202 conn(0x55b199ddb300 msgr2=0x55b19a18d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.124+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1111353202 shutdown_connections 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.124+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1111353202 wait complete. 2024-08-28T20:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.125+0000 7f2eabbcc740 1 -- start start 2024-08-28T20:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.125+0000 7f2eabbcc740 1 Processor -- start 2024-08-28T20:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.127+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a1c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.127+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a1c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.127+0000 7f2eabbcc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 0x55b19a1c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a1c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2e9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 0x55b19a1c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2e9d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a1c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33294/0 (socket says 172.21.15.1:33294) 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2e9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 0x55b19a1c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47692/0 (socket says 172.21.15.1:47692) 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2eabbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01a70d0 con 0x55b199dbe2f0 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01a8540 con 0x55b199de71b0 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2e9d400640 1 -- 172.21.15.1:0/1532527285 learned_addr learned my addr 172.21.15.1:0/1532527285 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea01a77a0 con 0x55b199dc64d0 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2eabbcc740 10 client.0 _ll_register_callbacks cb 0x7f2e98011b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.128+0000 7f2e9de00640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a1c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9e800640 1 -- 172.21.15.1:0/1532527285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 msgr2=0x55b19a1c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9e800640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a1c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9e800640 1 -- 172.21.15.1:0/1532527285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 msgr2=0x55b19a1c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9e800640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a1c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9d400640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a1c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9e800640 1 -- 172.21.15.1:0/1532527285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19a1c44f0 con 0x55b199de71b0 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9de00640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a1c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e9e800640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 0x55b19a1c6000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00f010 tx=0x7f2e8c00cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf6418a82bb9024 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e7f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.129+0000 7f2e7f400640 1 -- 172.21.15.1:0/1532527285 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c02a060 con 0x55b199de71b0 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.130+0000 7f2e7f400640 1 -- 172.21.15.1:0/1532527285 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f2e8c0037f0 con 0x55b199de71b0 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.130+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e900cd020 con 0x55b199de71b0 2024-08-28T20:22:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.130+0000 7f2e7f400640 1 -- 172.21.15.1:0/1532527285 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2e8c003a10 con 0x55b199de71b0 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.131+0000 7f2eabbcc740 10 client.25514 fetch_fsmap learned FSMap version 36 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.131+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b19a21f7c0 con 0x55b199de71b0 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.131+0000 7f2e7f400640 1 -- 172.21.15.1:0/1532527285 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e900cd020 con 0x55b199de71b0 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.131+0000 7f2e7f400640 1 -- 172.21.15.1:0/1532527285 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f2e8c024070 con 0x55b199de71b0 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2eabbcc740 10 client.25514 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2eabbcc740 10 client.25514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2eabbcc740 20 client.25514 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199d7b1c0 0x55b19a221e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2eabbcc740 4 client.25514 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b19a0fd960 con 0x55b199d7b1c0 2024-08-28T20:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.132+0000 7f2e9de00640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199d7b1c0 0x55b19a221e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.133+0000 7f2e7f400640 10 client.25514 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.133+0000 7f2e9de00640 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199d7b1c0 0x55b19a221e80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9bc1c6ef32acbf server_cookie=1eb6065405db7315 in_seq=0 out_seq=0 2024-08-28T20:22:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.151+0000 7f2e7f400640 1 -- 172.21.15.1:0/1532527285 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b19a0fd960 con 0x55b199d7b1c0 2024-08-28T20:22:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.151+0000 7f2e7f400640 10 client.25514 handle_command_reply: tid=0 2024-08-28T20:22:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.151+0000 7f2eabbcc740 1 client.25514 shutdown 2024-08-28T20:22:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.151+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 msgr2=0x55b19a1c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.151+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 0x55b19a1c6000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00f010 tx=0x7f2e8c00cb40 comp rx=0 tx=0).stop 2024-08-28T20:22:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 shutdown_connections 2024-08-28T20:22:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b199d7b1c0 0x55b19a221e80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b199de71b0 0x55b19a1c6000 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2e7f400640 0 client.25514 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b199dc64d0 0x55b19a1c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 --2- 172.21.15.1:0/1532527285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b199dbe2f0 0x55b19a1c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 >> 172.21.15.1:0/1532527285 conn(0x55b199ddb300 msgr2=0x55b19a188190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.152+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 shutdown_connections 2024-08-28T20:22:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.153+0000 7f2eabbcc740 1 -- 172.21.15.1:0/1532527285 wait complete. 2024-08-28T20:22:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.153+0000 7f2eabbcc740 20 client.25514 trim_cache size 0 max 16384 2024-08-28T20:22:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:22:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:22:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:22:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:22:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bf0 msgr2=0x7f2e840b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bf0 0x7f2e840b7100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e98007f70 tx=0x7f2e98007560 comp rx=0 tx=0).stop 2024-08-28T20:22:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 msgr2=0x7f2ea019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 0x7f2ea019a330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e90031440 tx=0x7f2e90003cf0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 shutdown_connections 2024-08-28T20:22:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f2e840b4bf0 0x7f2e840b7100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ea01091a0 0x7f2ea019aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea0106640 0x7f2ea019a330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 --2- 172.21.15.1:0/3688193281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ea006b5c0 0x7f2ea0199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.154+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 >> 172.21.15.1:0/3688193281 conn(0x7f2ea00fdca0 msgr2=0x7f2ea0104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.155+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 shutdown_connections 2024-08-28T20:22:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:08.155+0000 7f2ea4c00640 1 -- 172.21.15.1:0/3688193281 wait complete. 2024-08-28T20:22:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:07 smithi001 ceph-mon[20984]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 829 op/s 2024-08-28T20:22:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:07 smithi121 ceph-mon[25248]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 829 op/s 2024-08-28T20:22:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 220.0 s, 2892.0 tps, lat 34.548 ms stddev 42.015 2024-08-28T20:22:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:09 smithi007 ceph-mon[25357]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-08-28T20:22:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:09 smithi001 ceph-mon[20984]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-08-28T20:22:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:09 smithi121 ceph-mon[25248]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-08-28T20:22:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:11 smithi007 ceph-mon[25357]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 822 op/s 2024-08-28T20:22:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:11 smithi001 ceph-mon[20984]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 822 op/s 2024-08-28T20:22:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:11 smithi121 ceph-mon[25248]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 822 op/s 2024-08-28T20:22:13.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 225.0 s, 2760.8 tps, lat 36.192 ms stddev 42.093 2024-08-28T20:22:14.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:13 smithi001 ceph-mon[20984]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 758 op/s 2024-08-28T20:22:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:13 smithi121 ceph-mon[25248]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 758 op/s 2024-08-28T20:22:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:13 smithi007 ceph-mon[25357]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 758 op/s 2024-08-28T20:22:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:15 smithi001 ceph-mon[20984]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 789 op/s 2024-08-28T20:22:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:15 smithi121 ceph-mon[25248]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 789 op/s 2024-08-28T20:22:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:15 smithi007 ceph-mon[25357]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 789 op/s 2024-08-28T20:22:18.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:17 smithi001 ceph-mon[20984]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 759 op/s 2024-08-28T20:22:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:17 smithi121 ceph-mon[25248]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 759 op/s 2024-08-28T20:22:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:17 smithi007 ceph-mon[25357]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 759 op/s 2024-08-28T20:22:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 230.0 s, 2614.6 tps, lat 38.186 ms stddev 43.039 2024-08-28T20:22:20.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:19 smithi001 ceph-mon[20984]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 726 op/s 2024-08-28T20:22:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:19 smithi121 ceph-mon[25248]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 726 op/s 2024-08-28T20:22:20.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:19 smithi007 ceph-mon[25357]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 726 op/s 2024-08-28T20:22:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.470+0000 7f025c200640 1 -- 172.21.15.1:0/3972171252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f025410fbd0 msgr2=0x7f0254111ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.470+0000 7f025c200640 1 --2- 172.21.15.1:0/3972171252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f025410fbd0 0x7f0254111ff0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f024c009ca0 tx=0x7f024c02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.471+0000 7f025c200640 1 -- 172.21.15.1:0/3972171252 shutdown_connections 2024-08-28T20:22:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.471+0000 7f025c200640 1 --2- 172.21.15.1:0/3972171252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f025410fbd0 0x7f0254111ff0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.471+0000 7f025c200640 1 --2- 172.21.15.1:0/3972171252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 0x7f0254075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.471+0000 7f025c200640 1 --2- 172.21.15.1:0/3972171252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0254076e90 0x7f0254075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.471+0000 7f025c200640 1 -- 172.21.15.1:0/3972171252 >> 172.21.15.1:0/3972171252 conn(0x7f02540fed90 msgr2=0x7f0254101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.472+0000 7f025c200640 1 -- 172.21.15.1:0/3972171252 shutdown_connections 2024-08-28T20:22:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.473+0000 7f025c200640 1 -- 172.21.15.1:0/3972171252 wait complete. 2024-08-28T20:22:21.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.474+0000 7f025c200640 1 Processor -- start 2024-08-28T20:22:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.474+0000 7f025c200640 1 -- start start 2024-08-28T20:22:21.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.475+0000 7f025c200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 0x7f02541a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.475+0000 7f025c200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 0x7f02541a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.475+0000 7f025c200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f025410fbd0 0x7f02541a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.475+0000 7f025c200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02541156c0 con 0x7f025410fbd0 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.475+0000 7f025c200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0254115540 con 0x7f0254076e90 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.475+0000 7f025c200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0254115840 con 0x7f0254075a90 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0258e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 0x7f02541a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0259800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 0x7f02541a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f025a200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f025410fbd0 0x7f02541a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0258e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 0x7f02541a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34524/0 (socket says 172.21.15.1:34524) 2024-08-28T20:22:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0258e00640 1 -- 172.21.15.1:0/2941300945 learned_addr learned my addr 172.21.15.1:0/2941300945 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0259800640 1 -- 172.21.15.1:0/2941300945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 msgr2=0x7f02541a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0259800640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 0x7f02541a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0259800640 1 -- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f025410fbd0 msgr2=0x7f02541a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0259800640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f025410fbd0 0x7f02541a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.476+0000 7f0259800640 1 -- 172.21.15.1:0/2941300945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02541a1c30 con 0x7f0254075a90 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.477+0000 7f0258e00640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 0x7f02541a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.477+0000 7f0259800640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 0x7f02541a0280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f024800c970 tx=0x7f024800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.477+0000 7f0252000640 1 -- 172.21.15.1:0/2941300945 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248007bb0 con 0x7f0254075a90 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.477+0000 7f0252000640 1 -- 172.21.15.1:0/2941300945 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0248007d50 con 0x7f0254075a90 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.477+0000 7f0252000640 1 -- 172.21.15.1:0/2941300945 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248018820 con 0x7f0254075a90 2024-08-28T20:22:21.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.478+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02541a1f20 con 0x7f0254075a90 2024-08-28T20:22:21.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.478+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02541a84c0 con 0x7f0254075a90 2024-08-28T20:22:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.483+0000 7f02633d4740 1 Processor -- start 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.484+0000 7f02633d4740 1 -- start start 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.484+0000 7f02633d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x557196344dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.484+0000 7f02633d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.484+0000 7f02633d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x557196345f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.484+0000 7f02633d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571962b7f70 con 0x557195f7e4d0 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f02633d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5571962a7500 con 0x557195f9f1b0 2024-08-28T20:22:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f02633d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5571962ab4b0 con 0x557195f762f0 2024-08-28T20:22:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f0252000640 1 -- 172.21.15.1:0/2941300945 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f024800f450 con 0x7f0254075a90 2024-08-28T20:22:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x557196344dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x557196344dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34540/0 (socket says 172.21.15.1:34540) 2024-08-28T20:22:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 -- 172.21.15.1:0/1489748272 learned_addr learned my addr 172.21.15.1:0/1489748272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f0259800640 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 -- 172.21.15.1:0/1489748272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 msgr2=0x557196345430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 -- 172.21.15.1:0/1489748272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 msgr2=0x557196345f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x557196345f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.485+0000 7f025a200640 1 -- 172.21.15.1:0/1489748272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557196261c10 con 0x557195f9f1b0 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.486+0000 7f0259800640 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:22:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.486+0000 7f025a200640 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x557196344dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f024c0098b0 tx=0x7f024c0098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd15512d90b6d071 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.487+0000 7f0246a00640 1 -- 172.21.15.1:0/1489748272 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0316d0 con 0x557195f9f1b0 2024-08-28T20:22:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.487+0000 7f0246a00640 1 -- 172.21.15.1:0/1489748272 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f024c036040 con 0x557195f9f1b0 2024-08-28T20:22:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.487+0000 7f0246a00640 1 -- 172.21.15.1:0/1489748272 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c02f610 con 0x557195f9f1b0 2024-08-28T20:22:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.488+0000 7f02633d4740 1 -- 172.21.15.1:0/1489748272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 msgr2=0x557196344dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.488+0000 7f02633d4740 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x557196344dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f024c0098b0 tx=0x7f024c0098e0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.489+0000 7f0252000640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f023c0b4b30 0x7f023c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.489+0000 7f0252000640 1 -- 172.21.15.1:0/2941300945 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f02480e5240 con 0x7f0254075a90 2024-08-28T20:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f02633d4740 1 -- 172.21.15.1:0/1489748272 shutdown_connections 2024-08-28T20:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f02633d4740 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x557196345f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f02633d4740 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f02633d4740 1 --2- 172.21.15.1:0/1489748272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x557196344dc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f02633d4740 1 -- 172.21.15.1:0/1489748272 >> 172.21.15.1:0/1489748272 conn(0x557195f93300 msgr2=0x557196340850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f025a200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f023c0b4b30 0x7f023c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.490+0000 7f02633d4740 1 -- 172.21.15.1:0/1489748272 shutdown_connections 2024-08-28T20:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.491+0000 7f02633d4740 1 -- 172.21.15.1:0/1489748272 wait complete. 2024-08-28T20:22:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.492+0000 7f02633d4740 1 -- start start 2024-08-28T20:22:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.492+0000 7f02633d4740 1 Processor -- start 2024-08-28T20:22:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.493+0000 7f025a200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f023c0b4b30 0x7f023c0b7040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f024c009620 tx=0x7f024c02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.493+0000 7f02633d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x55719634e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.493+0000 7f02633d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x55719634eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f02633d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x55719634f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f02633d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5571961e0ab0 con 0x557195f7e4d0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f02633d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55719624e320 con 0x557195f9f1b0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f02633d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557196346a40 con 0x557195f762f0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f02633d4740 10 client.0 _ll_register_callbacks cb 0x5571962546a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x55719634f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x55719634f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34546/0 (socket says 172.21.15.1:34546) 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 -- 172.21.15.1:0/3216932184 learned_addr learned my addr 172.21.15.1:0/3216932184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f0259800640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x55719634e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f0258e00640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x55719634eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 -- 172.21.15.1:0/3216932184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 msgr2=0x55719634e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x55719634e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 -- 172.21.15.1:0/3216932184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 msgr2=0x55719634eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x55719634eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.494+0000 7f025a200640 1 -- 172.21.15.1:0/3216932184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719600a790 con 0x557195f9f1b0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.495+0000 7f025a200640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x55719634f620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f024c009390 tx=0x7f024c0098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c917fb09e6680da7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.495+0000 7f023b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.495+0000 7f023b400640 1 -- 172.21.15.1:0/3216932184 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c02fd60 con 0x557195f9f1b0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.495+0000 7f023b400640 1 -- 172.21.15.1:0/3216932184 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f024c003970 con 0x557195f9f1b0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.496+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024c036040 con 0x557195f9f1b0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.496+0000 7f023b400640 1 -- 172.21.15.1:0/3216932184 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f024c064050 con 0x557195f9f1b0 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.497+0000 7f02633d4740 10 client.25526 fetch_fsmap learned FSMap version 36 2024-08-28T20:22:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.497+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x557196083620 con 0x557195f9f1b0 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.497+0000 7f023b400640 1 -- 172.21.15.1:0/3216932184 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f024c036040 con 0x557195f9f1b0 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.497+0000 7f023b400640 1 -- 172.21.15.1:0/3216932184 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f024c030780 con 0x557195f9f1b0 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f02633d4740 10 client.25526 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f02633d4740 10 client.25526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f02633d4740 20 client.25526 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f02633d4740 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f5dd80 0x55719635b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f02633d4740 4 client.25526 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:22:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571962b9ec0 con 0x557195f5dd80 2024-08-28T20:22:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.498+0000 7f0259800640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f5dd80 0x55719635b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.499+0000 7f0259800640 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f5dd80 0x55719635b670 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de9a6a0d5ceb053a server_cookie=12841081ee9fa039 in_seq=0 out_seq=0 2024-08-28T20:22:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.499+0000 7f023b400640 10 client.25526 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.500+0000 7f023b400640 1 -- 172.21.15.1:0/3216932184 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571962b9ec0 con 0x557195f5dd80 2024-08-28T20:22:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.500+0000 7f023b400640 10 client.25526 handle_command_reply: tid=0 2024-08-28T20:22:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.500+0000 7f02633d4740 1 client.25526 shutdown 2024-08-28T20:22:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 msgr2=0x55719634f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x55719634f620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f024c009390 tx=0x7f024c0098e0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 shutdown_connections 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f5dd80 0x55719635b670 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f7e4d0 0x55719634eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f9f1b0 0x55719634f620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f023b400640 0 client.25526 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 --2- 172.21.15.1:0/3216932184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x55719634e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 >> 172.21.15.1:0/3216932184 conn(0x557195f93300 msgr2=0x55719633ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 shutdown_connections 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.501+0000 7f02633d4740 1 -- 172.21.15.1:0/3216932184 wait complete. 2024-08-28T20:22:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.502+0000 7f02633d4740 20 client.25526 trim_cache size 0 max 16384 2024-08-28T20:22:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.529+0000 7f02633d4740 1 Processor -- start 2024-08-28T20:22:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.530+0000 7f02633d4740 1 -- start start 2024-08-28T20:22:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.530+0000 7f02633d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.530+0000 7f02633d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f7e4d0 0x55719634b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.530+0000 7f02633d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x55719634ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.530+0000 7f0259800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f0259800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:59130/0 (socket says 172.21.15.1:59130) 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f025a200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x55719634ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f0258e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f7e4d0 0x55719634b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f02633d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02541ab4a0 con 0x557195f9f1b0 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f02633d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02541a8d10 con 0x557195f7e4d0 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f02633d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f025410dfb0 con 0x557195f762f0 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.531+0000 7f0259800640 1 -- 172.21.15.1:0/603886921 learned_addr learned my addr 172.21.15.1:0/603886921 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.532+0000 7f0259800640 1 -- 172.21.15.1:0/603886921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f7e4d0 msgr2=0x55719634b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.532+0000 7f0259800640 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f7e4d0 0x55719634b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.532+0000 7f0259800640 1 -- 172.21.15.1:0/603886921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 msgr2=0x55719634ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.532+0000 7f0259800640 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x55719634ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.532+0000 7f0259800640 1 -- 172.21.15.1:0/603886921 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719633a990 con 0x557195f762f0 2024-08-28T20:22:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.532+0000 7f0258e00640 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f7e4d0 0x55719634b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.533+0000 7f0259800640 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345c00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02480a7ce0 tx=0x7f02480e2c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9a75c144e8cedf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.534+0000 7f0246000640 1 -- 172.21.15.1:0/603886921 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02480abc60 con 0x557195f762f0 2024-08-28T20:22:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.534+0000 7f0246000640 1 -- 172.21.15.1:0/603886921 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02480b04d0 con 0x557195f762f0 2024-08-28T20:22:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.534+0000 7f0246000640 1 -- 172.21.15.1:0/603886921 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024800f740 con 0x557195f762f0 2024-08-28T20:22:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 -- 172.21.15.1:0/603886921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 msgr2=0x557196345c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345c00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02480a7ce0 tx=0x7f02480e2c00 comp rx=0 tx=0).stop 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 -- 172.21.15.1:0/603886921 shutdown_connections 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x55719634ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f7e4d0 0x55719634b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 --2- 172.21.15.1:0/603886921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f762f0 0x557196345c00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 -- 172.21.15.1:0/603886921 >> 172.21.15.1:0/603886921 conn(0x557195f93300 msgr2=0x557196340190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 -- 172.21.15.1:0/603886921 shutdown_connections 2024-08-28T20:22:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.535+0000 7f02633d4740 1 -- 172.21.15.1:0/603886921 wait complete. 2024-08-28T20:22:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.536+0000 7f02633d4740 1 -- start start 2024-08-28T20:22:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.536+0000 7f02633d4740 1 Processor -- start 2024-08-28T20:22:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.537+0000 7f02633d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f762f0 0x5571963525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.537+0000 7f02633d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 0x557196352b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f02633d4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x5571963536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f02633d4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f025410e620 con 0x557195f9f1b0 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f02633d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02541a8780 con 0x557195f762f0 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f02633d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f025410ecf0 con 0x557195f7e4d0 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f02633d4740 10 client.0 _ll_register_callbacks cb 0x7f024c031880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f0259800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f762f0 0x5571963525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f0258e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 0x557196352b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f0258e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 0x557196352b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:59146/0 (socket says 172.21.15.1:59146) 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f0259800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f762f0 0x5571963525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34560/0 (socket says 172.21.15.1:34560) 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f0258e00640 1 -- 172.21.15.1:0/4247593051 learned_addr learned my addr 172.21.15.1:0/4247593051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.538+0000 7f025a200640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x5571963536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f0258e00640 1 -- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f762f0 msgr2=0x5571963525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f0258e00640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f762f0 0x5571963525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f0258e00640 1 -- 172.21.15.1:0/4247593051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 msgr2=0x5571963536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f0258e00640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x5571963536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f0258e00640 1 -- 172.21.15.1:0/4247593051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557196353c30 con 0x557195f7e4d0 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f025a200640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x5571963536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f0258e00640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 0x557196352b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f024000c010 tx=0x7f02400039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753d4f404348aaa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.539+0000 7f023b400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.540+0000 7f023b400640 1 -- 172.21.15.1:0/4247593051 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02400227e0 con 0x557195f7e4d0 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.540+0000 7f023b400640 1 -- 172.21.15.1:0/4247593051 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f0240022980 con 0x557195f7e4d0 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.540+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02480b04d0 con 0x557195f7e4d0 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.540+0000 7f023b400640 1 -- 172.21.15.1:0/4247593051 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0240022b80 con 0x557195f7e4d0 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.541+0000 7f02633d4740 10 client.25507 fetch_fsmap learned FSMap version 36 2024-08-28T20:22:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.541+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5571963c68b0 con 0x557195f7e4d0 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.541+0000 7f023b400640 1 -- 172.21.15.1:0/4247593051 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02480b04d0 con 0x557195f7e4d0 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f023b400640 1 -- 172.21.15.1:0/4247593051 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f0240035050 con 0x557195f7e4d0 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f02633d4740 10 client.25507 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f02633d4740 10 client.25507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f02633d4740 20 client.25507 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f02633d4740 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f331c0 0x5571963c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f02633d4740 4 client.25507 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55719633f290 con 0x557195f331c0 2024-08-28T20:22:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.542+0000 7f0259800640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f331c0 0x5571963c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:21.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.543+0000 7f0259800640 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f331c0 0x5571963c9250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0e2e06bda6ef65 server_cookie=7850cacd1f238b90 in_seq=0 out_seq=0 2024-08-28T20:22:21.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.543+0000 7f023b400640 10 client.25507 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.558+0000 7f023b400640 1 -- 172.21.15.1:0/4247593051 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55719633f290 con 0x557195f331c0 2024-08-28T20:22:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.558+0000 7f023b400640 10 client.25507 handle_command_reply: tid=0 2024-08-28T20:22:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.558+0000 7f02633d4740 1 client.25507 shutdown 2024-08-28T20:22:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 msgr2=0x557196352b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 0x557196352b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f024000c010 tx=0x7f02400039c0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 shutdown_connections 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x557195f331c0 0x5571963c9250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557195f9f1b0 0x5571963536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557195f7e4d0 0x557196352b30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 --2- 172.21.15.1:0/4247593051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557195f762f0 0x5571963525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 >> 172.21.15.1:0/4247593051 conn(0x557195f93300 msgr2=0x557196348e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f023b400640 0 client.25507 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 shutdown_connections 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.559+0000 7f02633d4740 1 -- 172.21.15.1:0/4247593051 wait complete. 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.560+0000 7f02633d4740 20 client.25507 trim_cache size 0 max 16384 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:22:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.561+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f023c0b4b30 msgr2=0x7f023c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.561+0000 7f025c200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f023c0b4b30 0x7f023c0b7040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f024c009620 tx=0x7f024c02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.561+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 msgr2=0x7f02541a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.561+0000 7f025c200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 0x7f02541a0280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f024800c970 tx=0x7f024800ce30 comp rx=0 tx=0).stop 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 shutdown_connections 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f023c0b4b30 0x7f023c0b7040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f025410fbd0 0x7f02541a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0254076e90 0x7f02541a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 --2- 172.21.15.1:0/2941300945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0254075a90 0x7f02541a0280 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 >> 172.21.15.1:0/2941300945 conn(0x7f02540fed90 msgr2=0x7f0254102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 shutdown_connections 2024-08-28T20:22:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:21.562+0000 7f025c200640 1 -- 172.21.15.1:0/2941300945 wait complete. 2024-08-28T20:22:22.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:21 smithi001 ceph-mon[20984]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-08-28T20:22:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:21 smithi121 ceph-mon[25248]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-08-28T20:22:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:21 smithi007 ceph-mon[25357]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-08-28T20:22:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 235.0 s, 2582.6 tps, lat 38.160 ms stddev 48.137 2024-08-28T20:22:24.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:23 smithi001 ceph-mon[20984]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.6 MiB/s wr, 667 op/s 2024-08-28T20:22:24.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:23 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:22:24.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:23 smithi121 ceph-mon[25248]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.6 MiB/s wr, 667 op/s 2024-08-28T20:22:24.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:23 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:22:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:23 smithi007 ceph-mon[25357]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.6 MiB/s wr, 667 op/s 2024-08-28T20:22:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:23 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:22:25.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:22:25.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:22:25.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:22:25.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:22:25.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:22:25.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:22:25.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:22:25.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:22:25.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:22:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:25 smithi001 ceph-mon[20984]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.6 MiB/s wr, 717 op/s 2024-08-28T20:22:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:25 smithi121 ceph-mon[25248]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.6 MiB/s wr, 717 op/s 2024-08-28T20:22:26.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:25 smithi007 ceph-mon[25357]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.6 MiB/s wr, 717 op/s 2024-08-28T20:22:28.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:27 smithi001 ceph-mon[20984]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.8 MiB/s wr, 759 op/s 2024-08-28T20:22:28.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:27 smithi121 ceph-mon[25248]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.8 MiB/s wr, 759 op/s 2024-08-28T20:22:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:27 smithi007 ceph-mon[25357]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.8 MiB/s wr, 759 op/s 2024-08-28T20:22:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 240.0 s, 3050.4 tps, lat 33.093 ms stddev 39.947 2024-08-28T20:22:30.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:29 smithi001 ceph-mon[20984]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.2 MiB/s wr, 697 op/s 2024-08-28T20:22:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:29 smithi121 ceph-mon[25248]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.2 MiB/s wr, 697 op/s 2024-08-28T20:22:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:29 smithi007 ceph-mon[25357]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.2 MiB/s wr, 697 op/s 2024-08-28T20:22:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:31 smithi001 ceph-mon[20984]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.7 MiB/s wr, 799 op/s 2024-08-28T20:22:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:31 smithi121 ceph-mon[25248]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.7 MiB/s wr, 799 op/s 2024-08-28T20:22:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:31 smithi007 ceph-mon[25357]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.7 MiB/s wr, 799 op/s 2024-08-28T20:22:33.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 245.0 s, 2941.1 tps, lat 33.847 ms stddev 39.661 2024-08-28T20:22:34.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:33 smithi001 ceph-mon[20984]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.5 MiB/s wr, 668 op/s 2024-08-28T20:22:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:33 smithi121 ceph-mon[25248]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.5 MiB/s wr, 668 op/s 2024-08-28T20:22:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:33 smithi007 ceph-mon[25357]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.5 MiB/s wr, 668 op/s 2024-08-28T20:22:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 -- 172.21.15.1:0/1068079672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7406b620 msgr2=0x7f0f741060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/1068079672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7406b620 0x7f0f741060a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009900 tx=0x7f0f6402a400 comp rx=0 tx=0).stop 2024-08-28T20:22:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 -- 172.21.15.1:0/1068079672 shutdown_connections 2024-08-28T20:22:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/1068079672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741065e0 0x7f0f74108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/1068079672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f741091a0 0x7f0f7410b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/1068079672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7406b620 0x7f0f741060a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 -- 172.21.15.1:0/1068079672 >> 172.21.15.1:0/1068079672 conn(0x7f0f740fdca0 msgr2=0x7f0f74100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 -- 172.21.15.1:0/1068079672 shutdown_connections 2024-08-28T20:22:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.883+0000 7f0f7ae00640 1 -- 172.21.15.1:0/1068079672 wait complete. 2024-08-28T20:22:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.885+0000 7f0f7ae00640 1 Processor -- start 2024-08-28T20:22:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.886+0000 7f0f7ae00640 1 -- start start 2024-08-28T20:22:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.888+0000 7f0f7ae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 0x7f0f74103740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.888+0000 7f0f7ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f741065e0 0x7f0f74102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.888+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 0x7f0f74103740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.888+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 0x7f0f74103740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57154/0 (socket says 172.21.15.1:57154) 2024-08-28T20:22:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.888+0000 7f0f7ae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 0x7f0f74102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 0x7f0f74102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 0x7f0f74102540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35562/0 (socket says 172.21.15.1:35562) 2024-08-28T20:22:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f7ae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7410f110 con 0x7f0f741091a0 2024-08-28T20:22:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f7ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7410ef90 con 0x7f0f741065e0 2024-08-28T20:22:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f7ae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7410f290 con 0x7f0f7406b620 2024-08-28T20:22:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f741065e0 0x7f0f74102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f73e00640 1 -- 172.21.15.1:0/2534706659 learned_addr learned my addr 172.21.15.1:0/2534706659 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 -- 172.21.15.1:0/2534706659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 msgr2=0x7f0f74103740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 0x7f0f74103740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 -- 172.21.15.1:0/2534706659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f741065e0 msgr2=0x7f0f74102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f741065e0 0x7f0f74102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.889+0000 7f0f78e00640 1 -- 172.21.15.1:0/2534706659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f74102c30 con 0x7f0f741091a0 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.890+0000 7f0f73e00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 0x7f0f74103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:22:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.890+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 0x7f0f74102540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00cab0 tx=0x7f0f6c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.894+0000 7f0f70c00640 1 -- 172.21.15.1:0/2534706659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c022070 con 0x7f0f741091a0 2024-08-28T20:22:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.895+0000 7f0f70c00640 1 -- 172.21.15.1:0/2534706659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f6c01d440 con 0x7f0f741091a0 2024-08-28T20:22:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.895+0000 7f0f70c00640 1 -- 172.21.15.1:0/2534706659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c01b580 con 0x7f0f741091a0 2024-08-28T20:22:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.895+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f74199920 con 0x7f0f741091a0 2024-08-28T20:22:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.895+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f74199e20 con 0x7f0f741091a0 2024-08-28T20:22:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.902+0000 7f0f81e02740 1 Processor -- start 2024-08-28T20:22:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.903+0000 7f0f70c00640 1 -- 172.21.15.1:0/2534706659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f0f6c025070 con 0x7f0f741091a0 2024-08-28T20:22:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 -- start start 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ee1692ef70 con 0x55ee165f54d0 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ee1691e500 con 0x55ee166161b0 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f81e02740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ee169224b0 con 0x55ee165ed2f0 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.904+0000 7f0f73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169bc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57156/0 (socket says 172.21.15.1:57156) 2024-08-28T20:22:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73e00640 1 -- 172.21.15.1:0/4238199767 learned_addr learned my addr 172.21.15.1:0/4238199767 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48256/0 (socket says 172.21.15.1:48256) 2024-08-28T20:22:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 -- 172.21.15.1:0/4238199767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 msgr2=0x55ee169bc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169bc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 -- 172.21.15.1:0/4238199767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 msgr2=0x55ee169bcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 -- 172.21.15.1:0/4238199767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee168d8c10 con 0x55ee166161b0 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f70c00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0f580b4d00 0x7f0f580b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f73400640 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169bbdc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f60005d00 tx=0x7f0f60005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad74e699f5ce35a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.905+0000 7f0f70c00640 1 -- 172.21.15.1:0/2534706659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f0f6c0ed240 con 0x7f0f741091a0 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.906+0000 7f0f73e00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0f580b4d00 0x7f0f580b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.906+0000 7f0f69600640 1 -- 172.21.15.1:0/4238199767 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60012d20 con 0x55ee166161b0 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.906+0000 7f0f69600640 1 -- 172.21.15.1:0/4238199767 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f60005020 con 0x55ee166161b0 2024-08-28T20:22:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.906+0000 7f0f69600640 1 -- 172.21.15.1:0/4238199767 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004a00 con 0x55ee166161b0 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.908+0000 7f0f81e02740 1 -- 172.21.15.1:0/4238199767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 msgr2=0x55ee169bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.908+0000 7f0f81e02740 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169bbdc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f60005d00 tx=0x7f0f60005c90 comp rx=0 tx=0).stop 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.908+0000 7f0f73e00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0f580b4d00 0x7f0f580b7210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0f640096c0 tx=0x7f0f64009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.908+0000 7f0f81e02740 1 -- 172.21.15.1:0/4238199767 shutdown_connections 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.908+0000 7f0f81e02740 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.909+0000 7f0f81e02740 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.909+0000 7f0f81e02740 1 --2- 172.21.15.1:0/4238199767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169bbdc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.909+0000 7f0f81e02740 1 -- 172.21.15.1:0/4238199767 >> 172.21.15.1:0/4238199767 conn(0x55ee1660a300 msgr2=0x55ee169b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.909+0000 7f0f81e02740 1 -- 172.21.15.1:0/4238199767 shutdown_connections 2024-08-28T20:22:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.909+0000 7f0f81e02740 1 -- 172.21.15.1:0/4238199767 wait complete. 2024-08-28T20:22:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.910+0000 7f0f81e02740 1 -- start start 2024-08-28T20:22:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.911+0000 7f0f81e02740 1 Processor -- start 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.911+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f81e02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ee16857ab0 con 0x55ee165f54d0 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f81e02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ee168c5320 con 0x55ee166161b0 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f81e02740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ee169bdaa0 con 0x55ee165ed2f0 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f81e02740 10 client.0 _ll_register_callbacks cb 0x55ee168cb6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57168/0 (socket says 172.21.15.1:57168) 2024-08-28T20:22:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.912+0000 7f0f73e00640 1 -- 172.21.15.1:0/2585857617 learned_addr learned my addr 172.21.15.1:0/2585857617 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f73400640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f78e00640 1 -- 172.21.15.1:0/2585857617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 msgr2=0x55ee169c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f78e00640 1 -- 172.21.15.1:0/2585857617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 msgr2=0x55ee169c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.913+0000 7f0f78e00640 1 -- 172.21.15.1:0/2585857617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee16681790 con 0x55ee166161b0 2024-08-28T20:22:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.914+0000 7f0f73e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.914+0000 7f0f5e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:22:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.914+0000 7f0f78e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169c66c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0b39b0 tx=0x7f0f6c0b34e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebabeb15190176f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.914+0000 7f0f5e000640 1 -- 172.21.15.1:0/2585857617 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0b8470 con 0x55ee166161b0 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.915+0000 7f0f5e000640 1 -- 172.21.15.1:0/2585857617 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f0f6c0b80d0 con 0x55ee166161b0 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.915+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f60005020 con 0x55ee166161b0 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.915+0000 7f0f5e000640 1 -- 172.21.15.1:0/2585857617 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0f6c0bcf20 con 0x55ee166161b0 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.915+0000 7f0f81e02740 10 client.25544 fetch_fsmap learned FSMap version 36 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.915+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ee166fa620 con 0x55ee166161b0 2024-08-28T20:22:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.916+0000 7f0f5e000640 1 -- 172.21.15.1:0/2585857617 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f60005020 con 0x55ee166161b0 2024-08-28T20:22:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.916+0000 7f0f5e000640 1 -- 172.21.15.1:0/2585857617 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f0f6c0d6ce0 con 0x55ee166161b0 2024-08-28T20:22:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.916+0000 7f0f81e02740 10 client.25544 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:22:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.916+0000 7f0f81e02740 10 client.25544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.916+0000 7f0f81e02740 20 client.25544 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.916+0000 7f0f81e02740 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165d4d80 0x55ee169e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.917+0000 7f0f81e02740 4 client.25544 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:22:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.917+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee16930ec0 con 0x55ee165d4d80 2024-08-28T20:22:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.917+0000 7f0f73e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165d4d80 0x55ee169e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.918+0000 7f0f5e000640 10 client.25544 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.918+0000 7f0f73e00640 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165d4d80 0x55ee169e3c90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d9668a1a54113b server_cookie=da58e8601c9ffddb in_seq=0 out_seq=0 2024-08-28T20:22:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.919+0000 7f0f5e000640 1 -- 172.21.15.1:0/2585857617 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee16930ec0 con 0x55ee165d4d80 2024-08-28T20:22:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.919+0000 7f0f5e000640 10 client.25544 handle_command_reply: tid=0 2024-08-28T20:22:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.919+0000 7f0f81e02740 1 client.25544 shutdown 2024-08-28T20:22:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 msgr2=0x55ee169c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169c66c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0b39b0 tx=0x7f0f6c0b34e0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 shutdown_connections 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165d4d80 0x55ee169e3c90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee166161b0 0x55ee169c66c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f5e000640 0 client.25544 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 --2- 172.21.15.1:0/2585857617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165ed2f0 0x55ee169c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.920+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 >> 172.21.15.1:0/2585857617 conn(0x55ee1660a300 msgr2=0x55ee169b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.921+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 shutdown_connections 2024-08-28T20:22:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.921+0000 7f0f81e02740 1 -- 172.21.15.1:0/2585857617 wait complete. 2024-08-28T20:22:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.922+0000 7f0f81e02740 20 client.25544 trim_cache size 0 max 16384 2024-08-28T20:22:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.952+0000 7f0f81e02740 1 Processor -- start 2024-08-28T20:22:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.952+0000 7f0f81e02740 1 -- start start 2024-08-28T20:22:34.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.954+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.954+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.954+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee166161b0 0x55ee169b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.954+0000 7f0f81e02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740740e0 con 0x55ee165f54d0 2024-08-28T20:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.954+0000 7f0f81e02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f74071950 con 0x55ee165ed2f0 2024-08-28T20:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.954+0000 7f0f81e02740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7406f7a0 con 0x55ee166161b0 2024-08-28T20:22:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.955+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.955+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48280/0 (socket says 172.21.15.1:48280) 2024-08-28T20:22:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.955+0000 7f0f73400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.955+0000 7f0f73400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35586/0 (socket says 172.21.15.1:35586) 2024-08-28T20:22:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.955+0000 7f0f73400640 1 -- 172.21.15.1:0/1763823974 learned_addr learned my addr 172.21.15.1:0/1763823974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.955+0000 7f0f78e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee166161b0 0x55ee169b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.956+0000 7f0f73400640 1 -- 172.21.15.1:0/1763823974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee166161b0 msgr2=0x55ee169b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.956+0000 7f0f73400640 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee166161b0 0x55ee169b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.956+0000 7f0f73400640 1 -- 172.21.15.1:0/1763823974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 msgr2=0x55ee169c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.956+0000 7f0f73400640 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.956+0000 7f0f73400640 1 -- 172.21.15.1:0/1763823974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee169b1990 con 0x55ee165f54d0 2024-08-28T20:22:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.956+0000 7f0f73e00640 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:22:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.957+0000 7f0f73400640 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000b5e0 tx=0x7f0f6001b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd7445eb43bdfb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.957+0000 7f0f68c00640 1 -- 172.21.15.1:0/1763823974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f600050b0 con 0x55ee165f54d0 2024-08-28T20:22:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.957+0000 7f0f68c00640 1 -- 172.21.15.1:0/1763823974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f60016040 con 0x55ee165f54d0 2024-08-28T20:22:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.957+0000 7f0f68c00640 1 -- 172.21.15.1:0/1763823974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f600035f0 con 0x55ee165f54d0 2024-08-28T20:22:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.958+0000 7f0f81e02740 1 -- 172.21.15.1:0/1763823974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 msgr2=0x55ee169bcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.958+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000b5e0 tx=0x7f0f6001b040 comp rx=0 tx=0).stop 2024-08-28T20:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.959+0000 7f0f81e02740 1 -- 172.21.15.1:0/1763823974 shutdown_connections 2024-08-28T20:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.959+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee165f54d0 0x55ee169bcd20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.959+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee166161b0 0x55ee169b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.959+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1763823974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.959+0000 7f0f81e02740 1 -- 172.21.15.1:0/1763823974 >> 172.21.15.1:0/1763823974 conn(0x55ee1660a300 msgr2=0x55ee169c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.960+0000 7f0f81e02740 1 -- 172.21.15.1:0/1763823974 shutdown_connections 2024-08-28T20:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.960+0000 7f0f81e02740 1 -- 172.21.15.1:0/1763823974 wait complete. 2024-08-28T20:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.960+0000 7f0f81e02740 1 -- start start 2024-08-28T20:22:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.961+0000 7f0f81e02740 1 Processor -- start 2024-08-28T20:22:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.962+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165f54d0 0x55ee169ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f81e02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee166161b0 0x55ee169caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f81e02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7406fe10 con 0x55ee166161b0 2024-08-28T20:22:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f81e02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f74071280 con 0x55ee165ed2f0 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f81e02740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f740704e0 con 0x55ee165f54d0 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f81e02740 10 client.0 _ll_register_callbacks cb 0x7f0f6c0b3b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48292/0 (socket says 172.21.15.1:48292) 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 -- 172.21.15.1:0/1687075840 learned_addr learned my addr 172.21.15.1:0/1687075840 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f78e00640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee166161b0 0x55ee169caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73400640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165f54d0 0x55ee169ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 -- 172.21.15.1:0/1687075840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165f54d0 msgr2=0x55ee169ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165f54d0 0x55ee169ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 -- 172.21.15.1:0/1687075840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee166161b0 msgr2=0x55ee169caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:34.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee166161b0 0x55ee169caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.963+0000 7f0f73e00640 1 -- 172.21.15.1:0/1687075840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee169cb660 con 0x55ee165ed2f0 2024-08-28T20:22:34.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.964+0000 7f0f73e00640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169cc6c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f64031440 tx=0x7f0f6403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425b34215a0b3f33 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.964+0000 7f0f5e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:22:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.965+0000 7f0f5e000640 1 -- 172.21.15.1:0/1687075840 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64035040 con 0x55ee165ed2f0 2024-08-28T20:22:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.965+0000 7f0f5e000640 1 -- 172.21.15.1:0/1687075840 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f0f64004d90 con 0x55ee165ed2f0 2024-08-28T20:22:34.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.965+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f60016040 con 0x55ee165ed2f0 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.966+0000 7f0f5e000640 1 -- 172.21.15.1:0/1687075840 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0f640035f0 con 0x55ee165ed2f0 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.966+0000 7f0f81e02740 10 client.25550 fetch_fsmap learned FSMap version 36 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.966+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ee16a4f080 con 0x55ee165ed2f0 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.966+0000 7f0f5e000640 1 -- 172.21.15.1:0/1687075840 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f60016040 con 0x55ee165ed2f0 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f5e000640 1 -- 172.21.15.1:0/1687075840 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f0f64032880 con 0x55ee165ed2f0 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f81e02740 10 client.25550 fetch_fsmap finished waiting for FSMap version 36 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f81e02740 10 client.25550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f81e02740 20 client.25550 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165aa1c0 0x55ee16a51a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f81e02740 4 client.25550 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:22:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee169bd400 con 0x55ee165aa1c0 2024-08-28T20:22:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.967+0000 7f0f73400640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165aa1c0 0x55ee16a51a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.969+0000 7f0f73400640 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165aa1c0 0x55ee16a51a00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b23ed485ad0669a server_cookie=e70bb045c49843b8 in_seq=0 out_seq=0 2024-08-28T20:22:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.969+0000 7f0f5e000640 10 client.25550 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.986+0000 7f0f5e000640 1 -- 172.21.15.1:0/1687075840 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee169bd400 con 0x55ee165aa1c0 2024-08-28T20:22:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f5e000640 10 client.25550 handle_command_reply: tid=0 2024-08-28T20:22:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 client.25550 shutdown 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 msgr2=0x55ee169cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169cc6c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f64031440 tx=0x7f0f6403d000 comp rx=0 tx=0).stop 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 shutdown_connections 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ee165aa1c0 0x55ee16a51a00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee166161b0 0x55ee169caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee165f54d0 0x55ee169ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f5e000640 0 client.25550 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 --2- 172.21.15.1:0/1687075840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee165ed2f0 0x55ee169cc6c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 >> 172.21.15.1:0/1687075840 conn(0x55ee1660a300 msgr2=0x55ee169b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 shutdown_connections 2024-08-28T20:22:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 1 -- 172.21.15.1:0/1687075840 wait complete. 2024-08-28T20:22:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.987+0000 7f0f81e02740 20 client.25550 trim_cache size 0 max 16384 2024-08-28T20:22:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:22:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:22:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:22:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.988+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0f580b4d00 msgr2=0x7f0f580b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.988+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0f580b4d00 0x7f0f580b7210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0f640096c0 tx=0x7f0f64009560 comp rx=0 tx=0).stop 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.988+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 msgr2=0x7f0f74102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.988+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 0x7f0f74102540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00cab0 tx=0x7f0f6c00cf70 comp rx=0 tx=0).stop 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.989+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 shutdown_connections 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.989+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f0f580b4d00 0x7f0f580b7210 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.989+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f741091a0 0x7f0f74102540 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.989+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f741065e0 0x7f0f74102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.989+0000 7f0f7ae00640 1 --2- 172.21.15.1:0/2534706659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7406b620 0x7f0f74103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.989+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 >> 172.21.15.1:0/2534706659 conn(0x7f0f740fdca0 msgr2=0x7f0f74104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.990+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 shutdown_connections 2024-08-28T20:22:34.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:34.990+0000 7f0f7ae00640 1 -- 172.21.15.1:0/2534706659 wait complete. 2024-08-28T20:22:36.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:35 smithi001 ceph-mon[20984]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.6 MiB/s wr, 768 op/s 2024-08-28T20:22:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:35 smithi121 ceph-mon[25248]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.6 MiB/s wr, 768 op/s 2024-08-28T20:22:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:35 smithi007 ceph-mon[25357]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.6 MiB/s wr, 768 op/s 2024-08-28T20:22:37.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:36 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:22:37.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:36 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:22:37.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:36 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:22:38.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:37 smithi001 ceph-mon[20984]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.3 MiB/s wr, 801 op/s 2024-08-28T20:22:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:37 smithi121 ceph-mon[25248]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.3 MiB/s wr, 801 op/s 2024-08-28T20:22:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:37 smithi007 ceph-mon[25357]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.3 MiB/s wr, 801 op/s 2024-08-28T20:22:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 250.0 s, 2383.4 tps, lat 42.222 ms stddev 51.099 2024-08-28T20:22:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:39 smithi001 ceph-mon[20984]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 MiB/s wr, 760 op/s 2024-08-28T20:22:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:39 smithi121 ceph-mon[25248]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 MiB/s wr, 760 op/s 2024-08-28T20:22:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:39 smithi007 ceph-mon[25357]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 MiB/s wr, 760 op/s 2024-08-28T20:22:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:41 smithi001 ceph-mon[20984]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 786 op/s 2024-08-28T20:22:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:41 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:22:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:41 smithi121 ceph-mon[25248]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 786 op/s 2024-08-28T20:22:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:41 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:22:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:41 smithi007 ceph-mon[25357]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 786 op/s 2024-08-28T20:22:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:41 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:22:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 255.0 s, 2800.0 tps, lat 35.346 ms stddev 40.731 2024-08-28T20:22:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:43 smithi001 ceph-mon[20984]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 710 op/s 2024-08-28T20:22:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:43 smithi121 ceph-mon[25248]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 710 op/s 2024-08-28T20:22:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:43 smithi007 ceph-mon[25357]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 710 op/s 2024-08-28T20:22:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:45 smithi001 ceph-mon[20984]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 830 op/s 2024-08-28T20:22:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:45 smithi121 ceph-mon[25248]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 830 op/s 2024-08-28T20:22:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:45 smithi007 ceph-mon[25357]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 830 op/s 2024-08-28T20:22:48.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:47 smithi001 ceph-mon[20984]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.6 MiB/s wr, 777 op/s 2024-08-28T20:22:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:47 smithi121 ceph-mon[25248]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.6 MiB/s wr, 777 op/s 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 -- 172.21.15.1:0/3233414589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6854103330 msgr2=0x7f68541037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 --2- 172.21.15.1:0/3233414589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6854103330 0x7f68541037a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f684800dc90 tx=0x7f684802e390 comp rx=0 tx=0).stop 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 -- 172.21.15.1:0/3233414589 shutdown_connections 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 --2- 172.21.15.1:0/3233414589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68541043b0 0x7f68541047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 --2- 172.21.15.1:0/3233414589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6854104d50 0x7f685410b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 --2- 172.21.15.1:0/3233414589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6854103330 0x7f68541037a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 -- 172.21.15.1:0/3233414589 >> 172.21.15.1:0/3233414589 conn(0x7f68540fec50 msgr2=0x7f6854101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 -- 172.21.15.1:0/3233414589 shutdown_connections 2024-08-28T20:22:48.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.303+0000 7f685aa00640 1 -- 172.21.15.1:0/3233414589 wait complete. 2024-08-28T20:22:48.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.305+0000 7f685aa00640 1 Processor -- start 2024-08-28T20:22:48.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.305+0000 7f685aa00640 1 -- start start 2024-08-28T20:22:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f685aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6854103330 0x7f6854197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f685aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 0x7f6854198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f685aa00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6854104d50 0x7f6854198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f685aa00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f685410cd70 con 0x7f6854104d50 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f685aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f685410cbf0 con 0x7f68541043b0 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f685aa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f685410cef0 con 0x7f6854103330 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f6858c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 0x7f6854198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f6858c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 0x7f6854198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35458/0 (socket says 172.21.15.1:35458) 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f6858c00640 1 -- 172.21.15.1:0/4046577773 learned_addr learned my addr 172.21.15.1:0/4046577773 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.306+0000 7f6859600640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6854103330 0x7f6854197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f6858c00640 1 -- 172.21.15.1:0/4046577773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6854103330 msgr2=0x7f6854197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f6858c00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6854103330 0x7f6854197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f6858c00640 1 -- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6854104d50 msgr2=0x7f6854198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f685a000640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6854104d50 0x7f6854198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f6858c00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6854104d50 0x7f6854198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f6858c00640 1 -- 172.21.15.1:0/4046577773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68541993d0 con 0x7f68541043b0 2024-08-28T20:22:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.307+0000 7f6858c00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 0x7f6854198000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f684000b4a0 tx=0x7f684000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.309+0000 7f6852000640 1 -- 172.21.15.1:0/4046577773 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840025070 con 0x7f68541043b0 2024-08-28T20:22:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.309+0000 7f6852000640 1 -- 172.21.15.1:0/4046577773 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6840021ac0 con 0x7f68541043b0 2024-08-28T20:22:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.309+0000 7f6852000640 1 -- 172.21.15.1:0/4046577773 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840020c40 con 0x7f68541043b0 2024-08-28T20:22:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.309+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68541996c0 con 0x7f68541043b0 2024-08-28T20:22:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.310+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685419fbd0 con 0x7f68541043b0 2024-08-28T20:22:48.314 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:47 smithi007 ceph-mon[25357]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.6 MiB/s wr, 777 op/s 2024-08-28T20:22:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.318+0000 7f6852000640 1 -- 172.21.15.1:0/4046577773 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f6840028070 con 0x7f68541043b0 2024-08-28T20:22:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.320+0000 7f6863024740 1 Processor -- start 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 -- start start 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6852000640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f683c0b4c70 0x7f683c0b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546ee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e45465ff70 con 0x55e4543471b0 2024-08-28T20:22:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e45464f500 con 0x55e45431e2f0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6863024740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e4546534b0 con 0x55e4543264d0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f6852000640 1 -- 172.21.15.1:0/4046577773 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f68400f5600 con 0x7f68541043b0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.321+0000 7f685a000640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f683c0b4c70 0x7f683c0b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6859600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35468/0 (socket says 172.21.15.1:35468) 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 -- 172.21.15.1:0/995218030 learned_addr learned my addr 172.21.15.1:0/995218030 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f685a000640 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 -- 172.21.15.1:0/995218030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 msgr2=0x55e4546ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 -- 172.21.15.1:0/995218030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 msgr2=0x55e4546ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 -- 172.21.15.1:0/995218030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e454609c10 con 0x55e45431e2f0 2024-08-28T20:22:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6858c00640 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546ed610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68400bbd20 tx=0x7f68400047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec272a884e21178 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f685a000640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f683c0b4c70 0x7f683c0b7180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f684c005fd0 tx=0x7f684c009f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.322+0000 7f6846600640 1 -- 172.21.15.1:0/995218030 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684002f040 con 0x55e45431e2f0 2024-08-28T20:22:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.323+0000 7f6846600640 1 -- 172.21.15.1:0/995218030 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68400c0890 con 0x55e45431e2f0 2024-08-28T20:22:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.323+0000 7f6846600640 1 -- 172.21.15.1:0/995218030 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68400c4eb0 con 0x55e45431e2f0 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.323+0000 7f6863024740 1 -- 172.21.15.1:0/995218030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 msgr2=0x55e4546ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.323+0000 7f6863024740 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546ed610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68400bbd20 tx=0x7f68400047d0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 -- 172.21.15.1:0/995218030 shutdown_connections 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546ed610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 --2- 172.21.15.1:0/995218030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 -- 172.21.15.1:0/995218030 >> 172.21.15.1:0/995218030 conn(0x55e45433b300 msgr2=0x55e4546e8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 -- 172.21.15.1:0/995218030 shutdown_connections 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 -- 172.21.15.1:0/995218030 wait complete. 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 -- start start 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.324+0000 7f6863024740 1 Processor -- start 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e45431e2f0 0x55e4546f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e454588ab0 con 0x55e4543471b0 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e4545f6320 con 0x55e4543264d0 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e4546eec80 con 0x55e45431e2f0 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6863024740 10 client.0 _ll_register_callbacks cb 0x55e4545fc6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6859600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e45431e2f0 0x55e4546f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6858c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6859600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e45431e2f0 0x55e4546f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47914/0 (socket says 172.21.15.1:47914) 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6858c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35474/0 (socket says 172.21.15.1:35474) 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f6859600640 1 -- 172.21.15.1:0/4151330952 learned_addr learned my addr 172.21.15.1:0/4151330952 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.325+0000 7f685a000640 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6858c00640 1 -- 172.21.15.1:0/4151330952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e45431e2f0 msgr2=0x55e4546f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6858c00640 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e45431e2f0 0x55e4546f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6858c00640 1 -- 172.21.15.1:0/4151330952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 msgr2=0x55e4546f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6858c00640 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6858c00640 1 -- 172.21.15.1:0/4151330952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4543b2790 con 0x55e4543264d0 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6858c00640 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546f6d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f684000be60 tx=0x7f68400bbe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c3f587894afc32 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f683aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f683aa00640 1 -- 172.21.15.1:0/4151330952 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684002f070 con 0x55e4543264d0 2024-08-28T20:22:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f683aa00640 1 -- 172.21.15.1:0/4151330952 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f6840021610 con 0x55e4543264d0 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68400c0890 con 0x55e4543264d0 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f683aa00640 1 -- 172.21.15.1:0/4151330952 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6840021850 con 0x55e4543264d0 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6863024740 10 client.25562 fetch_fsmap learned FSMap version 38 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.326+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e45442b620 con 0x55e4543264d0 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f683aa00640 1 -- 172.21.15.1:0/4151330952 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68400c0890 con 0x55e4543264d0 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f683aa00640 1 -- 172.21.15.1:0/4151330952 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f6840020050 con 0x55e4543264d0 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6863024740 10 client.25562 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6863024740 10 client.25562 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6863024740 20 client.25562 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6863024740 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e454305d80 0x55e454703970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6863024740 4 client.25562 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e454661ec0 con 0x55e454305d80 2024-08-28T20:22:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.327+0000 7f6859600640 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e454305d80 0x55e454703970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.328+0000 7f6859600640 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e454305d80 0x55e454703970 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=705910628d22df75 server_cookie=478c227f642a8758 in_seq=0 out_seq=0 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.328+0000 7f683aa00640 10 client.25562 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f683aa00640 1 -- 172.21.15.1:0/4151330952 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e454661ec0 con 0x55e454305d80 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f683aa00640 10 client.25562 handle_command_reply: tid=0 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 client.25562 shutdown 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 msgr2=0x55e4546f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546f6d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f684000be60 tx=0x7f68400bbe80 comp rx=0 tx=0).stop 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 shutdown_connections 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e454305d80 0x55e454703970 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546f6d20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 --2- 172.21.15.1:0/4151330952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e45431e2f0 0x55e4546f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f683aa00640 0 client.25562 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 >> 172.21.15.1:0/4151330952 conn(0x55e45433b300 msgr2=0x55e4546e6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 shutdown_connections 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.329+0000 7f6863024740 1 -- 172.21.15.1:0/4151330952 wait complete. 2024-08-28T20:22:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.330+0000 7f6863024740 20 client.25562 trim_cache size 0 max 16384 2024-08-28T20:22:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.360+0000 7f6863024740 1 Processor -- start 2024-08-28T20:22:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.360+0000 7f6863024740 1 -- start start 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6863024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6863024740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6863024740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6863024740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68541ab2a0 con 0x55e4543471b0 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6863024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68541a8b10 con 0x55e45431e2f0 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6863024740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68541a6960 con 0x55e4543264d0 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6859600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6859600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35476/0 (socket says 172.21.15.1:35476) 2024-08-28T20:22:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6858c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f6859600640 1 -- 172.21.15.1:0/3176840089 learned_addr learned my addr 172.21.15.1:0/3176840089 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.361+0000 7f685a000640 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6859600640 1 -- 172.21.15.1:0/3176840089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 msgr2=0x55e4546f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6859600640 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6859600640 1 -- 172.21.15.1:0/3176840089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 msgr2=0x55e4546f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6859600640 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6859600640 1 -- 172.21.15.1:0/3176840089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e454703ce0 con 0x55e45431e2f0 2024-08-28T20:22:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6859600640 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546f5860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6848005ab0 tx=0x7f6848030040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e48250ab3cf68ef5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6845c00640 1 -- 172.21.15.1:0/3176840089 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684800d0d0 con 0x55e45431e2f0 2024-08-28T20:22:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6845c00640 1 -- 172.21.15.1:0/3176840089 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f684800d270 con 0x55e45431e2f0 2024-08-28T20:22:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.362+0000 7f6845c00640 1 -- 172.21.15.1:0/3176840089 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848041420 con 0x55e45431e2f0 2024-08-28T20:22:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 -- 172.21.15.1:0/3176840089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 msgr2=0x55e4546f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546f5860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6848005ab0 tx=0x7f6848030040 comp rx=0 tx=0).stop 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 -- 172.21.15.1:0/3176840089 shutdown_connections 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4543471b0 0x55e4546f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543264d0 0x55e4546f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 --2- 172.21.15.1:0/3176840089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45431e2f0 0x55e4546f5860 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.364+0000 7f6863024740 1 -- 172.21.15.1:0/3176840089 >> 172.21.15.1:0/3176840089 conn(0x55e45433b300 msgr2=0x55e4546edde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.365+0000 7f6863024740 1 -- 172.21.15.1:0/3176840089 shutdown_connections 2024-08-28T20:22:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.365+0000 7f6863024740 1 -- 172.21.15.1:0/3176840089 wait complete. 2024-08-28T20:22:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.365+0000 7f6863024740 1 -- start start 2024-08-28T20:22:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.366+0000 7f6863024740 1 Processor -- start 2024-08-28T20:22:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.367+0000 7f6863024740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e45431e2f0 0x55e4546fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.367+0000 7f6863024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546fce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f6863024740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 0x55e4546fd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f6863024740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68541a6fd0 con 0x55e45431e2f0 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f6863024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68541a8440 con 0x55e4543264d0 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f6863024740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68541a76a0 con 0x55e4543471b0 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f6863024740 10 client.0 _ll_register_callbacks cb 0x7f6840020370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f685a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 0x55e4546fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f685a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 0x55e4546fd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47924/0 (socket says 172.21.15.1:47924) 2024-08-28T20:22:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.368+0000 7f685a000640 1 -- 172.21.15.1:0/3601036304 learned_addr learned my addr 172.21.15.1:0/3601036304 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:22:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f6858c00640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f6859600640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e45431e2f0 0x55e4546fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f685a000640 1 -- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 msgr2=0x55e4546fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f685a000640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546fce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f685a000640 1 -- 172.21.15.1:0/3601036304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e45431e2f0 msgr2=0x55e4546fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:22:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f685a000640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e45431e2f0 0x55e4546fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f685a000640 1 -- 172.21.15.1:0/3601036304 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4546fd8a0 con 0x55e4543471b0 2024-08-28T20:22:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.369+0000 7f6858c00640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:22:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.370+0000 7f685a000640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 0x55e4546fd360 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f684c0142d0 tx=0x7f684c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d639c20a7b00e2c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:22:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.370+0000 7f683aa00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:22:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.371+0000 7f683aa00640 1 -- 172.21.15.1:0/3601036304 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c0129d0 con 0x55e4543471b0 2024-08-28T20:22:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.371+0000 7f683aa00640 1 -- 172.21.15.1:0/3601036304 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f684c012b70 con 0x55e4543471b0 2024-08-28T20:22:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.371+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f684800d270 con 0x55e4543471b0 2024-08-28T20:22:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.372+0000 7f683aa00640 1 -- 172.21.15.1:0/3601036304 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f684c023450 con 0x55e4543471b0 2024-08-28T20:22:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.372+0000 7f6863024740 10 client.25537 fetch_fsmap learned FSMap version 38 2024-08-28T20:22:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.372+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e4546fc6f0 con 0x55e4543471b0 2024-08-28T20:22:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f683aa00640 1 -- 172.21.15.1:0/3601036304 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f684800d270 con 0x55e4543471b0 2024-08-28T20:22:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f683aa00640 1 -- 172.21.15.1:0/3601036304 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f684c02c550 con 0x55e4543471b0 2024-08-28T20:22:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6863024740 10 client.25537 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:22:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6863024740 10 client.25537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:22:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6863024740 20 client.25537 populate_metadata read hostname 'smithi001' 2024-08-28T20:22:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6863024740 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e4542db1c0 0x55e454770aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:22:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6863024740 4 client.25537 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:22:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e45465d960 con 0x55e4542db1c0 2024-08-28T20:22:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.373+0000 7f6859600640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e4542db1c0 0x55e454770aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:22:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.374+0000 7f6859600640 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e4542db1c0 0x55e454770aa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622534cee8c89c1b server_cookie=7d9a869a618dc13e in_seq=0 out_seq=0 2024-08-28T20:22:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.374+0000 7f683aa00640 10 client.25537 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.389+0000 7f683aa00640 1 -- 172.21.15.1:0/3601036304 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e45465d960 con 0x55e4542db1c0 2024-08-28T20:22:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.389+0000 7f683aa00640 10 client.25537 handle_command_reply: tid=0 2024-08-28T20:22:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.389+0000 7f6863024740 1 client.25537 shutdown 2024-08-28T20:22:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.389+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 msgr2=0x55e4546fd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.389+0000 7f6863024740 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 0x55e4546fd360 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f684c0142d0 tx=0x7f684c004ab0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 shutdown_connections 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e4542db1c0 0x55e454770aa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e4543471b0 0x55e4546fd360 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e4543264d0 0x55e4546fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 --2- 172.21.15.1:0/3601036304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e45431e2f0 0x55e4546fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f683aa00640 0 client.25537 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 >> 172.21.15.1:0/3601036304 conn(0x55e45433b300 msgr2=0x55e4546f1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 shutdown_connections 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 1 -- 172.21.15.1:0/3601036304 wait complete. 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.390+0000 7f6863024740 20 client.25537 trim_cache size 0 max 16384 2024-08-28T20:22:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:22:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:22:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:22:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:22:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.393+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f683c0b4c70 msgr2=0x7f683c0b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.393+0000 7f685aa00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f683c0b4c70 0x7f683c0b7180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f684c005fd0 tx=0x7f684c009f90 comp rx=0 tx=0).stop 2024-08-28T20:22:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.393+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 msgr2=0x7f6854198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:22:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.393+0000 7f685aa00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 0x7f6854198000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f684000b4a0 tx=0x7f684000b960 comp rx=0 tx=0).stop 2024-08-28T20:22:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 shutdown_connections 2024-08-28T20:22:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f683c0b4c70 0x7f683c0b7180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6854104d50 0x7f6854198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68541043b0 0x7f6854198000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 --2- 172.21.15.1:0/4046577773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6854103330 0x7f6854197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:22:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 >> 172.21.15.1:0/4046577773 conn(0x7f68540fec50 msgr2=0x7f68541076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:22:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 shutdown_connections 2024-08-28T20:22:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:22:48.394+0000 7f685aa00640 1 -- 172.21.15.1:0/4046577773 wait complete. 2024-08-28T20:22:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 260.0 s, 2993.0 tps, lat 33.799 ms stddev 39.860 2024-08-28T20:22:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:49 smithi001 ceph-mon[20984]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.3 MiB/s wr, 693 op/s 2024-08-28T20:22:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:49 smithi121 ceph-mon[25248]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.3 MiB/s wr, 693 op/s 2024-08-28T20:22:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:49 smithi007 ceph-mon[25357]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.3 MiB/s wr, 693 op/s 2024-08-28T20:22:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:51 smithi007 ceph-mon[25357]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.1 MiB/s wr, 721 op/s 2024-08-28T20:22:52.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:51 smithi001 ceph-mon[20984]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.1 MiB/s wr, 721 op/s 2024-08-28T20:22:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:51 smithi121 ceph-mon[25248]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.1 MiB/s wr, 721 op/s 2024-08-28T20:22:53.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:53 smithi007 ceph-mon[25357]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 715 op/s 2024-08-28T20:22:53.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:53 smithi001 ceph-mon[20984]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 715 op/s 2024-08-28T20:22:53.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:53 smithi121 ceph-mon[25248]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 715 op/s 2024-08-28T20:22:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 265.0 s, 2638.2 tps, lat 37.883 ms stddev 42.575 2024-08-28T20:22:55.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:55 smithi001 ceph-mon[20984]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 MiB/s wr, 739 op/s 2024-08-28T20:22:55.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:55 smithi121 ceph-mon[25248]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 MiB/s wr, 739 op/s 2024-08-28T20:22:55.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:55 smithi007 ceph-mon[25357]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 MiB/s wr, 739 op/s 2024-08-28T20:22:57.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:57 smithi001 ceph-mon[20984]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 MiB/s wr, 722 op/s 2024-08-28T20:22:57.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:57 smithi121 ceph-mon[25248]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 MiB/s wr, 722 op/s 2024-08-28T20:22:57.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:57 smithi007 ceph-mon[25357]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.2 MiB/s wr, 722 op/s 2024-08-28T20:22:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 270.0 s, 2878.6 tps, lat 34.703 ms stddev 40.304 2024-08-28T20:22:59.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:22:59 smithi001 ceph-mon[20984]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 696 op/s 2024-08-28T20:22:59.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:22:59 smithi121 ceph-mon[25248]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 696 op/s 2024-08-28T20:22:59.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:22:59 smithi007 ceph-mon[25357]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 696 op/s 2024-08-28T20:23:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2443659887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 msgr2=0x7f3b68079d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2443659887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 0x7f3b68079d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b6001acb0 tx=0x7f3b6003b8f0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2443659887 shutdown_connections 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2443659887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 0x7f3b68079d50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2443659887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68078e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2443659887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b680779c0 0x7f3b68077e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2443659887 >> 172.21.15.1:0/2443659887 conn(0x7f3b68100fb0 msgr2=0x7f3b68103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2443659887 shutdown_connections 2024-08-28T20:23:01.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.721+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2443659887 wait complete. 2024-08-28T20:23:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.723+0000 7f3b6fc00640 1 Processor -- start 2024-08-28T20:23:01.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.723+0000 7f3b6fc00640 1 -- start start 2024-08-28T20:23:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.723+0000 7f3b6fc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b680779c0 0x7f3b68197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.723+0000 7f3b6fc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b6fc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 0x7f3b68198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b6fc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b68106ec0 con 0x7f3b680779c0 2024-08-28T20:23:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b6fc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b68106d40 con 0x7f3b68078a40 2024-08-28T20:23:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b6fc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b68107040 con 0x7f3b680793e0 2024-08-28T20:23:01.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:01 smithi001 ceph-mon[20984]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 726 op/s 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41138/0 (socket says 172.21.15.1:41138) 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.724+0000 7f3b67e00640 1 -- 172.21.15.1:0/2018752626 learned_addr learned my addr 172.21.15.1:0/2018752626 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b6dc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 0x7f3b68198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b6d200640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b680779c0 0x7f3b68197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b67e00640 1 -- 172.21.15.1:0/2018752626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 msgr2=0x7f3b68198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b67e00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 0x7f3b68198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b67e00640 1 -- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b680779c0 msgr2=0x7f3b68197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b67e00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b680779c0 0x7f3b68197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b67e00640 1 -- 172.21.15.1:0/2018752626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b681994d0 con 0x7f3b68078a40 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.725+0000 7f3b67e00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68198100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00e9f0 tx=0x7f3b5c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.726+0000 7f3b65600640 1 -- 172.21.15.1:0/2018752626 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00cd80 con 0x7f3b68078a40 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.726+0000 7f3b65600640 1 -- 172.21.15.1:0/2018752626 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5c0054d0 con 0x7f3b68078a40 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.726+0000 7f3b65600640 1 -- 172.21.15.1:0/2018752626 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c010430 con 0x7f3b68078a40 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.726+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b681997c0 con 0x7f3b68078a40 2024-08-28T20:23:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.726+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6819feb0 con 0x7f3b68078a40 2024-08-28T20:23:01.731 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:01 smithi121 ceph-mon[25248]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 726 op/s 2024-08-28T20:23:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.734+0000 7f3b65600640 1 -- 172.21.15.1:0/2018752626 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f3b5c005020 con 0x7f3b68078a40 2024-08-28T20:23:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.736+0000 7f3b65600640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b500b4c30 0x7f3b500b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.736+0000 7f3b76dc5740 1 Processor -- start 2024-08-28T20:23:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.736+0000 7f3b65600640 1 -- 172.21.15.1:0/2018752626 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3b5c0e55a0 con 0x7f3b68078a40 2024-08-28T20:23:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 -- start start 2024-08-28T20:23:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b6d200640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b500b4c30 0x7f3b500b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c7119dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c711a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c711af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c2c708cf70 con 0x55c2c6d741b0 2024-08-28T20:23:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c2c707c500 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.737+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c2c70804b0 con 0x55c2c6d534d0 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c711a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c711a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41144/0 (socket says 172.21.15.1:41144) 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 -- 172.21.15.1:0/1434347220 learned_addr learned my addr 172.21.15.1:0/1434347220 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b6dc00640 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c711af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b6d200640 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c7119dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b6d200640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b500b4c30 0x7f3b500b7140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009b60 tx=0x7f3b54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 -- 172.21.15.1:0/1434347220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 msgr2=0x55c2c711af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c711af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 -- 172.21.15.1:0/1434347220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 msgr2=0x55c2c7119dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c7119dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b67e00640 1 -- 172.21.15.1:0/1434347220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c7036c10 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.738+0000 7f3b6d200640 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c7119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:23:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.739+0000 7f3b67e00640 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c711a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0abef0 tx=0x7f3b5c005310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41069d80ae8391f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.739+0000 7f3b5a000640 1 -- 172.21.15.1:0/1434347220 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0ac660 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.739+0000 7f3b5a000640 1 -- 172.21.15.1:0/1434347220 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5c0abf60 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.739+0000 7f3b5a000640 1 -- 172.21.15.1:0/1434347220 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0b05a0 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1434347220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 msgr2=0x55c2c711a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c711a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0abef0 tx=0x7f3b5c005310 comp rx=0 tx=0).stop 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1434347220 shutdown_connections 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c711af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c711a430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1434347220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c7119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.740+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1434347220 >> 172.21.15.1:0/1434347220 conn(0x55c2c6d68300 msgr2=0x55c2c7115850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.742+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1434347220 shutdown_connections 2024-08-28T20:23:01.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.742+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1434347220 wait complete. 2024-08-28T20:23:01.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.743+0000 7f3b76dc5740 1 -- start start 2024-08-28T20:23:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.743+0000 7f3b76dc5740 1 Processor -- start 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7123510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 0x55c2c7123bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7124740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c2c6fb5ab0 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7023320 con 0x55c2c6d534d0 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c2c711baa0 con 0x55c2c6d741b0 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b76dc5740 10 client.0 _ll_register_callbacks cb 0x55c2c70296a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 0x55c2c7123bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 0x55c2c7123bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41150/0 (socket says 172.21.15.1:41150) 2024-08-28T20:23:01.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b67e00640 1 -- 172.21.15.1:0/1565892895 learned_addr learned my addr 172.21.15.1:0/1565892895 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:01.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.744+0000 7f3b6dc00640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7124740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.745+0000 7f3b67e00640 1 -- 172.21.15.1:0/1565892895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 msgr2=0x55c2c7124740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.745+0000 7f3b67e00640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7124740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.745+0000 7f3b67e00640 1 -- 172.21.15.1:0/1565892895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d4b2f0 msgr2=0x55c2c7123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.745+0000 7f3b67e00640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7123510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.745+0000 7f3b67e00640 1 -- 172.21.15.1:0/1565892895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c6ddf790 con 0x55c2c6d534d0 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.745+0000 7f3b6d200640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.746+0000 7f3b67e00640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 0x55c2c7123bd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0095f0 tx=0x7f3b5c0a8450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4981cd58abd633e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.746+0000 7f3b4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.746+0000 7f3b4ea00640 1 -- 172.21.15.1:0/1565892895 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0c6060 con 0x55c2c6d534d0 2024-08-28T20:23:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.746+0000 7f3b4ea00640 1 -- 172.21.15.1:0/1565892895 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3b5c0b5000 con 0x55c2c6d534d0 2024-08-28T20:23:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.747+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b5c0abf60 con 0x55c2c6d534d0 2024-08-28T20:23:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.747+0000 7f3b4ea00640 1 -- 172.21.15.1:0/1565892895 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3b5c0b5280 con 0x55c2c6d534d0 2024-08-28T20:23:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.747+0000 7f3b76dc5740 10 client.25580 fetch_fsmap learned FSMap version 38 2024-08-28T20:23:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.747+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c2c6e58620 con 0x55c2c6d534d0 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.748+0000 7f3b4ea00640 1 -- 172.21.15.1:0/1565892895 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5c0abf60 con 0x55c2c6d534d0 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.748+0000 7f3b4ea00640 1 -- 172.21.15.1:0/1565892895 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f3b5c0af070 con 0x55c2c6d534d0 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.749+0000 7f3b76dc5740 10 client.25580 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.749+0000 7f3b76dc5740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.749+0000 7f3b76dc5740 20 client.25580 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.749+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d32d80 0x55c2c7130820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.749+0000 7f3b76dc5740 4 client.25580 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:23:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.749+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2c708eec0 con 0x55c2c6d32d80 2024-08-28T20:23:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.750+0000 7f3b6d200640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d32d80 0x55c2c7130820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.751+0000 7f3b6d200640 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d32d80 0x55c2c7130820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac09576a827246f server_cookie=c390b88e16495c23 in_seq=0 out_seq=0 2024-08-28T20:23:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.753+0000 7f3b4ea00640 10 client.25580 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.753+0000 7f3b4ea00640 1 -- 172.21.15.1:0/1565892895 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2c708eec0 con 0x55c2c6d32d80 2024-08-28T20:23:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.753+0000 7f3b4ea00640 10 client.25580 handle_command_reply: tid=0 2024-08-28T20:23:01.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.753+0000 7f3b76dc5740 1 client.25580 shutdown 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.756+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 msgr2=0x55c2c7123bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.756+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 0x55c2c7123bd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0095f0 tx=0x7f3b5c0a8450 comp rx=0 tx=0).stop 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 shutdown_connections 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d32d80 0x55c2c7130820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7124740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d534d0 0x55c2c7123bd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b4ea00640 0 client.25580 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/1565892895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 >> 172.21.15.1:0/1565892895 conn(0x55c2c6d68300 msgr2=0x55c2c7113cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:01.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.757+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 shutdown_connections 2024-08-28T20:23:01.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.761+0000 7f3b76dc5740 1 -- 172.21.15.1:0/1565892895 wait complete. 2024-08-28T20:23:01.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.761+0000 7f3b76dc5740 20 client.25580 trim_cache size 0 max 16384 2024-08-28T20:23:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.808+0000 7f3b76dc5740 1 Processor -- start 2024-08-28T20:23:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.808+0000 7f3b76dc5740 1 -- start start 2024-08-28T20:23:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.809+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7116e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.809+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d534d0 0x55c2c711e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.809+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7122640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681ab510 con 0x55c2c6d534d0 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a8d80 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a6bd0 con 0x55c2c6d741b0 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7116e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7116e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41156/0 (socket says 172.21.15.1:41156) 2024-08-28T20:23:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b6d200640 1 -- 172.21.15.1:0/295772478 learned_addr learned my addr 172.21.15.1:0/295772478 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.810+0000 7f3b6dc00640 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.811+0000 7f3b67e00640 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d534d0 0x55c2c711e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.811+0000 7f3b6d200640 1 -- 172.21.15.1:0/295772478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 msgr2=0x55c2c7122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.811+0000 7f3b6d200640 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7122640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.811+0000 7f3b6d200640 1 -- 172.21.15.1:0/295772478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d534d0 msgr2=0x55c2c711e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.811+0000 7f3b6d200640 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d534d0 0x55c2c711e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.811+0000 7f3b6d200640 1 -- 172.21.15.1:0/295772478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c7110a80 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:01 smithi007 ceph-mon[25357]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 726 op/s 2024-08-28T20:23:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.812+0000 7f3b6d200640 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7116e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55c2c7130f70 tx=0x7f3b54014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace0cf0c82f1fda2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.812+0000 7f3b59600640 1 -- 172.21.15.1:0/295772478 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5402a430 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.813+0000 7f3b59600640 1 -- 172.21.15.1:0/295772478 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5402aa80 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.813+0000 7f3b59600640 1 -- 172.21.15.1:0/295772478 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5401fb70 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 -- 172.21.15.1:0/295772478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 msgr2=0x55c2c7116e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7116e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55c2c7130f70 tx=0x7f3b54014000 comp rx=0 tx=0).stop 2024-08-28T20:23:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 -- 172.21.15.1:0/295772478 shutdown_connections 2024-08-28T20:23:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d534d0 0x55c2c711e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d741b0 0x55c2c7122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/295772478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c7116e10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.814+0000 7f3b76dc5740 1 -- 172.21.15.1:0/295772478 >> 172.21.15.1:0/295772478 conn(0x55c2c6d68300 msgr2=0x55c2c7121f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.815+0000 7f3b76dc5740 1 -- 172.21.15.1:0/295772478 shutdown_connections 2024-08-28T20:23:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.815+0000 7f3b76dc5740 1 -- 172.21.15.1:0/295772478 wait complete. 2024-08-28T20:23:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.816+0000 7f3b76dc5740 1 -- start start 2024-08-28T20:23:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.816+0000 7f3b76dc5740 1 Processor -- start 2024-08-28T20:23:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.817+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c712a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.817+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c712ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.817+0000 7f3b76dc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c71291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.818+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a7240 con 0x55c2c6d741b0 2024-08-28T20:23:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.818+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a86b0 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.818+0000 7f3b76dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a7910 con 0x55c2c6d534d0 2024-08-28T20:23:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.818+0000 7f3b76dc5740 10 client.0 _ll_register_callbacks cb 0x7f3b5c0ab940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.818+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c712a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.818+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c712a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41160/0 (socket says 172.21.15.1:41160) 2024-08-28T20:23:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.819+0000 7f3b6d200640 1 -- 172.21.15.1:0/2883588239 learned_addr learned my addr 172.21.15.1:0/2883588239 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.819+0000 7f3b67e00640 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c712ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.819+0000 7f3b6d200640 1 -- 172.21.15.1:0/2883588239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 msgr2=0x55c2c712ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.819+0000 7f3b6d200640 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c712ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.820+0000 7f3b6d200640 1 -- 172.21.15.1:0/2883588239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 msgr2=0x55c2c71291a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.820+0000 7f3b6d200640 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c71291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.820+0000 7f3b6d200640 1 -- 172.21.15.1:0/2883588239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c712b370 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.821+0000 7f3b6d200640 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c712a5e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011a90 tx=0x7f3b5402ad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e334131d52fcbdc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.821+0000 7f3b4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.821+0000 7f3b4ea00640 1 -- 172.21.15.1:0/2883588239 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5402d040 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.822+0000 7f3b4ea00640 1 -- 172.21.15.1:0/2883588239 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3b5402a840 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.822+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b5402aa80 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.823+0000 7f3b4ea00640 1 -- 172.21.15.1:0/2883588239 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3b54041050 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.823+0000 7f3b76dc5740 10 client.25586 fetch_fsmap learned FSMap version 38 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.823+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c2c719b7c0 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.823+0000 7f3b4ea00640 1 -- 172.21.15.1:0/2883588239 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5402aa80 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.823+0000 7f3b4ea00640 1 -- 172.21.15.1:0/2883588239 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7f3b540046c0 con 0x55c2c6d4b2f0 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b76dc5740 10 client.25586 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b76dc5740 10 client.25586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b76dc5740 20 client.25586 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d081c0 0x55c2c719e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b76dc5740 4 client.25586 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:23:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2c708a960 con 0x55c2c6d081c0 2024-08-28T20:23:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.824+0000 7f3b67e00640 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d081c0 0x55c2c719e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.825+0000 7f3b67e00640 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d081c0 0x55c2c719e230 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6196895a3df83b1 server_cookie=bc2a77a81f866a0 in_seq=0 out_seq=0 2024-08-28T20:23:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.825+0000 7f3b4ea00640 10 client.25586 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.839+0000 7f3b4ea00640 1 -- 172.21.15.1:0/2883588239 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2c708a960 con 0x55c2c6d081c0 2024-08-28T20:23:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.839+0000 7f3b4ea00640 10 client.25586 handle_command_reply: tid=0 2024-08-28T20:23:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.839+0000 7f3b76dc5740 1 client.25586 shutdown 2024-08-28T20:23:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.839+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 msgr2=0x55c2c712a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.839+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c712a5e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011a90 tx=0x7f3b5402ad90 comp rx=0 tx=0).stop 2024-08-28T20:23:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 shutdown_connections 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55c2c6d081c0 0x55c2c719e230 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2c6d741b0 0x55c2c71291a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2c6d534d0 0x55c2c712ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 --2- 172.21.15.1:0/2883588239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c2c6d4b2f0 0x55c2c712a5e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 >> 172.21.15.1:0/2883588239 conn(0x55c2c6d68300 msgr2=0x55c2c71228f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b4ea00640 0 client.25586 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 shutdown_connections 2024-08-28T20:23:01.843 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 1 -- 172.21.15.1:0/2883588239 wait complete. 2024-08-28T20:23:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.840+0000 7f3b76dc5740 20 client.25586 trim_cache size 0 max 16384 2024-08-28T20:23:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:23:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:23:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:23:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:23:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b500b4c30 msgr2=0x7f3b500b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b500b4c30 0x7f3b500b7140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009b60 tx=0x7f3b54005f90 comp rx=0 tx=0).stop 2024-08-28T20:23:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 msgr2=0x7f3b68198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68198100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00e9f0 tx=0x7f3b5c00edf0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 shutdown_connections 2024-08-28T20:23:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3b500b4c30 0x7f3b500b7140 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b680793e0 0x7f3b68198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b68078a40 0x7f3b68198100 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 --2- 172.21.15.1:0/2018752626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b680779c0 0x7f3b68197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.842+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 >> 172.21.15.1:0/2018752626 conn(0x7f3b68100fb0 msgr2=0x7f3b6818e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.843+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 shutdown_connections 2024-08-28T20:23:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:01.843+0000 7f3b6fc00640 1 -- 172.21.15.1:0/2018752626 wait complete. 2024-08-28T20:23:03.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:03 smithi001 ceph-mon[20984]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.8 MiB/s wr, 725 op/s 2024-08-28T20:23:03.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:03 smithi121 ceph-mon[25248]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.8 MiB/s wr, 725 op/s 2024-08-28T20:23:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 275.0 s, 3019.8 tps, lat 32.974 ms stddev 40.428 2024-08-28T20:23:03.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:03 smithi007 ceph-mon[25357]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.8 MiB/s wr, 725 op/s 2024-08-28T20:23:05.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:05 smithi001 ceph-mon[20984]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 742 op/s 2024-08-28T20:23:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:05 smithi121 ceph-mon[25248]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 742 op/s 2024-08-28T20:23:05.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:05 smithi007 ceph-mon[25357]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 742 op/s 2024-08-28T20:23:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:07 smithi001 ceph-mon[20984]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 763 op/s 2024-08-28T20:23:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:07 smithi121 ceph-mon[25248]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 763 op/s 2024-08-28T20:23:07.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:07 smithi007 ceph-mon[25357]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.3 MiB/s wr, 763 op/s 2024-08-28T20:23:08.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 280.0 s, 2994.3 tps, lat 33.381 ms stddev 38.194 2024-08-28T20:23:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:09 smithi001 ceph-mon[20984]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-08-28T20:23:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:09 smithi121 ceph-mon[25248]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-08-28T20:23:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:09 smithi007 ceph-mon[25357]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 682 op/s 2024-08-28T20:23:11.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:11 smithi001 ceph-mon[20984]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 794 op/s 2024-08-28T20:23:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:11 smithi121 ceph-mon[25248]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 794 op/s 2024-08-28T20:23:11.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:11 smithi007 ceph-mon[25357]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 794 op/s 2024-08-28T20:23:13.729 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:13 smithi001 ceph-mon[20984]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 786 op/s 2024-08-28T20:23:13.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:13 smithi121 ceph-mon[25248]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 786 op/s 2024-08-28T20:23:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 285.0 s, 2147.9 tps, lat 46.455 ms stddev 54.594 2024-08-28T20:23:13.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:13 smithi007 ceph-mon[25357]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 786 op/s 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 -- 172.21.15.1:0/3273519657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64107090 msgr2=0x7fcc6410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 --2- 172.21.15.1:0/3273519657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64107090 0x7fcc6410da30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009ca0 tx=0x7fcc5c02a8b0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 -- 172.21.15.1:0/3273519657 shutdown_connections 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 --2- 172.21.15.1:0/3273519657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64107090 0x7fcc6410da30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 --2- 172.21.15.1:0/3273519657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc641066f0 0x7fcc64106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 --2- 172.21.15.1:0/3273519657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc64105670 0x7fcc64105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 -- 172.21.15.1:0/3273519657 >> 172.21.15.1:0/3273519657 conn(0x7fcc64100fd0 msgr2=0x7fcc64103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 -- 172.21.15.1:0/3273519657 shutdown_connections 2024-08-28T20:23:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.130+0000 7fcc6b200640 1 -- 172.21.15.1:0/3273519657 wait complete. 2024-08-28T20:23:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.132+0000 7fcc6b200640 1 Processor -- start 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.132+0000 7fcc6b200640 1 -- start start 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.132+0000 7fcc6b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 0x7fcc641a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.132+0000 7fcc6b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc641066f0 0x7fcc641a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.132+0000 7fcc6b200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc64107090 0x7fcc641a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc6b200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc64078250 con 0x7fcc64107090 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc6b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc640780d0 con 0x7fcc641066f0 2024-08-28T20:23:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc6b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc640783d0 con 0x7fcc64105670 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 0x7fcc641a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 0x7fcc641a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34572/0 (socket says 172.21.15.1:34572) 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 -- 172.21.15.1:0/1451741993 learned_addr learned my addr 172.21.15.1:0/1451741993 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63400640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc641066f0 0x7fcc641a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 -- 172.21.15.1:0/1451741993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc641066f0 msgr2=0x7fcc641a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc641066f0 0x7fcc641a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 -- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc64107090 msgr2=0x7fcc641a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.133+0000 7fcc63e00640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc64107090 0x7fcc641a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.134+0000 7fcc63e00640 1 -- 172.21.15.1:0/1451741993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc641a1cc0 con 0x7fcc64105670 2024-08-28T20:23:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.134+0000 7fcc63e00640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 0x7fcc641a0280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400d950 tx=0x7fcc5400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.135+0000 7fcc60c00640 1 -- 172.21.15.1:0/1451741993 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54017030 con 0x7fcc64105670 2024-08-28T20:23:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.135+0000 7fcc60c00640 1 -- 172.21.15.1:0/1451741993 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc54004020 con 0x7fcc64105670 2024-08-28T20:23:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.135+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc641a1fb0 con 0x7fcc64105670 2024-08-28T20:23:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.135+0000 7fcc60c00640 1 -- 172.21.15.1:0/1451741993 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc540047a0 con 0x7fcc64105670 2024-08-28T20:23:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.135+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc641a86a0 con 0x7fcc64105670 2024-08-28T20:23:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.140+0000 7fcc723f3740 1 Processor -- start 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 -- start start 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf710a1b0 0x562bf74afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562bf7422f70 con 0x562bf710a1b0 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562bf7412500 con 0x562bf70e94d0 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.142+0000 7fcc723f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562bf74164b0 con 0x562bf70e12f0 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.143+0000 7fcc63400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.143+0000 7fcc69200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf710a1b0 0x562bf74afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.143+0000 7fcc63400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57792/0 (socket says 172.21.15.1:57792) 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.143+0000 7fcc60c00640 1 -- 172.21.15.1:0/1451741993 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fcc54009a30 con 0x7fcc64105670 2024-08-28T20:23:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.143+0000 7fcc63400640 1 -- 172.21.15.1:0/1479149720 learned_addr learned my addr 172.21.15.1:0/1479149720 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.144+0000 7fcc63e00640 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.144+0000 7fcc63400640 1 -- 172.21.15.1:0/1479149720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 msgr2=0x562bf74b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.144+0000 7fcc63400640 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.144+0000 7fcc63400640 1 -- 172.21.15.1:0/1479149720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf710a1b0 msgr2=0x562bf74afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.144+0000 7fcc63400640 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf710a1b0 0x562bf74afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.144+0000 7fcc63400640 1 -- 172.21.15.1:0/1479149720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf73ccc10 con 0x562bf70e94d0 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.145+0000 7fcc63400640 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74b0cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009c70 tx=0x7fcc50011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dccb2ebbcba92950 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.145+0000 7fcc59600640 1 -- 172.21.15.1:0/1479149720 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50004230 con 0x562bf70e94d0 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.145+0000 7fcc59600640 1 -- 172.21.15.1:0/1479149720 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc500043d0 con 0x562bf70e94d0 2024-08-28T20:23:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.145+0000 7fcc59600640 1 -- 172.21.15.1:0/1479149720 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50019710 con 0x562bf70e94d0 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.146+0000 7fcc60c00640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcc480b4d00 0x7fcc480b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 -- 172.21.15.1:0/1479149720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 msgr2=0x562bf74b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74b0cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009c70 tx=0x7fcc50011810 comp rx=0 tx=0).stop 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 -- 172.21.15.1:0/1479149720 shutdown_connections 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74b0cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1479149720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf710a1b0 0x562bf74afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 -- 172.21.15.1:0/1479149720 >> 172.21.15.1:0/1479149720 conn(0x562bf70fe300 msgr2=0x562bf74ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc723f3740 1 -- 172.21.15.1:0/1479149720 shutdown_connections 2024-08-28T20:23:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.147+0000 7fcc69200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcc480b4d00 0x7fcc480b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.150+0000 7fcc60c00640 1 -- 172.21.15.1:0/1451741993 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fcc540e4b60 con 0x7fcc64105670 2024-08-28T20:23:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.152+0000 7fcc69200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcc480b4d00 0x7fcc480b7210 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c031040 tx=0x7fcc5c030760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.153+0000 7fcc723f3740 1 -- 172.21.15.1:0/1479149720 wait complete. 2024-08-28T20:23:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.153+0000 7fcc723f3740 1 -- start start 2024-08-28T20:23:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 Processor -- start 2024-08-28T20:23:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e94d0 0x562bf74b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562bf734bab0 con 0x562bf70e94d0 2024-08-28T20:23:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562bf73b9320 con 0x562bf710a1b0 2024-08-28T20:23:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.154+0000 7fcc723f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562bf74b1810 con 0x562bf70e12f0 2024-08-28T20:23:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.155+0000 7fcc723f3740 10 client.0 _ll_register_callbacks cb 0x562bf73f2e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.156+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.156+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34592/0 (socket says 172.21.15.1:34592) 2024-08-28T20:23:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.156+0000 7fcc63e00640 1 -- 172.21.15.1:0/427864566 learned_addr learned my addr 172.21.15.1:0/427864566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.156+0000 7fcc69200640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc69200640 1 -- 172.21.15.1:0/427864566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 msgr2=0x562bf74b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc69200640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc69200640 1 -- 172.21.15.1:0/427864566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e94d0 msgr2=0x562bf74b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc63400640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e94d0 0x562bf74b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc69200640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e94d0 0x562bf74b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc69200640 1 -- 172.21.15.1:0/427864566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf7175790 con 0x562bf710a1b0 2024-08-28T20:23:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.157+0000 7fcc63400640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e94d0 0x562bf74b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.158+0000 7fcc4e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.158+0000 7fcc69200640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74ba3a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c030860 tx=0x7fcc5c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=844bfed1a15f304e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.159+0000 7fcc4e000640 1 -- 172.21.15.1:0/427864566 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c004180 con 0x562bf710a1b0 2024-08-28T20:23:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.163+0000 7fcc4e000640 1 -- 172.21.15.1:0/427864566 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fcc5c003f80 con 0x562bf710a1b0 2024-08-28T20:23:15.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.164+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc500043d0 con 0x562bf710a1b0 2024-08-28T20:23:15.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.164+0000 7fcc4e000640 1 -- 172.21.15.1:0/427864566 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcc5c004180 con 0x562bf710a1b0 2024-08-28T20:23:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.165+0000 7fcc723f3740 10 client.25598 fetch_fsmap learned FSMap version 38 2024-08-28T20:23:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.165+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562bf71ee620 con 0x562bf710a1b0 2024-08-28T20:23:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.167+0000 7fcc4e000640 1 -- 172.21.15.1:0/427864566 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc500043d0 con 0x562bf710a1b0 2024-08-28T20:23:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc4e000640 1 -- 172.21.15.1:0/427864566 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fcc5c04e070 con 0x562bf710a1b0 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc723f3740 10 client.25598 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc723f3740 10 client.25598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc723f3740 20 client.25598 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc723f3740 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf70c8d80 0x562bf74c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc723f3740 4 client.25598 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.168+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bf7424ec0 con 0x562bf70c8d80 2024-08-28T20:23:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.170+0000 7fcc63e00640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf70c8d80 0x562bf74c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.172+0000 7fcc63e00640 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf70c8d80 0x562bf74c6a10 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf194b952f3ae47 server_cookie=a25679072cf044bb in_seq=0 out_seq=0 2024-08-28T20:23:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.173+0000 7fcc4e000640 10 client.25598 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.174+0000 7fcc4e000640 1 -- 172.21.15.1:0/427864566 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bf7424ec0 con 0x562bf70c8d80 2024-08-28T20:23:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.174+0000 7fcc4e000640 10 client.25598 handle_command_reply: tid=0 2024-08-28T20:23:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.174+0000 7fcc723f3740 1 client.25598 shutdown 2024-08-28T20:23:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 msgr2=0x562bf74ba3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74ba3a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c030860 tx=0x7fcc5c0095c0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 shutdown_connections 2024-08-28T20:23:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf70c8d80 0x562bf74c6a10 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e94d0 0x562bf74b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74ba3a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 --2- 172.21.15.1:0/427864566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e12f0 0x562bf74b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 >> 172.21.15.1:0/427864566 conn(0x562bf70fe300 msgr2=0x562bf74a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc4e000640 0 client.25598 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 shutdown_connections 2024-08-28T20:23:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.175+0000 7fcc723f3740 1 -- 172.21.15.1:0/427864566 wait complete. 2024-08-28T20:23:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.176+0000 7fcc723f3740 20 client.25598 trim_cache size 0 max 16384 2024-08-28T20:23:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.233+0000 7fcc723f3740 1 Processor -- start 2024-08-28T20:23:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.233+0000 7fcc723f3740 1 -- start start 2024-08-28T20:23:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 0x562bf74a6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc723f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc641b3c80 con 0x562bf70e12f0 2024-08-28T20:23:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc723f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc641b14f0 con 0x562bf710a1b0 2024-08-28T20:23:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc723f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc641af340 con 0x562bf70e94d0 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc63400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 0x562bf74a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc63400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 0x562bf74a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34596/0 (socket says 172.21.15.1:34596) 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.234+0000 7fcc63400640 1 -- 172.21.15.1:0/4230403977 learned_addr learned my addr 172.21.15.1:0/4230403977 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63e00640 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc69200640 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63400640 1 -- 172.21.15.1:0/4230403977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 msgr2=0x562bf74b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63400640 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63400640 1 -- 172.21.15.1:0/4230403977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 msgr2=0x562bf74b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63400640 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63400640 1 -- 172.21.15.1:0/4230403977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf74b0560 con 0x562bf70e94d0 2024-08-28T20:23:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63e00640 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc63400640 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 0x562bf74a6240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009380 tx=0x7fcc500096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=296b25eacd60a311 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc58c00640 1 -- 172.21.15.1:0/4230403977 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50005240 con 0x562bf70e94d0 2024-08-28T20:23:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc58c00640 1 -- 172.21.15.1:0/4230403977 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc50003aa0 con 0x562bf70e94d0 2024-08-28T20:23:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.235+0000 7fcc58c00640 1 -- 172.21.15.1:0/4230403977 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50022830 con 0x562bf70e94d0 2024-08-28T20:23:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 -- 172.21.15.1:0/4230403977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 msgr2=0x562bf74a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 0x562bf74a6240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009380 tx=0x7fcc500096e0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 -- 172.21.15.1:0/4230403977 shutdown_connections 2024-08-28T20:23:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf710a1b0 0x562bf74b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf70e94d0 0x562bf74a6240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 --2- 172.21.15.1:0/4230403977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 -- 172.21.15.1:0/4230403977 >> 172.21.15.1:0/4230403977 conn(0x562bf70fe300 msgr2=0x562bf74b8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 -- 172.21.15.1:0/4230403977 shutdown_connections 2024-08-28T20:23:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.238+0000 7fcc723f3740 1 -- 172.21.15.1:0/4230403977 wait complete. 2024-08-28T20:23:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.239+0000 7fcc723f3740 1 -- start start 2024-08-28T20:23:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.239+0000 7fcc723f3740 1 Processor -- start 2024-08-28T20:23:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 0x562bf74c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc641af9b0 con 0x562bf70e12f0 2024-08-28T20:23:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc641b0e20 con 0x562bf70e94d0 2024-08-28T20:23:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc641b0080 con 0x562bf710a1b0 2024-08-28T20:23:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc723f3740 10 client.0 _ll_register_callbacks cb 0x7fcc5c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc63e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc69200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 0x562bf74c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc69200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 0x562bf74c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34602/0 (socket says 172.21.15.1:34602) 2024-08-28T20:23:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc69200640 1 -- 172.21.15.1:0/1550816272 learned_addr learned my addr 172.21.15.1:0/1550816272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.240+0000 7fcc63400640 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc69200640 1 -- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 msgr2=0x562bf74bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc69200640 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc69200640 1 -- 172.21.15.1:0/1550816272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 msgr2=0x562bf74c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc69200640 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74c0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc69200640 1 -- 172.21.15.1:0/1550816272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf74c0a00 con 0x562bf710a1b0 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc69200640 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 0x562bf74c0270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c055040 tx=0x7fcc5c003d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4562dd13a5e393b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc4e000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc4e000640 1 -- 172.21.15.1:0/1550816272 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c05f070 con 0x562bf710a1b0 2024-08-28T20:23:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc4e000640 1 -- 172.21.15.1:0/1550816272 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fcc5c003f80 con 0x562bf710a1b0 2024-08-28T20:23:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.242+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc50003aa0 con 0x562bf710a1b0 2024-08-28T20:23:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.243+0000 7fcc4e000640 1 -- 172.21.15.1:0/1550816272 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcc5c069050 con 0x562bf710a1b0 2024-08-28T20:23:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.243+0000 7fcc723f3740 10 client.25573 fetch_fsmap learned FSMap version 38 2024-08-28T20:23:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.243+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562bf75313d0 con 0x562bf710a1b0 2024-08-28T20:23:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.244+0000 7fcc4e000640 1 -- 172.21.15.1:0/1550816272 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc50003aa0 con 0x562bf710a1b0 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc4e000640 1 -- 172.21.15.1:0/1550816272 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fcc5c04e040 con 0x562bf710a1b0 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc723f3740 10 client.25573 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc723f3740 10 client.25573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc723f3740 20 client.25573 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf709e1c0 0x562bf7533e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc723f3740 4 client.25573 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562bf7420960 con 0x562bf709e1c0 2024-08-28T20:23:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.245+0000 7fcc63e00640 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf709e1c0 0x562bf7533e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.246+0000 7fcc4e000640 10 client.25573 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.246+0000 7fcc63e00640 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf709e1c0 0x562bf7533e10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36882b75719a6bb3 server_cookie=9626cbefc19528f0 in_seq=0 out_seq=0 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc4e000640 1 -- 172.21.15.1:0/1550816272 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562bf7420960 con 0x562bf709e1c0 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc4e000640 10 client.25573 handle_command_reply: tid=0 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 client.25573 shutdown 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 msgr2=0x562bf74c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 0x562bf74c0270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c055040 tx=0x7fcc5c003d40 comp rx=0 tx=0).stop 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 shutdown_connections 2024-08-28T20:23:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562bf709e1c0 0x562bf7533e10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562bf710a1b0 0x562bf74c0270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf70e94d0 0x562bf74bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 --2- 172.21.15.1:0/1550816272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562bf70e12f0 0x562bf74c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc4e000640 0 client.25573 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 >> 172.21.15.1:0/1550816272 conn(0x562bf70fe300 msgr2=0x562bf74a6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.263+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 shutdown_connections 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.264+0000 7fcc723f3740 1 -- 172.21.15.1:0/1550816272 wait complete. 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.264+0000 7fcc723f3740 20 client.25573 trim_cache size 0 max 16384 2024-08-28T20:23:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:23:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:23:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:23:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.264+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcc480b4d00 msgr2=0x7fcc480b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.264+0000 7fcc6b200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcc480b4d00 0x7fcc480b7210 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c031040 tx=0x7fcc5c030760 comp rx=0 tx=0).stop 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.264+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 msgr2=0x7fcc641a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.264+0000 7fcc6b200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 0x7fcc641a0280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400d950 tx=0x7fcc5400de10 comp rx=0 tx=0).stop 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 shutdown_connections 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fcc480b4d00 0x7fcc480b7210 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc64107090 0x7fcc641a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc641066f0 0x7fcc641a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 --2- 172.21.15.1:0/1451741993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc64105670 0x7fcc641a0280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 >> 172.21.15.1:0/1451741993 conn(0x7fcc64100fd0 msgr2=0x7fcc6407ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 shutdown_connections 2024-08-28T20:23:15.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:15.265+0000 7fcc6b200640 1 -- 172.21.15.1:0/1451741993 wait complete. 2024-08-28T20:23:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:15 smithi007 ceph-mon[25357]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 738 op/s 2024-08-28T20:23:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:15 smithi001 ceph-mon[20984]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 738 op/s 2024-08-28T20:23:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:15 smithi121 ceph-mon[25248]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 738 op/s 2024-08-28T20:23:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:17 smithi007 ceph-mon[25357]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 MiB/s wr, 700 op/s 2024-08-28T20:23:18.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:17 smithi001 ceph-mon[20984]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 MiB/s wr, 700 op/s 2024-08-28T20:23:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:17 smithi121 ceph-mon[25248]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.2 MiB/s wr, 700 op/s 2024-08-28T20:23:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 290.0 s, 2329.8 tps, lat 42.924 ms stddev 50.747 2024-08-28T20:23:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:19 smithi007 ceph-mon[25357]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 691 op/s 2024-08-28T20:23:20.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:19 smithi001 ceph-mon[20984]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 691 op/s 2024-08-28T20:23:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:19 smithi121 ceph-mon[25248]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 691 op/s 2024-08-28T20:23:22.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:21 smithi007 ceph-mon[25357]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 733 op/s 2024-08-28T20:23:22.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:21 smithi001 ceph-mon[20984]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 733 op/s 2024-08-28T20:23:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:21 smithi121 ceph-mon[25248]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 733 op/s 2024-08-28T20:23:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 295.0 s, 2662.2 tps, lat 37.678 ms stddev 46.816 2024-08-28T20:23:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:23 smithi007 ceph-mon[25357]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 623 op/s 2024-08-28T20:23:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:23 smithi001 ceph-mon[20984]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 623 op/s 2024-08-28T20:23:24.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:23 smithi121 ceph-mon[25248]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 623 op/s 2024-08-28T20:23:25.130 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:24 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:23:25.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:24 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:23:25.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:24 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:23:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:25 smithi001 ceph-mon[20984]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 665 op/s 2024-08-28T20:23:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:25 smithi121 ceph-mon[25248]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 665 op/s 2024-08-28T20:23:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:25 smithi007 ceph-mon[25357]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 665 op/s 2024-08-28T20:23:27.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:23:27.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:23:27.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:23:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:23:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:23:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:23:27.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:23:27.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:23:27.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:23:28.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:27 smithi001 ceph-mon[20984]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2024-08-28T20:23:28.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:27 smithi121 ceph-mon[25248]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2024-08-28T20:23:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:27 smithi007 ceph-mon[25357]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2024-08-28T20:23:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 -- 172.21.15.1:0/3406782656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8103460 msgr2=0x7fbbc81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/3406782656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8103460 0x7fbbc81038d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009900 tx=0x7fbbb402a410 comp rx=0 tx=0).stop 2024-08-28T20:23:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 -- 172.21.15.1:0/3406782656 shutdown_connections 2024-08-28T20:23:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/3406782656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 0x7fbbc81048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/3406782656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 0x7fbbc810b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/3406782656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8103460 0x7fbbc81038d0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009900 tx=0x7fbbb402a410 comp rx=0 tx=0).stop 2024-08-28T20:23:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.579+0000 7fbbcfc00640 1 -- 172.21.15.1:0/3406782656 >> 172.21.15.1:0/3406782656 conn(0x7fbbc80feda0 msgr2=0x7fbbc8101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.581+0000 7fbbcfc00640 1 -- 172.21.15.1:0/3406782656 shutdown_connections 2024-08-28T20:23:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.581+0000 7fbbcfc00640 1 -- 172.21.15.1:0/3406782656 wait complete. 2024-08-28T20:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.584+0000 7fbbcfc00640 1 Processor -- start 2024-08-28T20:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.585+0000 7fbbcfc00640 1 -- start start 2024-08-28T20:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcfc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 0x7fbbc8105c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcfc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 0x7fbbc81062e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcfc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 0x7fbbc81072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcfc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc810f150 con 0x7fbbc81044e0 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcfc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc810efd0 con 0x7fbbc8104e80 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcfc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc810f2d0 con 0x7fbbc8106da0 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcdc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 0x7fbbc81072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcdc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 0x7fbbc81072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44040/0 (socket says 172.21.15.1:44040) 2024-08-28T20:23:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.586+0000 7fbbcdc00640 1 -- 172.21.15.1:0/2889752552 learned_addr learned my addr 172.21.15.1:0/2889752552 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcd200640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 0x7fbbc8105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcdc00640 1 -- 172.21.15.1:0/2889752552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 msgr2=0x7fbbc81062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 0x7fbbc81062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 0x7fbbc81062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcdc00640 1 -- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 msgr2=0x7fbbc8105c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 0x7fbbc8105c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcdc00640 1 -- 172.21.15.1:0/2889752552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc8107ac0 con 0x7fbbc8106da0 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.587+0000 7fbbcd200640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 0x7fbbc8105c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.588+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 0x7fbbc81062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.588+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 0x7fbbc81072a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009fd0 tx=0x7fbbc000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.588+0000 7fbbc5600640 1 -- 172.21.15.1:0/2889752552 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0017070 con 0x7fbbc8106da0 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.588+0000 7fbbc5600640 1 -- 172.21.15.1:0/2889752552 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc0003e20 con 0x7fbbc8106da0 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.588+0000 7fbbc5600640 1 -- 172.21.15.1:0/2889752552 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00106c0 con 0x7fbbc8106da0 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.589+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc8107e20 con 0x7fbbc8106da0 2024-08-28T20:23:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.589+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc8108320 con 0x7fbbc8106da0 2024-08-28T20:23:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.595+0000 7fbbc5600640 1 -- 172.21.15.1:0/2889752552 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbbc0004140 con 0x7fbbc8106da0 2024-08-28T20:23:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.596+0000 7fbbd6e4f740 1 Processor -- start 2024-08-28T20:23:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.597+0000 7fbbd6e4f740 1 -- start start 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fde2f0 0x55a5753ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fe64d0 0x55a5753adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a57531ff70 con 0x55a574fde2f0 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a57530f500 con 0x55a5750071b0 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a5753134b0 con 0x55a574fe64d0 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbc7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbc7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:37354/0 (socket says 172.21.15.1:37354) 2024-08-28T20:23:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbc7e00640 1 -- 172.21.15.1:0/1855868198 learned_addr learned my addr 172.21.15.1:0/1855868198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fde2f0 0x55a5753ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.598+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fe64d0 0x55a5753adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.599+0000 7fbbcd200640 1 -- 172.21.15.1:0/1855868198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fe64d0 msgr2=0x55a5753adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.599+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fe64d0 0x55a5753adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.599+0000 7fbbcd200640 1 -- 172.21.15.1:0/1855868198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 msgr2=0x55a5753acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.599+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.599+0000 7fbbcd200640 1 -- 172.21.15.1:0/1855868198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5752c9c10 con 0x55a574fde2f0 2024-08-28T20:23:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.600+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fde2f0 0x55a5753ad430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4008000 tx=0x7fbbb40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7e741e9dfc3a73 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.601+0000 7fbbc5600640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbac0c5bf0 0x7fbbac0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.602+0000 7fbbbe000640 1 -- 172.21.15.1:0/1855868198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb403f070 con 0x55a574fde2f0 2024-08-28T20:23:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.602+0000 7fbbc5600640 1 -- 172.21.15.1:0/2889752552 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbbc00e4ee0 con 0x7fbbc8106da0 2024-08-28T20:23:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.602+0000 7fbbbe000640 1 -- 172.21.15.1:0/1855868198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb4005de0 con 0x55a574fde2f0 2024-08-28T20:23:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.602+0000 7fbbbe000640 1 -- 172.21.15.1:0/1855868198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4035070 con 0x55a574fde2f0 2024-08-28T20:23:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.603+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbac0c5bf0 0x7fbbac0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1855868198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fde2f0 msgr2=0x55a5753ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fde2f0 0x55a5753ad430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4008000 tx=0x7fbbb40043d0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1855868198 shutdown_connections 2024-08-28T20:23:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fde2f0 0x55a5753ad430 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fe64d0 0x55a5753adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1855868198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1855868198 >> 172.21.15.1:0/1855868198 conn(0x55a574ffb300 msgr2=0x55a5753a8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbac0c5bf0 0x7fbbac0c8100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800afd0 tx=0x7fbbb800a1f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1855868198 shutdown_connections 2024-08-28T20:23:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.605+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1855868198 wait complete. 2024-08-28T20:23:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.606+0000 7fbbd6e4f740 1 -- start start 2024-08-28T20:23:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.606+0000 7fbbd6e4f740 1 Processor -- start 2024-08-28T20:23:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.610+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a575248ab0 con 0x55a574fe64d0 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a5752b6320 con 0x55a5750071b0 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a5753aea40 con 0x55a574fde2f0 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbcd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbd6e4f740 10 client.0 _ll_register_callbacks cb 0x55a5752bc6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.611+0000 7fbbcd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44046/0 (socket says 172.21.15.1:44046) 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcd200640 1 -- 172.21.15.1:0/933059642 learned_addr learned my addr 172.21.15.1:0/933059642 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 -- 172.21.15.1:0/933059642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 msgr2=0x55a5753b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 -- 172.21.15.1:0/933059642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 msgr2=0x55a5753b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 -- 172.21.15.1:0/933059642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a575072790 con 0x55a5750071b0 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:28.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b7640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00a8b10 tx=0x7fbbc00ab2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeeaa213a0c69b57 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.612+0000 7fbbb2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbb2a00640 1 -- 172.21.15.1:0/933059642 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00abfa0 con 0x55a5750071b0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a575321ec0 con 0x55a5750071b0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbb2a00640 1 -- 172.21.15.1:0/933059642 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbbc0003b80 con 0x55a5750071b0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbb2a00640 1 -- 172.21.15.1:0/933059642 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbbc00ab8a0 con 0x55a5750071b0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbd6e4f740 10 client.25613 fetch_fsmap learned FSMap version 38 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a5750eb620 con 0x55a5750071b0 2024-08-28T20:23:28.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.613+0000 7fbbb2a00640 1 -- 172.21.15.1:0/933059642 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a575321ec0 con 0x55a5750071b0 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbb2a00640 1 -- 172.21.15.1:0/933059642 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbbc00aab00 con 0x55a5750071b0 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbd6e4f740 10 client.25613 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbd6e4f740 10 client.25613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbd6e4f740 20 client.25613 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574fc5d80 0x55a5753c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbd6e4f740 4 client.25613 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.614+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a57531d960 con 0x55a574fc5d80 2024-08-28T20:23:28.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.615+0000 7fbbcd200640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574fc5d80 0x55a5753c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.616+0000 7fbbcd200640 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574fc5d80 0x55a5753c3c00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17582f6f5fc41e54 server_cookie=e46f8a921c2a80a8 in_seq=0 out_seq=0 2024-08-28T20:23:28.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.616+0000 7fbbb2a00640 10 client.25613 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:28.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.618+0000 7fbbb2a00640 1 -- 172.21.15.1:0/933059642 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a57531d960 con 0x55a574fc5d80 2024-08-28T20:23:28.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.618+0000 7fbbb2a00640 10 client.25613 handle_command_reply: tid=0 2024-08-28T20:23:28.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.618+0000 7fbbd6e4f740 1 client.25613 shutdown 2024-08-28T20:23:28.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.618+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 msgr2=0x55a5753b7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.618+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b7640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00a8b10 tx=0x7fbbc00ab2e0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 shutdown_connections 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574fc5d80 0x55a5753c3c00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b7640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/933059642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 >> 172.21.15.1:0/933059642 conn(0x55a574ffb300 msgr2=0x55a5753a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbb2a00640 0 client.25613 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 shutdown_connections 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/933059642 wait complete. 2024-08-28T20:23:28.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.619+0000 7fbbd6e4f740 20 client.25613 trim_cache size 0 max 16384 2024-08-28T20:23:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.651+0000 7fbbd6e4f740 1 Processor -- start 2024-08-28T20:23:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 -- start start 2024-08-28T20:23:28.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753a7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81abad0 con 0x55a574fe64d0 2024-08-28T20:23:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc80741e0 con 0x55a5750071b0 2024-08-28T20:23:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.652+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc8072030 con 0x55a574fde2f0 2024-08-28T20:23:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753a7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44054/0 (socket says 172.21.15.1:44054) 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcd200640 1 -- 172.21.15.1:0/1952882367 learned_addr learned my addr 172.21.15.1:0/1952882367 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcdc00640 1 -- 172.21.15.1:0/1952882367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 msgr2=0x55a5753a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753a7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.653+0000 7fbbcdc00640 1 -- 172.21.15.1:0/1952882367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 msgr2=0x55a5753a79a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.654+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.654+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753a79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.654+0000 7fbbcdc00640 1 -- 172.21.15.1:0/1952882367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5753aeb80 con 0x55a5750071b0 2024-08-28T20:23:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.654+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.654+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b2300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0005c40 tx=0x7fbbc00a77f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150ddd23ae2bafa8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.655+0000 7fbbbd600640 1 -- 172.21.15.1:0/1952882367 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00b0110 con 0x55a5750071b0 2024-08-28T20:23:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.655+0000 7fbbbd600640 1 -- 172.21.15.1:0/1952882367 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc00b4bc0 con 0x55a5750071b0 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.655+0000 7fbbbd600640 1 -- 172.21.15.1:0/1952882367 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00aa570 con 0x55a5750071b0 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1952882367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 msgr2=0x55a5753b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b2300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0005c40 tx=0x7fbbc00a77f0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1952882367 shutdown_connections 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a574fe64d0 0x55a5753a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5750071b0 0x55a5753b2300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1952882367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1952882367 >> 172.21.15.1:0/1952882367 conn(0x55a574ffb300 msgr2=0x55a5753b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1952882367 shutdown_connections 2024-08-28T20:23:28.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1952882367 wait complete. 2024-08-28T20:23:28.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.656+0000 7fbbd6e4f740 1 -- start start 2024-08-28T20:23:28.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 Processor -- start 2024-08-28T20:23:28.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a574fe64d0 0x55a5753bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5750071b0 0x55a5753bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc80726a0 con 0x55a5750071b0 2024-08-28T20:23:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc8073b10 con 0x55a574fe64d0 2024-08-28T20:23:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc8072d70 con 0x55a574fde2f0 2024-08-28T20:23:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.657+0000 7fbbd6e4f740 10 client.0 _ll_register_callbacks cb 0x7fbbc00ab700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbc7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a574fe64d0 0x55a5753bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753bd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44070/0 (socket says 172.21.15.1:44070) 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 -- 172.21.15.1:0/1224024678 learned_addr learned my addr 172.21.15.1:0/1224024678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5750071b0 0x55a5753bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 -- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a574fe64d0 msgr2=0x55a5753bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a574fe64d0 0x55a5753bddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 -- 172.21.15.1:0/1224024678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5750071b0 msgr2=0x55a5753bc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5750071b0 0x55a5753bc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.658+0000 7fbbcd200640 1 -- 172.21.15.1:0/1224024678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5753bc820 con 0x55a574fde2f0 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.659+0000 7fbbcdc00640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5750071b0 0x55a5753bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.659+0000 7fbbb2a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:23:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.659+0000 7fbbcd200640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753bd720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55a5753c43a0 tx=0x7fbbb40045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f59433cfd58449 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.660+0000 7fbbb2a00640 1 -- 172.21.15.1:0/1224024678 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb405a060 con 0x55a574fde2f0 2024-08-28T20:23:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.660+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc00b4bc0 con 0x55a574fde2f0 2024-08-28T20:23:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.660+0000 7fbbb2a00640 1 -- 172.21.15.1:0/1224024678 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbbb4052070 con 0x55a574fde2f0 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.661+0000 7fbbb2a00640 1 -- 172.21.15.1:0/1224024678 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbbb405a060 con 0x55a574fde2f0 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.661+0000 7fbbd6e4f740 10 client.25591 fetch_fsmap learned FSMap version 38 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.661+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a57542ee00 con 0x55a574fde2f0 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.661+0000 7fbbb2a00640 1 -- 172.21.15.1:0/1224024678 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc00b4bc0 con 0x55a574fde2f0 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbb2a00640 1 -- 172.21.15.1:0/1224024678 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 38) ==== 8362+0+0 (secure 0 0 0) 0x7fbbb4044b00 con 0x55a574fde2f0 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbd6e4f740 10 client.25591 fetch_fsmap finished waiting for FSMap version 38 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbd6e4f740 10 client.25591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbd6e4f740 20 client.25591 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:28.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574f9b1c0 0x55a575431420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbd6e4f740 4 client.25591 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:23:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a57531b0a0 con 0x55a574f9b1c0 2024-08-28T20:23:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.662+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574f9b1c0 0x55a575431420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:28.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.663+0000 7fbbb2a00640 10 client.25591 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.664+0000 7fbbc7e00640 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574f9b1c0 0x55a575431420 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b097899217363c88 server_cookie=2292384ed11518f3 in_seq=0 out_seq=0 2024-08-28T20:23:28.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.678+0000 7fbbb2a00640 1 -- 172.21.15.1:0/1224024678 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a57531b0a0 con 0x55a574f9b1c0 2024-08-28T20:23:28.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.678+0000 7fbbb2a00640 10 client.25591 handle_command_reply: tid=0 2024-08-28T20:23:28.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.678+0000 7fbbd6e4f740 1 client.25591 shutdown 2024-08-28T20:23:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 msgr2=0x55a5753bd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753bd720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55a5753c43a0 tx=0x7fbbb40045d0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 shutdown_connections 2024-08-28T20:23:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a574f9b1c0 0x55a575431420 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5750071b0 0x55a5753bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a574fe64d0 0x55a5753bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbb2a00640 0 client.25591 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 --2- 172.21.15.1:0/1224024678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a574fde2f0 0x55a5753bd720 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.679+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 >> 172.21.15.1:0/1224024678 conn(0x55a574ffb300 msgr2=0x55a5753b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.680+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 shutdown_connections 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.680+0000 7fbbd6e4f740 1 -- 172.21.15.1:0/1224024678 wait complete. 2024-08-28T20:23:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.680+0000 7fbbd6e4f740 20 client.25591 trim_cache size 0 max 16384 2024-08-28T20:23:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:23:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:23:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:23:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:23:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbac0c5bf0 msgr2=0x7fbbac0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbac0c5bf0 0x7fbbac0c8100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800afd0 tx=0x7fbbb800a1f0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 msgr2=0x7fbbc81072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 0x7fbbc81072a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009fd0 tx=0x7fbbc000b260 comp rx=0 tx=0).stop 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 shutdown_connections 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbac0c5bf0 0x7fbbac0c8100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbc8106da0 0x7fbbc81072a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbc8104e80 0x7fbbc81062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 --2- 172.21.15.1:0/2889752552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbc81044e0 0x7fbbc8105c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.681+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 >> 172.21.15.1:0/2889752552 conn(0x7fbbc80feda0 msgr2=0x7fbbc8075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.682+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 shutdown_connections 2024-08-28T20:23:28.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:28.682+0000 7fbbcfc00640 1 -- 172.21.15.1:0/2889752552 wait complete. 2024-08-28T20:23:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 300.0 s, 2537.8 tps, lat 39.429 ms stddev 51.971 2024-08-28T20:23:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:29 smithi001 ceph-mon[20984]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 692 op/s 2024-08-28T20:23:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:29 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:23:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:29 smithi121 ceph-mon[25248]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 692 op/s 2024-08-28T20:23:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:29 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:23:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:29 smithi007 ceph-mon[25357]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 692 op/s 2024-08-28T20:23:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:29 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:23:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:31 smithi001 ceph-mon[20984]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 685 op/s 2024-08-28T20:23:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:31 smithi121 ceph-mon[25248]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 685 op/s 2024-08-28T20:23:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:31 smithi007 ceph-mon[25357]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 685 op/s 2024-08-28T20:23:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 305.0 s, 3047.4 tps, lat 32.732 ms stddev 37.632 2024-08-28T20:23:34.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:33 smithi001 ceph-mon[20984]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 705 op/s 2024-08-28T20:23:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:33 smithi121 ceph-mon[25248]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 705 op/s 2024-08-28T20:23:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:33 smithi007 ceph-mon[25357]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.0 MiB/s wr, 705 op/s 2024-08-28T20:23:36.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:35 smithi001 ceph-mon[20984]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 781 op/s 2024-08-28T20:23:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:35 smithi121 ceph-mon[25248]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 781 op/s 2024-08-28T20:23:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:35 smithi007 ceph-mon[25357]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 781 op/s 2024-08-28T20:23:38.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:37 smithi001 ceph-mon[20984]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 719 op/s 2024-08-28T20:23:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:37 smithi121 ceph-mon[25248]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 719 op/s 2024-08-28T20:23:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:37 smithi007 ceph-mon[25357]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 719 op/s 2024-08-28T20:23:38.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 310.0 s, 2231.8 tps, lat 44.874 ms stddev 51.960 2024-08-28T20:23:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:39 smithi001 ceph-mon[20984]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 676 op/s 2024-08-28T20:23:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:39 smithi121 ceph-mon[25248]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 676 op/s 2024-08-28T20:23:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:39 smithi007 ceph-mon[25357]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 676 op/s 2024-08-28T20:23:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 -- 172.21.15.1:0/1329770868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf14105690 msgr2=0x7fdf14105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 --2- 172.21.15.1:0/1329770868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf14105690 0x7fdf14105b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009900 tx=0x7fdf0402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 -- 172.21.15.1:0/1329770868 shutdown_connections 2024-08-28T20:23:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 --2- 172.21.15.1:0/1329770868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf14106710 0x7fdf14106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 --2- 172.21.15.1:0/1329770868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf141070b0 0x7fdf1410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 --2- 172.21.15.1:0/1329770868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf14105690 0x7fdf14105b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 -- 172.21.15.1:0/1329770868 >> 172.21.15.1:0/1329770868 conn(0x7fdf14100fd0 msgr2=0x7fdf14103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.981+0000 7fdf19400640 1 -- 172.21.15.1:0/1329770868 shutdown_connections 2024-08-28T20:23:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.982+0000 7fdf19400640 1 -- 172.21.15.1:0/1329770868 wait complete. 2024-08-28T20:23:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.983+0000 7fdf19400640 1 Processor -- start 2024-08-28T20:23:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.983+0000 7fdf19400640 1 -- start start 2024-08-28T20:23:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf19400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf14105690 0x7fdf1419bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf19400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf14106710 0x7fdf1419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf19400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 0x7fdf1419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf13200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 0x7fdf1419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf13200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 0x7fdf1419d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39252/0 (socket says 172.21.15.1:39252) 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf13200640 1 -- 172.21.15.1:0/1919620678 learned_addr learned my addr 172.21.15.1:0/1919620678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14111300 con 0x7fdf14106710 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14111180 con 0x7fdf141070b0 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14111480 con 0x7fdf14105690 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf12800640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf14105690 0x7fdf1419bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf14106710 0x7fdf1419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.984+0000 7fdf13200640 1 -- 172.21.15.1:0/1919620678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf14105690 msgr2=0x7fdf1419bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.985+0000 7fdf13200640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf14105690 0x7fdf1419bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.985+0000 7fdf13200640 1 -- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf14106710 msgr2=0x7fdf1419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.985+0000 7fdf13200640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf14106710 0x7fdf1419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.985+0000 7fdf13200640 1 -- 172.21.15.1:0/1919620678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1419d8d0 con 0x7fdf141070b0 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.985+0000 7fdf13200640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 0x7fdf1419d140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00cc60 tx=0x7fdf0c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.985+0000 7fdf0b400640 1 -- 172.21.15.1:0/1919620678 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00f450 con 0x7fdf141070b0 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.986+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1419dbc0 con 0x7fdf141070b0 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.986+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf14077780 con 0x7fdf141070b0 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.986+0000 7fdf0b400640 1 -- 172.21.15.1:0/1919620678 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf0c00faa0 con 0x7fdf141070b0 2024-08-28T20:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.986+0000 7fdf0b400640 1 -- 172.21.15.1:0/1919620678 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c018b60 con 0x7fdf141070b0 2024-08-28T20:23:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.992+0000 7fdf20406740 1 Processor -- start 2024-08-28T20:23:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.994+0000 7fdf0b400640 1 -- 172.21.15.1:0/1919620678 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fdf0c018d00 con 0x7fdf141070b0 2024-08-28T20:23:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.994+0000 7fdf20406740 1 -- start start 2024-08-28T20:23:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf20406740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c241b0 0x5629c7fc9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf20406740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7bfb2f0 0x5629c7fca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf20406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fcaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf20406740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5629c7f3cf70 con 0x5629c7bfb2f0 2024-08-28T20:23:41.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf20406740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629c7f2c500 con 0x5629c7c241b0 2024-08-28T20:23:41.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf20406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5629c7f304b0 con 0x5629c7c034d0 2024-08-28T20:23:41.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf12800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7bfb2f0 0x5629c7fca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf11e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fcaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf11e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c241b0 0x5629c7fc9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf11e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c241b0 0x5629c7fc9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39262/0 (socket says 172.21.15.1:39262) 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.995+0000 7fdf11e00640 1 -- 172.21.15.1:0/1295782217 learned_addr learned my addr 172.21.15.1:0/1295782217 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf0b400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdef80b4bf0 0x7fdef80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf12800640 1 -- 172.21.15.1:0/1295782217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 msgr2=0x5629c7fcaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf12800640 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fcaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf12800640 1 -- 172.21.15.1:0/1295782217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c241b0 msgr2=0x5629c7fc9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf12800640 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c241b0 0x5629c7fc9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf12800640 1 -- 172.21.15.1:0/1295782217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c7ee6c10 con 0x5629c7bfb2f0 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf0b400640 1 -- 172.21.15.1:0/1919620678 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fdf0c0e5370 con 0x7fdf141070b0 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf13200640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdef80b4bf0 0x7fdef80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:41.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdf12800640 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7bfb2f0 0x5629c7fca430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdf0402a9e0 tx=0x7fdf04005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40ec6f03c15aaf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:41.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.996+0000 7fdeff400640 1 -- 172.21.15.1:0/1295782217 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0404c070 con 0x5629c7bfb2f0 2024-08-28T20:23:41.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.997+0000 7fdeff400640 1 -- 172.21.15.1:0/1295782217 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf040054e0 con 0x5629c7bfb2f0 2024-08-28T20:23:41.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.997+0000 7fdeff400640 1 -- 172.21.15.1:0/1295782217 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04035050 con 0x5629c7bfb2f0 2024-08-28T20:23:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 -- 172.21.15.1:0/1295782217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7bfb2f0 msgr2=0x5629c7fca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7bfb2f0 0x5629c7fca430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdf0402a9e0 tx=0x7fdf04005fd0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf13200640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdef80b4bf0 0x7fdef80b7100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0a9000 tx=0x7fdf0c00cf60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 -- 172.21.15.1:0/1295782217 shutdown_connections 2024-08-28T20:23:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7bfb2f0 0x5629c7fca430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fcaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 --2- 172.21.15.1:0/1295782217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c241b0 0x5629c7fc9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:41.999+0000 7fdf20406740 1 -- 172.21.15.1:0/1295782217 >> 172.21.15.1:0/1295782217 conn(0x5629c7c18300 msgr2=0x5629c7fc5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:42.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.000+0000 7fdf20406740 1 -- 172.21.15.1:0/1295782217 shutdown_connections 2024-08-28T20:23:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.000+0000 7fdf20406740 1 -- 172.21.15.1:0/1295782217 wait complete. 2024-08-28T20:23:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.001+0000 7fdf20406740 1 -- start start 2024-08-28T20:23:42.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.001+0000 7fdf20406740 1 Processor -- start 2024-08-28T20:23:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 0x5629c7fd3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7c241b0 0x5629c7fd4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5629c7e65ab0 con 0x5629c7c241b0 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629c7ed3320 con 0x5629c7c034d0 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5629c7fcba40 con 0x5629c7bfb2f0 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf20406740 10 client.0 _ll_register_callbacks cb 0x5629c7ed96a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf12800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 0x5629c7fd3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf12800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 0x5629c7fd3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39276/0 (socket says 172.21.15.1:39276) 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf12800640 1 -- 172.21.15.1:0/79988459 learned_addr learned my addr 172.21.15.1:0/79988459 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf11e00640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf12800640 1 -- 172.21.15.1:0/79988459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7bfb2f0 msgr2=0x5629c7fd3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.003+0000 7fdf12800640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdf12800640 1 -- 172.21.15.1:0/79988459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7c241b0 msgr2=0x5629c7fd4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdf12800640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7c241b0 0x5629c7fd4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdf12800640 1 -- 172.21.15.1:0/79988459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c7c8f790 con 0x5629c7c034d0 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdf11e00640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdf12800640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 0x5629c7fd3ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009850 tx=0x7fdf0403ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a3ccb38b1cbff9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdef3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdef3e00640 1 -- 172.21.15.1:0/79988459 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04055060 con 0x5629c7c034d0 2024-08-28T20:23:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdef3e00640 1 -- 172.21.15.1:0/79988459 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fdf04004ca0 con 0x5629c7c034d0 2024-08-28T20:23:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.004+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf040054e0 con 0x5629c7c034d0 2024-08-28T20:23:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.005+0000 7fdef3e00640 1 -- 172.21.15.1:0/79988459 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fdf0404c040 con 0x5629c7c034d0 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.005+0000 7fdf20406740 10 client.25631 fetch_fsmap learned FSMap version 39 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.005+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5629c7d08620 con 0x5629c7c034d0 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.005+0000 7fdef3e00640 1 -- 172.21.15.1:0/79988459 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf040054e0 con 0x5629c7c034d0 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.005+0000 7fdef3e00640 1 -- 172.21.15.1:0/79988459 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8358+0+0 (secure 0 0 0) 0x7fdf0404f070 con 0x5629c7c034d0 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf20406740 10 client.25631 fetch_fsmap finished waiting for FSMap version 39 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf20406740 10 client.25631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf20406740 20 client.25631 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf20406740 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7be2d80 0x5629c7fe0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf20406740 4 client.25631 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629c7f3eec0 con 0x5629c7be2d80 2024-08-28T20:23:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.006+0000 7fdf11e00640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7be2d80 0x5629c7fe0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.009+0000 7fdf11e00640 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7be2d80 0x5629c7fe0730 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=817e7501246fa5a9 server_cookie=cc24084c72aced80 in_seq=0 out_seq=0 2024-08-28T20:23:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.009+0000 7fdef3e00640 10 client.25631 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.014+0000 7fdef3e00640 1 -- 172.21.15.1:0/79988459 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629c7f3eec0 con 0x5629c7be2d80 2024-08-28T20:23:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.014+0000 7fdef3e00640 10 client.25631 handle_command_reply: tid=0 2024-08-28T20:23:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.014+0000 7fdf20406740 1 client.25631 shutdown 2024-08-28T20:23:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.015+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 msgr2=0x5629c7fd3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.015+0000 7fdf20406740 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 0x5629c7fd3ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009850 tx=0x7fdf0403ecc0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.015+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 shutdown_connections 2024-08-28T20:23:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.015+0000 7fdf20406740 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7be2d80 0x5629c7fe0730 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.016+0000 7fdf20406740 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7c241b0 0x5629c7fd4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.016+0000 7fdef3e00640 0 client.25631 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.016+0000 7fdf20406740 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7c034d0 0x5629c7fd3ae0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.016+0000 7fdf20406740 1 --2- 172.21.15.1:0/79988459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.016+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 >> 172.21.15.1:0/79988459 conn(0x5629c7c18300 msgr2=0x5629c7fc3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.017+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 shutdown_connections 2024-08-28T20:23:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.019+0000 7fdf20406740 1 -- 172.21.15.1:0/79988459 wait complete. 2024-08-28T20:23:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.019+0000 7fdf20406740 20 client.25631 trim_cache size 0 max 16384 2024-08-28T20:23:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.051+0000 7fdf20406740 1 Processor -- start 2024-08-28T20:23:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.051+0000 7fdf20406740 1 -- start start 2024-08-28T20:23:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf20406740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fd1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf20406740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf20406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fc4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf20406740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4010da0 con 0x5629c7be2d80 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf20406740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdef400e640 con 0x5629c7bfb2f0 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf20406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdef400c490 con 0x5629c7c034d0 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf12800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf12800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39282/0 (socket says 172.21.15.1:39282) 2024-08-28T20:23:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.052+0000 7fdf12800640 1 -- 172.21.15.1:0/1243336947 learned_addr learned my addr 172.21.15.1:0/1243336947 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fd1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fc4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf12800640 1 -- 172.21.15.1:0/1243336947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 msgr2=0x5629c7fc4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf12800640 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fc4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf12800640 1 -- 172.21.15.1:0/1243336947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 msgr2=0x5629c7fd1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf12800640 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fd1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.053+0000 7fdf12800640 1 -- 172.21.15.1:0/1243336947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c7fd15f0 con 0x5629c7bfb2f0 2024-08-28T20:23:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.054+0000 7fdf12800640 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd1eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003be0 tx=0x7fdf04005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83626ec0d922d774 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.054+0000 7fdefea00640 1 -- 172.21.15.1:0/1243336947 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04055070 con 0x5629c7bfb2f0 2024-08-28T20:23:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.054+0000 7fdefea00640 1 -- 172.21.15.1:0/1243336947 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf040315a0 con 0x5629c7bfb2f0 2024-08-28T20:23:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.054+0000 7fdefea00640 1 -- 172.21.15.1:0/1243336947 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04035040 con 0x5629c7bfb2f0 2024-08-28T20:23:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 -- 172.21.15.1:0/1243336947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 msgr2=0x5629c7fd1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd1eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003be0 tx=0x7fdf04005fd0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 -- 172.21.15.1:0/1243336947 shutdown_connections 2024-08-28T20:23:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fc4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd1eb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 --2- 172.21.15.1:0/1243336947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fd1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.056+0000 7fdf20406740 1 -- 172.21.15.1:0/1243336947 >> 172.21.15.1:0/1243336947 conn(0x5629c7c18300 msgr2=0x5629c7fd2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.057+0000 7fdf20406740 1 -- 172.21.15.1:0/1243336947 shutdown_connections 2024-08-28T20:23:42.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.057+0000 7fdf20406740 1 -- 172.21.15.1:0/1243336947 wait complete. 2024-08-28T20:23:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.057+0000 7fdf20406740 1 -- start start 2024-08-28T20:23:42.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 Processor -- start 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fdb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fda320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdef400cb00 con 0x5629c7be2d80 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdef400df70 con 0x5629c7bfb2f0 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.058+0000 7fdf20406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdef400d1d0 con 0x5629c7c034d0 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.059+0000 7fdf20406740 10 client.0 _ll_register_callbacks cb 0x7fdf0403eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.059+0000 7fdf11e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fdb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.059+0000 7fdf11e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fdb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41042/0 (socket says 172.21.15.1:41042) 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.059+0000 7fdf11e00640 1 -- 172.21.15.1:0/1458825653 learned_addr learned my addr 172.21.15.1:0/1458825653 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.059+0000 7fdf12800640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.060+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fda320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.060+0000 7fdf12800640 1 -- 172.21.15.1:0/1458825653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 msgr2=0x5629c7fda320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.060+0000 7fdf12800640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fda320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.060+0000 7fdf12800640 1 -- 172.21.15.1:0/1458825653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 msgr2=0x5629c7fdb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.060+0000 7fdf12800640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fdb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.060+0000 7fdf12800640 1 -- 172.21.15.1:0/1458825653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c7fdaa10 con 0x5629c7bfb2f0 2024-08-28T20:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.061+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fda320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.061+0000 7fdf12800640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd9de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003d50 tx=0x7fdf04004570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c96028486a8f3f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.061+0000 7fdef3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.061+0000 7fdef3e00640 1 -- 172.21.15.1:0/1458825653 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04035070 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.061+0000 7fdef3e00640 1 -- 172.21.15.1:0/1458825653 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fdf04031750 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.061+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf040315a0 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.062+0000 7fdef3e00640 1 -- 172.21.15.1:0/1458825653 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fdf04055070 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.062+0000 7fdf20406740 10 client.25637 fetch_fsmap learned FSMap version 39 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.062+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5629c804b050 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.062+0000 7fdef3e00640 1 -- 172.21.15.1:0/1458825653 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf040315a0 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdef3e00640 1 -- 172.21.15.1:0/1458825653 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8358+0+0 (secure 0 0 0) 0x7fdf0408c050 con 0x5629c7bfb2f0 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf20406740 10 client.25637 fetch_fsmap finished waiting for FSMap version 39 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf20406740 10 client.25637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf20406740 20 client.25637 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf20406740 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7c241b0 0x5629c804d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf20406740 4 client.25637 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:23:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629c7f3a960 con 0x5629c7c241b0 2024-08-28T20:23:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.063+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7c241b0 0x5629c804d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.065+0000 7fdf11e00640 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7c241b0 0x5629c804d640 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75846fec3d9020a7 server_cookie=969a6ac08d45c32b in_seq=0 out_seq=0 2024-08-28T20:23:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.066+0000 7fdef3e00640 10 client.25637 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdef3e00640 1 -- 172.21.15.1:0/1458825653 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629c7f3a960 con 0x5629c7c241b0 2024-08-28T20:23:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdef3e00640 10 client.25637 handle_command_reply: tid=0 2024-08-28T20:23:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 client.25637 shutdown 2024-08-28T20:23:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 msgr2=0x5629c7fd9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:42.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd9de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003d50 tx=0x7fdf04004570 comp rx=0 tx=0).stop 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 shutdown_connections 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5629c7c241b0 0x5629c804d640 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c7c034d0 0x5629c7fda320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629c7bfb2f0 0x5629c7fd9de0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 --2- 172.21.15.1:0/1458825653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629c7be2d80 0x5629c7fdb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.087+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 >> 172.21.15.1:0/1458825653 conn(0x5629c7c18300 msgr2=0x5629c7fd1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.088+0000 7fdef3e00640 0 client.25637 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.088+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 shutdown_connections 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.088+0000 7fdf20406740 1 -- 172.21.15.1:0/1458825653 wait complete. 2024-08-28T20:23:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.088+0000 7fdf20406740 20 client.25637 trim_cache size 0 max 16384 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdef80b4bf0 msgr2=0x7fdef80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdef80b4bf0 0x7fdef80b7100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0a9000 tx=0x7fdf0c00cf60 comp rx=0 tx=0).stop 2024-08-28T20:23:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 msgr2=0x7fdf1419d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 0x7fdf1419d140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00cc60 tx=0x7fdf0c00a620 comp rx=0 tx=0).stop 2024-08-28T20:23:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 shutdown_connections 2024-08-28T20:23:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fdef80b4bf0 0x7fdef80b7100 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf14106710 0x7fdf1419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf141070b0 0x7fdf1419d140 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 --2- 172.21.15.1:0/1919620678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf14105690 0x7fdf1419bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.090+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 >> 172.21.15.1:0/1919620678 conn(0x7fdf14100fd0 msgr2=0x7fdf14109a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.091+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 shutdown_connections 2024-08-28T20:23:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:42.091+0000 7fdf19400640 1 -- 172.21.15.1:0/1919620678 wait complete. 2024-08-28T20:23:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:41 smithi001 ceph-mon[20984]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 756 op/s 2024-08-28T20:23:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:41 smithi121 ceph-mon[25248]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 756 op/s 2024-08-28T20:23:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:41 smithi007 ceph-mon[25357]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 756 op/s 2024-08-28T20:23:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 315.0 s, 2683.4 tps, lat 37.055 ms stddev 45.223 2024-08-28T20:23:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:43 smithi001 ceph-mon[20984]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-08-28T20:23:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:43 smithi121 ceph-mon[25248]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-08-28T20:23:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:43 smithi007 ceph-mon[25357]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-08-28T20:23:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:45 smithi121 ceph-mon[25248]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 723 op/s 2024-08-28T20:23:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:45 smithi007 ceph-mon[25357]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 723 op/s 2024-08-28T20:23:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:45 smithi001 ceph-mon[20984]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 723 op/s 2024-08-28T20:23:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:47 smithi007 ceph-mon[25357]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.8 MiB/s wr, 692 op/s 2024-08-28T20:23:48.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:47 smithi001 ceph-mon[20984]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.8 MiB/s wr, 692 op/s 2024-08-28T20:23:48.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:47 smithi121 ceph-mon[25248]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.8 MiB/s wr, 692 op/s 2024-08-28T20:23:48.765 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 320.0 s, 2278.8 tps, lat 43.880 ms stddev 54.841 2024-08-28T20:23:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:49 smithi007 ceph-mon[25357]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 712 op/s 2024-08-28T20:23:50.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:49 smithi001 ceph-mon[20984]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 712 op/s 2024-08-28T20:23:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:49 smithi121 ceph-mon[25248]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 712 op/s 2024-08-28T20:23:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:51 smithi007 ceph-mon[25357]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.8 MiB/s wr, 728 op/s 2024-08-28T20:23:52.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:51 smithi001 ceph-mon[20984]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.8 MiB/s wr, 728 op/s 2024-08-28T20:23:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:51 smithi121 ceph-mon[25248]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.8 MiB/s wr, 728 op/s 2024-08-28T20:23:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 325.0 s, 3479.4 tps, lat 28.856 ms stddev 33.289 2024-08-28T20:23:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:54 smithi007 ceph-mon[25357]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 MiB/s wr, 639 op/s 2024-08-28T20:23:54.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:54 smithi001 ceph-mon[20984]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 MiB/s wr, 639 op/s 2024-08-28T20:23:54.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:54 smithi121 ceph-mon[25248]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 MiB/s wr, 639 op/s 2024-08-28T20:23:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 -- 172.21.15.1:0/2649807711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc078a40 msgr2=0x7f02bc078e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 --2- 172.21.15.1:0/2649807711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc078a40 0x7f02bc078e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009900 tx=0x7f02a402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 -- 172.21.15.1:0/2649807711 shutdown_connections 2024-08-28T20:23:55.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 --2- 172.21.15.1:0/2649807711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc0793e0 0x7f02bc079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 --2- 172.21.15.1:0/2649807711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc078a40 0x7f02bc078e50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 --2- 172.21.15.1:0/2649807711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02bc0779c0 0x7f02bc077e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 -- 172.21.15.1:0/2649807711 >> 172.21.15.1:0/2649807711 conn(0x7f02bc100fd0 msgr2=0x7f02bc103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 -- 172.21.15.1:0/2649807711 shutdown_connections 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.391+0000 7f02c0c00640 1 -- 172.21.15.1:0/2649807711 wait complete. 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.392+0000 7f02c0c00640 1 Processor -- start 2024-08-28T20:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 -- start start 2024-08-28T20:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02bc0779c0 0x7f02bc1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 0x7f02bc1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc0793e0 0x7f02bc1a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc115730 con 0x7f02bc0779c0 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc1155b0 con 0x7f02bc0793e0 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02c0c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc1158b0 con 0x7f02bc078a40 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.393+0000 7f02b1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 0x7f02bc1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 0x7f02bc1a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58484/0 (socket says 172.21.15.1:58484) 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 -- 172.21.15.1:0/1149464924 learned_addr learned my addr 172.21.15.1:0/1149464924 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b9e00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02bc0779c0 0x7f02bc1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02ba800640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc0793e0 0x7f02bc1a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 -- 172.21.15.1:0/1149464924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc0793e0 msgr2=0x7f02bc1a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc0793e0 0x7f02bc1a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 -- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02bc0779c0 msgr2=0x7f02bc1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02bc0779c0 0x7f02bc1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.394+0000 7f02b1400640 1 -- 172.21.15.1:0/1149464924 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02bc1a1d50 con 0x7f02bc078a40 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.395+0000 7f02b1400640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 0x7f02bc1a0980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f02a4031440 tx=0x7f02a4003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.395+0000 7f02b3400640 1 -- 172.21.15.1:0/1149464924 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a403f070 con 0x7f02bc078a40 2024-08-28T20:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.395+0000 7f02b3400640 1 -- 172.21.15.1:0/1149464924 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a4031c50 con 0x7f02bc078a40 2024-08-28T20:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.395+0000 7f02b3400640 1 -- 172.21.15.1:0/1149464924 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4035030 con 0x7f02bc078a40 2024-08-28T20:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.395+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02bc1a1fe0 con 0x7f02bc078a40 2024-08-28T20:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.395+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02bc105250 con 0x7f02bc078a40 2024-08-28T20:23:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.400+0000 7f02c7dc3740 1 Processor -- start 2024-08-28T20:23:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 -- start start 2024-08-28T20:23:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8ee01b0 0x5588d9285dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8eb72f0 0x5588d9286430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d9286f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5588d91f8f70 con 0x5588d8eb72f0 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5588d91e8500 con 0x5588d8ebf4d0 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.401+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5588d91ec4b0 con 0x5588d8ee01b0 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.402+0000 7f02b3400640 1 -- 172.21.15.1:0/1149464924 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f02a4042070 con 0x7f02bc078a40 2024-08-28T20:23:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.402+0000 7f02ba800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8ee01b0 0x5588d9285dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.402+0000 7f02ba800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8ee01b0 0x5588d9285dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58494/0 (socket says 172.21.15.1:58494) 2024-08-28T20:23:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.402+0000 7f02ba800640 1 -- 172.21.15.1:0/3997230454 learned_addr learned my addr 172.21.15.1:0/3997230454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.402+0000 7f02b1400640 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d9286f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.403+0000 7f02b9e00640 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8eb72f0 0x5588d9286430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b1400640 1 -- 172.21.15.1:0/3997230454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8ee01b0 msgr2=0x5588d9285dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b1400640 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8ee01b0 0x5588d9285dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b1400640 1 -- 172.21.15.1:0/3997230454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8eb72f0 msgr2=0x5588d9286430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b1400640 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8eb72f0 0x5588d9286430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b1400640 1 -- 172.21.15.1:0/3997230454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d91a2c10 con 0x5588d8ebf4d0 2024-08-28T20:23:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b9e00640 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8eb72f0 0x5588d9286430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:23:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02b1400640 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d9286f80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02a4103460 tx=0x7f02a410bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96dce0caa31b6b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02ab000640 1 -- 172.21.15.1:0/3997230454 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4115020 con 0x5588d8ebf4d0 2024-08-28T20:23:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02ab000640 1 -- 172.21.15.1:0/3997230454 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a410dc00 con 0x5588d8ebf4d0 2024-08-28T20:23:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.404+0000 7f02ab000640 1 -- 172.21.15.1:0/3997230454 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4110620 con 0x5588d8ebf4d0 2024-08-28T20:23:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.405+0000 7f02b3400640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02a00b4bf0 0x7f02a00b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.405+0000 7f02b3400640 1 -- 172.21.15.1:0/1149464924 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f02a4105a30 con 0x7f02bc078a40 2024-08-28T20:23:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.405+0000 7f02ba800640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02a00b4bf0 0x7f02a00b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.406+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3997230454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 msgr2=0x5588d9286f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.406+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d9286f80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02a4103460 tx=0x7f02a410bc50 comp rx=0 tx=0).stop 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3997230454 shutdown_connections 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8eb72f0 0x5588d9286430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d9286f80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3997230454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8ee01b0 0x5588d9285dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3997230454 >> 172.21.15.1:0/3997230454 conn(0x5588d8ed4300 msgr2=0x5588d9281850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02ba800640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02a00b4bf0 0x7f02a00b7100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009e10 tx=0x7f02b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.408+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3997230454 shutdown_connections 2024-08-28T20:23:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.409+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3997230454 wait complete. 2024-08-28T20:23:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.409+0000 7f02c7dc3740 1 -- start start 2024-08-28T20:23:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 Processor -- start 2024-08-28T20:23:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d928f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d928f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ee01b0 0x5588d9290460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5588d9121ab0 con 0x5588d8ee01b0 2024-08-28T20:23:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5588d918f320 con 0x5588d8ebf4d0 2024-08-28T20:23:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5588d9287860 con 0x5588d8eb72f0 2024-08-28T20:23:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.410+0000 7f02c7dc3740 10 client.0 _ll_register_callbacks cb 0x5588d91956a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d928f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d928f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39386/0 (socket says 172.21.15.1:39386) 2024-08-28T20:23:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 -- 172.21.15.1:0/3802786386 learned_addr learned my addr 172.21.15.1:0/3802786386 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 -- 172.21.15.1:0/3802786386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 msgr2=0x5588d928f230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:23:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d928f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 -- 172.21.15.1:0/3802786386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ee01b0 msgr2=0x5588d9290460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ee01b0 0x5588d9290460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.411+0000 7f02b1400640 1 -- 172.21.15.1:0/3802786386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d8f4b790 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f02b1400640 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d928f8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f02a40cc380 tx=0x7f02a403b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c28ef72d68c3ba server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f029f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f029f400640 1 -- 172.21.15.1:0/3802786386 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4049030 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f029f400640 1 -- 172.21.15.1:0/3802786386 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f02a410da00 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02a410dc00 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f029f400640 1 -- 172.21.15.1:0/3802786386 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f02a4115020 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f02c7dc3740 10 client.25649 fetch_fsmap learned FSMap version 39 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.412+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5588d8fc4620 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f029f400640 1 -- 172.21.15.1:0/3802786386 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a410dc00 con 0x5588d8ebf4d0 2024-08-28T20:23:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f029f400640 1 -- 172.21.15.1:0/3802786386 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8358+0+0 (secure 0 0 0) 0x7f02a40c85f0 con 0x5588d8ebf4d0 2024-08-28T20:23:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02c7dc3740 10 client.25649 fetch_fsmap finished waiting for FSMap version 39 2024-08-28T20:23:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02c7dc3740 10 client.25649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02c7dc3740 20 client.25649 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d8e9ed80 0x5588d929c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02c7dc3740 4 client.25649 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:23:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588d91faec0 con 0x5588d8e9ed80 2024-08-28T20:23:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.413+0000 7f02b9e00640 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d8e9ed80 0x5588d929c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.414+0000 7f02b9e00640 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d8e9ed80 0x5588d929c4b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82f1c7a2130decb0 server_cookie=6c881c5805daf102 in_seq=0 out_seq=0 2024-08-28T20:23:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.414+0000 7f029f400640 10 client.25649 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.415+0000 7f029f400640 1 -- 172.21.15.1:0/3802786386 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588d91faec0 con 0x5588d8e9ed80 2024-08-28T20:23:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.415+0000 7f029f400640 10 client.25649 handle_command_reply: tid=0 2024-08-28T20:23:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.415+0000 7f02c7dc3740 1 client.25649 shutdown 2024-08-28T20:23:55.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 msgr2=0x5588d928f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d928f8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f02a40cc380 tx=0x7f02a403b800 comp rx=0 tx=0).stop 2024-08-28T20:23:55.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 shutdown_connections 2024-08-28T20:23:55.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d8e9ed80 0x5588d929c4b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ee01b0 0x5588d9290460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ebf4d0 0x5588d928f8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/3802786386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d928f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 >> 172.21.15.1:0/3802786386 conn(0x5588d8ed4300 msgr2=0x5588d927fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.416+0000 7f029f400640 0 client.25649 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.417+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 shutdown_connections 2024-08-28T20:23:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.417+0000 7f02c7dc3740 1 -- 172.21.15.1:0/3802786386 wait complete. 2024-08-28T20:23:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.417+0000 7f02c7dc3740 20 client.25649 trim_cache size 0 max 16384 2024-08-28T20:23:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.453+0000 7f02c7dc3740 1 Processor -- start 2024-08-28T20:23:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 -- start start 2024-08-28T20:23:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d9286470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9297340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9281c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc1ab450 con 0x5588d8ebf4d0 2024-08-28T20:23:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc1a8cf0 con 0x5588d8ee01b0 2024-08-28T20:23:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.454+0000 7f02c7dc3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc10c050 con 0x5588d8eb72f0 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.455+0000 7f02ba800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9281c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.455+0000 7f02ba800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9281c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39396/0 (socket says 172.21.15.1:39396) 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d9286470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d9286470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58520/0 (socket says 172.21.15.1:58520) 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 -- 172.21.15.1:0/2931641879 learned_addr learned my addr 172.21.15.1:0/2931641879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 -- 172.21.15.1:0/2931641879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 msgr2=0x5588d9281c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9281c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 -- 172.21.15.1:0/2931641879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 msgr2=0x5588d9297340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9297340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.456+0000 7f02b9e00640 1 -- 172.21.15.1:0/2931641879 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d9291060 con 0x5588d8eb72f0 2024-08-28T20:23:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.457+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d9286470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5588d929cc00 tx=0x7f02ac009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1573cf1d76764eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.458+0000 7f02aa600640 1 -- 172.21.15.1:0/2931641879 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac004b20 con 0x5588d8eb72f0 2024-08-28T20:23:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.461+0000 7f02aa600640 1 -- 172.21.15.1:0/2931641879 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ac02e070 con 0x5588d8eb72f0 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.463+0000 7f02aa600640 1 -- 172.21.15.1:0/2931641879 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac005520 con 0x5588d8eb72f0 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2931641879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 msgr2=0x5588d9286470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d9286470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5588d929cc00 tx=0x7f02ac009500 comp rx=0 tx=0).stop 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2931641879 shutdown_connections 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9297340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9281c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2931641879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8eb72f0 0x5588d9286470 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5588d929cc00 tx=0x7f02ac009500 comp rx=0 tx=0).stop 2024-08-28T20:23:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.464+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2931641879 >> 172.21.15.1:0/2931641879 conn(0x5588d8ed4300 msgr2=0x5588d9285d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.466+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2931641879 shutdown_connections 2024-08-28T20:23:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.466+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2931641879 wait complete. 2024-08-28T20:23:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.466+0000 7f02c7dc3740 1 -- start start 2024-08-28T20:23:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.467+0000 7f02c7dc3740 1 Processor -- start 2024-08-28T20:23:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.468+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9292940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.468+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9293000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.469+0000 7f02c7dc3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 0x5588d9296bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.469+0000 7f02ba800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 0x5588d9296bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.469+0000 7f02ba800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 0x5588d9296bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58528/0 (socket says 172.21.15.1:58528) 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02ba800640 1 -- 172.21.15.1:0/2642669912 learned_addr learned my addr 172.21.15.1:0/2642669912 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc10c6c0 con 0x5588d8ebf4d0 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc1a8620 con 0x5588d8ee01b0 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc10cd90 con 0x5588d8e741c0 2024-08-28T20:23:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9292940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02b1400640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9293000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.470+0000 7f02c7dc3740 10 client.0 _ll_register_callbacks cb 0x7f02a410bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:23:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.471+0000 7f02ba800640 1 -- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 msgr2=0x5588d9293000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.471+0000 7f02ba800640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9293000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.471+0000 7f02ba800640 1 -- 172.21.15.1:0/2642669912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 msgr2=0x5588d9292940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:23:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.471+0000 7f02ba800640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9292940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.471+0000 7f02ba800640 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d9297350 con 0x5588d8e741c0 2024-08-28T20:23:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.471+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9292940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:23:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.474+0000 7f02ba800640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 0x5588d9296bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02b401fa00 tx=0x7f02b401fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e5f30ba9d979bd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:23:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.474+0000 7f029f400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:23:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.474+0000 7f029f400640 1 -- 172.21.15.1:0/2642669912 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4005020 con 0x5588d8e741c0 2024-08-28T20:23:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.474+0000 7f029f400640 1 -- 172.21.15.1:0/2642669912 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f02b4018030 con 0x5588d8e741c0 2024-08-28T20:23:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.475+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02ac02e070 con 0x5588d8e741c0 2024-08-28T20:23:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.475+0000 7f029f400640 1 -- 172.21.15.1:0/2642669912 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f02b40051c0 con 0x5588d8e741c0 2024-08-28T20:23:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.476+0000 7f02c7dc3740 10 client.25615 fetch_fsmap learned FSMap version 39 2024-08-28T20:23:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.476+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5588d9294880 con 0x5588d8e741c0 2024-08-28T20:23:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.476+0000 7f029f400640 1 -- 172.21.15.1:0/2642669912 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ac02e070 con 0x5588d8e741c0 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f029f400640 1 -- 172.21.15.1:0/2642669912 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 39) ==== 8358+0+0 (secure 0 0 0) 0x7f02b4032050 con 0x5588d8e741c0 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f02c7dc3740 10 client.25615 fetch_fsmap finished waiting for FSMap version 39 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f02c7dc3740 10 client.25615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f02c7dc3740 20 client.25615 populate_metadata read hostname 'smithi001' 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d9318640 0x5588d931aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f02c7dc3740 4 client.25615 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:23:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.477+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588d91f6960 con 0x5588d9318640 2024-08-28T20:23:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.478+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d9318640 0x5588d931aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:23:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.480+0000 7f02b9e00640 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d9318640 0x5588d931aa60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1731c17b2a6479a5 server_cookie=f920291af858847b in_seq=0 out_seq=0 2024-08-28T20:23:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.480+0000 7f029f400640 10 client.25615 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.539+0000 7f029f400640 1 -- 172.21.15.1:0/2642669912 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588d91f6960 con 0x5588d9318640 2024-08-28T20:23:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.539+0000 7f029f400640 10 client.25615 handle_command_reply: tid=0 2024-08-28T20:23:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.539+0000 7f02c7dc3740 1 client.25615 shutdown 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 msgr2=0x5588d9296bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 0x5588d9296bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02b401fa00 tx=0x7f02b401fa30 comp rx=0 tx=0).stop 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 shutdown_connections 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5588d9318640 0x5588d931aa60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5588d8e741c0 0x5588d9296bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5588d8ee01b0 0x5588d9293000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 --2- 172.21.15.1:0/2642669912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5588d8ebf4d0 0x5588d9292940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f029f400640 0 client.25615 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:23:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 >> 172.21.15.1:0/2642669912 conn(0x5588d8ed4300 msgr2=0x5588d928d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 shutdown_connections 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 1 -- 172.21.15.1:0/2642669912 wait complete. 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.540+0000 7f02c7dc3740 20 client.25615 trim_cache size 0 max 16384 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:23:55.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02a00b4bf0 msgr2=0x7f02a00b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02a00b4bf0 0x7f02a00b7100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009e10 tx=0x7f02b4005f90 comp rx=0 tx=0).stop 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 msgr2=0x7f02bc1a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 0x7f02bc1a0980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f02a4031440 tx=0x7f02a4003b90 comp rx=0 tx=0).stop 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 shutdown_connections 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f02a00b4bf0 0x7f02a00b7100 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02bc0793e0 0x7f02bc1a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc078a40 0x7f02bc1a0980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 --2- 172.21.15.1:0/1149464924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02bc0779c0 0x7f02bc1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:23:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.541+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 >> 172.21.15.1:0/1149464924 conn(0x7f02bc100fd0 msgr2=0x7f02bc103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:23:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.542+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 shutdown_connections 2024-08-28T20:23:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:23:55.542+0000 7f02c0c00640 1 -- 172.21.15.1:0/1149464924 wait complete. 2024-08-28T20:23:56.278 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:56 smithi001 ceph-mon[20984]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.5 MiB/s wr, 776 op/s 2024-08-28T20:23:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:56 smithi007 ceph-mon[25357]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.5 MiB/s wr, 776 op/s 2024-08-28T20:23:56.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:56 smithi121 ceph-mon[25248]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.5 MiB/s wr, 776 op/s 2024-08-28T20:23:57.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:57 smithi007 ceph-mon[25357]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.6 MiB/s wr, 747 op/s 2024-08-28T20:23:57.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:57 smithi001 ceph-mon[20984]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.6 MiB/s wr, 747 op/s 2024-08-28T20:23:57.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:57 smithi121 ceph-mon[25248]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.6 MiB/s wr, 747 op/s 2024-08-28T20:23:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 330.0 s, 2394.2 tps, lat 41.754 ms stddev 52.081 2024-08-28T20:23:59.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:23:59 smithi001 ceph-mon[20984]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 699 op/s 2024-08-28T20:23:59.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:23:59 smithi121 ceph-mon[25248]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 699 op/s 2024-08-28T20:23:59.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:23:59 smithi007 ceph-mon[25357]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 699 op/s 2024-08-28T20:24:01.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:01 smithi001 ceph-mon[20984]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.9 MiB/s wr, 708 op/s 2024-08-28T20:24:01.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:01 smithi121 ceph-mon[25248]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.9 MiB/s wr, 708 op/s 2024-08-28T20:24:01.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:01 smithi007 ceph-mon[25357]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.9 MiB/s wr, 708 op/s 2024-08-28T20:24:03.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:03 smithi001 ceph-mon[20984]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.1 MiB/s wr, 677 op/s 2024-08-28T20:24:03.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:03 smithi121 ceph-mon[25248]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.1 MiB/s wr, 677 op/s 2024-08-28T20:24:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 335.0 s, 1835.8 tps, lat 54.314 ms stddev 67.229 2024-08-28T20:24:03.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:03 smithi007 ceph-mon[25357]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.1 MiB/s wr, 677 op/s 2024-08-28T20:24:05.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:05 smithi001 ceph-mon[20984]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 772 op/s 2024-08-28T20:24:05.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:05 smithi121 ceph-mon[25248]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 772 op/s 2024-08-28T20:24:05.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:05 smithi007 ceph-mon[25357]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 772 op/s 2024-08-28T20:24:07.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:07 smithi001 ceph-mon[20984]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 633 op/s 2024-08-28T20:24:07.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:07 smithi121 ceph-mon[25248]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 633 op/s 2024-08-28T20:24:07.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:07 smithi007 ceph-mon[25357]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 633 op/s 2024-08-28T20:24:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 340.0 s, 2659.8 tps, lat 37.699 ms stddev 48.375 2024-08-28T20:24:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 -- 172.21.15.1:0/2507300241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 msgr2=0x7f7ed010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/2507300241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 0x7f7ed010d870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009860 tx=0x7f7ec002a340 comp rx=0 tx=0).stop 2024-08-28T20:24:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 -- 172.21.15.1:0/2507300241 shutdown_connections 2024-08-28T20:24:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/2507300241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ed0106530 0x7f7ed0106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/2507300241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 0x7f7ed010d870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/2507300241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.871+0000 7f7ecfe00640 1 -- 172.21.15.1:0/2507300241 >> 172.21.15.1:0/2507300241 conn(0x7f7ed0100df0 msgr2=0x7f7ed01032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.872+0000 7f7ecfe00640 1 -- 172.21.15.1:0/2507300241 shutdown_connections 2024-08-28T20:24:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.872+0000 7f7ecfe00640 1 -- 172.21.15.1:0/2507300241 wait complete. 2024-08-28T20:24:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.873+0000 7f7ecfe00640 1 Processor -- start 2024-08-28T20:24:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.874+0000 7f7ecfe00640 1 -- start start 2024-08-28T20:24:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecfe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ed0106530 0x7f7ed019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 0x7f7ed019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecfe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0111150 con 0x7f7ed0106530 2024-08-28T20:24:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0110fd0 con 0x7f7ed01054b0 2024-08-28T20:24:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecfe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01112d0 con 0x7f7ed0106ed0 2024-08-28T20:24:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35940/0 (socket says 172.21.15.1:35940) 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecea00640 1 -- 172.21.15.1:0/1995611070 learned_addr learned my addr 172.21.15.1:0/1995611070 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.875+0000 7f7ecf400640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 0x7f7ed019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.876+0000 7f7ecea00640 1 -- 172.21.15.1:0/1995611070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 msgr2=0x7f7ed019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.876+0000 7f7ecea00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 0x7f7ed019cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.876+0000 7f7ecea00640 1 -- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ed0106530 msgr2=0x7f7ed019c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.876+0000 7f7ecea00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ed0106530 0x7f7ed019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.876+0000 7f7ecea00640 1 -- 172.21.15.1:0/1995611070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed019d720 con 0x7f7ed01054b0 2024-08-28T20:24:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.876+0000 7f7ecea00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed019bce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c420 tx=0x7f7ec8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.877+0000 7f7ec7400640 1 -- 172.21.15.1:0/1995611070 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8003970 con 0x7f7ed01054b0 2024-08-28T20:24:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.877+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed019da10 con 0x7f7ed01054b0 2024-08-28T20:24:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.877+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed01a4100 con 0x7f7ed01054b0 2024-08-28T20:24:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.877+0000 7f7ec7400640 1 -- 172.21.15.1:0/1995611070 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ec8004020 con 0x7f7ed01054b0 2024-08-28T20:24:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.877+0000 7f7ec7400640 1 -- 172.21.15.1:0/1995611070 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800b9a0 con 0x7f7ed01054b0 2024-08-28T20:24:08.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.883+0000 7f7edcc77740 1 Processor -- start 2024-08-28T20:24:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.883+0000 7f7edcc77740 1 -- start start 2024-08-28T20:24:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.884+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f766fa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.884+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f766fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.884+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f766fb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.884+0000 7f7edcc77740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f76664f70 con 0x562f7634c1b0 2024-08-28T20:24:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.884+0000 7f7edcc77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f76654500 con 0x562f763232f0 2024-08-28T20:24:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.884+0000 7f7edcc77740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f766584b0 con 0x562f7632b4d0 2024-08-28T20:24:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.885+0000 7f7ecf400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f766fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.885+0000 7f7ece000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f766fb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.885+0000 7f7ec7400640 1 -- 172.21.15.1:0/1995611070 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f7ec801d020 con 0x7f7ed01054b0 2024-08-28T20:24:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.885+0000 7f7ecf400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f766fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33780/0 (socket says 172.21.15.1:33780) 2024-08-28T20:24:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.885+0000 7f7ecf400640 1 -- 172.21.15.1:0/2933349069 learned_addr learned my addr 172.21.15.1:0/2933349069 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.885+0000 7f7ecea00640 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f766fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.886+0000 7f7ecea00640 1 -- 172.21.15.1:0/2933349069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 msgr2=0x562f766fb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.886+0000 7f7ecea00640 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f766fb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.886+0000 7f7ecea00640 1 -- 172.21.15.1:0/2933349069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 msgr2=0x562f766fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.886+0000 7f7ecea00640 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f766fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.886+0000 7f7ecea00640 1 -- 172.21.15.1:0/2933349069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7660ec10 con 0x562f763232f0 2024-08-28T20:24:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.886+0000 7f7ecf400640 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f766fa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:24:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.887+0000 7f7ecea00640 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f766fabc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80e2af0 tx=0x7f7ec80ed1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dda83524a5d4bf8d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.887+0000 7f7ebfe00640 1 -- 172.21.15.1:0/2933349069 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80f8070 con 0x562f763232f0 2024-08-28T20:24:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.887+0000 7f7ebfe00640 1 -- 172.21.15.1:0/2933349069 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ec80e54f0 con 0x562f763232f0 2024-08-28T20:24:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.887+0000 7f7ebfe00640 1 -- 172.21.15.1:0/2933349069 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80ede60 con 0x562f763232f0 2024-08-28T20:24:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.888+0000 7f7ec7400640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7eb40b4c20 0x7f7eb40b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.888+0000 7f7ec7400640 1 -- 172.21.15.1:0/1995611070 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7ec80e50c0 con 0x7f7ed01054b0 2024-08-28T20:24:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.888+0000 7f7ecf400640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7eb40b4c20 0x7f7eb40b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 -- 172.21.15.1:0/2933349069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 msgr2=0x562f766fabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f766fabc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80e2af0 tx=0x7f7ec80ed1b0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 -- 172.21.15.1:0/2933349069 shutdown_connections 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f766fb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f766fabc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 --2- 172.21.15.1:0/2933349069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f766fa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.889+0000 7f7edcc77740 1 -- 172.21.15.1:0/2933349069 >> 172.21.15.1:0/2933349069 conn(0x562f76340300 msgr2=0x562f766ed7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.890+0000 7f7ecf400640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7eb40b4c20 0x7f7eb40b7130 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00095f0 tx=0x7f7ec0030450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.890+0000 7f7edcc77740 1 -- 172.21.15.1:0/2933349069 shutdown_connections 2024-08-28T20:24:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.890+0000 7f7edcc77740 1 -- 172.21.15.1:0/2933349069 wait complete. 2024-08-28T20:24:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.891+0000 7f7edcc77740 1 -- start start 2024-08-28T20:24:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.891+0000 7f7edcc77740 1 Processor -- start 2024-08-28T20:24:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f76703ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f76704190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f76704d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f7658dab0 con 0x562f7634c1b0 2024-08-28T20:24:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f765fb320 con 0x562f763232f0 2024-08-28T20:24:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f766fc0b0 con 0x562f7632b4d0 2024-08-28T20:24:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.892+0000 7f7edcc77740 10 client.0 _ll_register_callbacks cb 0x562f76634e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.893+0000 7f7ecea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f76703ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.893+0000 7f7ecea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f76703ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35956/0 (socket says 172.21.15.1:35956) 2024-08-28T20:24:08.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.893+0000 7f7ecea00640 1 -- 172.21.15.1:0/3142803038 learned_addr learned my addr 172.21.15.1:0/3142803038 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:08.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.893+0000 7f7ece000640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f76704190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.893+0000 7f7ecf400640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f76704d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.894+0000 7f7ecea00640 1 -- 172.21.15.1:0/3142803038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 msgr2=0x562f76704190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.894+0000 7f7ecea00640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f76704190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.894+0000 7f7ecea00640 1 -- 172.21.15.1:0/3142803038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 msgr2=0x562f76704d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.894+0000 7f7ecea00640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f76704d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.894+0000 7f7ecea00640 1 -- 172.21.15.1:0/3142803038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f763b7790 con 0x562f763232f0 2024-08-28T20:24:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.894+0000 7f7ecf400640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f76704d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:24:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.895+0000 7f7ecea00640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f76703ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80aba10 tx=0x7f7ec80e53a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97cedd9d3d360f4a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.895+0000 7f7ebcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:24:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.896+0000 7f7ebcc00640 1 -- 172.21.15.1:0/3142803038 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80a7940 con 0x562f763232f0 2024-08-28T20:24:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.896+0000 7f7ebcc00640 1 -- 172.21.15.1:0/3142803038 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7ec80e72e0 con 0x562f763232f0 2024-08-28T20:24:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.896+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ec80e54f0 con 0x562f763232f0 2024-08-28T20:24:08.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.896+0000 7f7ebcc00640 1 -- 172.21.15.1:0/3142803038 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7ec80a7210 con 0x562f763232f0 2024-08-28T20:24:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.898+0000 7f7edcc77740 10 client.25667 fetch_fsmap learned FSMap version 39 2024-08-28T20:24:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.898+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562f76430620 con 0x562f763232f0 2024-08-28T20:24:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.899+0000 7f7ebcc00640 1 -- 172.21.15.1:0/3142803038 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ec80e54f0 con 0x562f763232f0 2024-08-28T20:24:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.899+0000 7f7ebcc00640 1 -- 172.21.15.1:0/3142803038 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8358+0+0 (secure 0 0 0) 0x7f7ec800b040 con 0x562f763232f0 2024-08-28T20:24:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7edcc77740 10 client.25667 fetch_fsmap finished waiting for FSMap version 39 2024-08-28T20:24:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7edcc77740 10 client.25667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7edcc77740 20 client.25667 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7edcc77740 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7630ad80 0x562f76710f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7edcc77740 4 client.25667 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:24:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f76666ec0 con 0x562f7630ad80 2024-08-28T20:24:08.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.900+0000 7f7ece000640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7630ad80 0x562f76710f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.902+0000 7f7ece000640 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7630ad80 0x562f76710f90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41cad09a4d606499 server_cookie=9a5dcdc59f6c371f in_seq=0 out_seq=0 2024-08-28T20:24:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.902+0000 7f7ebcc00640 10 client.25667 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.902+0000 7f7ebcc00640 1 -- 172.21.15.1:0/3142803038 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f76666ec0 con 0x562f7630ad80 2024-08-28T20:24:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7ebcc00640 10 client.25667 handle_command_reply: tid=0 2024-08-28T20:24:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 client.25667 shutdown 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 msgr2=0x562f76703ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f76703ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80aba10 tx=0x7f7ec80e53a0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 shutdown_connections 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f7630ad80 0x562f76710f90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f7634c1b0 0x562f76704d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7632b4d0 0x562f76704190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 --2- 172.21.15.1:0/3142803038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f763232f0 0x562f76703ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 >> 172.21.15.1:0/3142803038 conn(0x562f76340300 msgr2=0x562f766ebd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.903+0000 7f7ebcc00640 0 client.25667 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.904+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 shutdown_connections 2024-08-28T20:24:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.904+0000 7f7edcc77740 1 -- 172.21.15.1:0/3142803038 wait complete. 2024-08-28T20:24:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.904+0000 7f7edcc77740 20 client.25667 trim_cache size 0 max 16384 2024-08-28T20:24:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.943+0000 7f7edcc77740 1 Processor -- start 2024-08-28T20:24:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.943+0000 7f7edcc77740 1 -- start start 2024-08-28T20:24:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f766fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f76705260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f766ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7edcc77740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01ab340 con 0x562f763232f0 2024-08-28T20:24:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7edcc77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a8be0 con 0x562f7632b4d0 2024-08-28T20:24:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7edcc77740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a6a50 con 0x562f7634c1b0 2024-08-28T20:24:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7ecf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f766ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7ecf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f766ebd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60364/0 (socket says 172.21.15.1:60364) 2024-08-28T20:24:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7ecf400640 1 -- 172.21.15.1:0/120807536 learned_addr learned my addr 172.21.15.1:0/120807536 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7ece000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f76705260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.944+0000 7f7ecea00640 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f766fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.945+0000 7f7ecf400640 1 -- 172.21.15.1:0/120807536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 msgr2=0x562f76705260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.945+0000 7f7ecf400640 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f76705260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.945+0000 7f7ecf400640 1 -- 172.21.15.1:0/120807536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 msgr2=0x562f766fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.945+0000 7f7ecf400640 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f766fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.945+0000 7f7ecf400640 1 -- 172.21.15.1:0/120807536 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f76701ce0 con 0x562f7634c1b0 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.945+0000 7f7ecf400640 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f766ebd70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009860 tx=0x7f7ec003f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4eb7cb4ace626a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.946+0000 7f7ebf400640 1 -- 172.21.15.1:0/120807536 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0048040 con 0x562f7634c1b0 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.946+0000 7f7ebf400640 1 -- 172.21.15.1:0/120807536 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ec0053070 con 0x562f7634c1b0 2024-08-28T20:24:08.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.946+0000 7f7ebf400640 1 -- 172.21.15.1:0/120807536 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0037040 con 0x562f7634c1b0 2024-08-28T20:24:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 -- 172.21.15.1:0/120807536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 msgr2=0x562f766ebd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f766ebd70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009860 tx=0x7f7ec003f000 comp rx=0 tx=0).stop 2024-08-28T20:24:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 -- 172.21.15.1:0/120807536 shutdown_connections 2024-08-28T20:24:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f766ebd70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f76705260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 --2- 172.21.15.1:0/120807536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f766fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 -- 172.21.15.1:0/120807536 >> 172.21.15.1:0/120807536 conn(0x562f76340300 msgr2=0x562f766fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.947+0000 7f7edcc77740 1 -- 172.21.15.1:0/120807536 shutdown_connections 2024-08-28T20:24:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.948+0000 7f7edcc77740 1 -- 172.21.15.1:0/120807536 wait complete. 2024-08-28T20:24:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.948+0000 7f7edcc77740 1 -- start start 2024-08-28T20:24:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.948+0000 7f7edcc77740 1 Processor -- start 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.949+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f7670b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.949+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f7670a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.949+0000 7f7edcc77740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f7670a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.949+0000 7f7edcc77740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a70a0 con 0x562f763232f0 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.949+0000 7f7edcc77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a8510 con 0x562f7632b4d0 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.949+0000 7f7edcc77740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a7770 con 0x562f7634c1b0 2024-08-28T20:24:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7edcc77740 10 client.0 _ll_register_callbacks cb 0x7f7ec80f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7ecea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f7670b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7ece000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f7670a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7ecea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f7670b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33808/0 (socket says 172.21.15.1:33808) 2024-08-28T20:24:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7ecea00640 1 -- 172.21.15.1:0/778291407 learned_addr learned my addr 172.21.15.1:0/778291407 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7ecf400640 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f7670a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.950+0000 7f7ece000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f7670a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35972/0 (socket says 172.21.15.1:35972) 2024-08-28T20:24:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.951+0000 7f7ecea00640 1 -- 172.21.15.1:0/778291407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 msgr2=0x562f7670a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.951+0000 7f7ecea00640 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f7670a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.951+0000 7f7ecea00640 1 -- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 msgr2=0x562f7670a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.951+0000 7f7ecea00640 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f7670a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.951+0000 7f7ecea00640 1 -- 172.21.15.1:0/778291407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7670ad60 con 0x562f763232f0 2024-08-28T20:24:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.952+0000 7f7ecea00640 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f7670b620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80b4f60 tx=0x7f7ec80e5d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b8059d08124378 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.952+0000 7f7ebcc00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:24:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.952+0000 7f7ebcc00640 1 -- 172.21.15.1:0/778291407 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80ab1f0 con 0x562f763232f0 2024-08-28T20:24:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.952+0000 7f7ebcc00640 1 -- 172.21.15.1:0/778291407 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f7ec80041d0 con 0x562f763232f0 2024-08-28T20:24:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.952+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ec0053070 con 0x562f763232f0 2024-08-28T20:24:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.953+0000 7f7ebcc00640 1 -- 172.21.15.1:0/778291407 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7ec80ab3d0 con 0x562f763232f0 2024-08-28T20:24:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.953+0000 7f7edcc77740 10 client.15498 fetch_fsmap learned FSMap version 39 2024-08-28T20:24:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.953+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562f76709bb0 con 0x562f763232f0 2024-08-28T20:24:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7ebcc00640 1 -- 172.21.15.1:0/778291407 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ec0053070 con 0x562f763232f0 2024-08-28T20:24:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7ebcc00640 1 -- 172.21.15.1:0/778291407 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 39) ==== 8358+0+0 (secure 0 0 0) 0x7f7ec80a7d10 con 0x562f763232f0 2024-08-28T20:24:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7edcc77740 10 client.15498 fetch_fsmap finished waiting for FSMap version 39 2024-08-28T20:24:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7edcc77740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7edcc77740 20 client.15498 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7edcc77740 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f762e01c0 0x562f7677dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7edcc77740 4 client.15498 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:24:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.954+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f76662960 con 0x562f762e01c0 2024-08-28T20:24:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.955+0000 7f7ece000640 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f762e01c0 0x562f7677dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.956+0000 7f7ebcc00640 10 client.15498 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:08.959+0000 7f7ece000640 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f762e01c0 0x562f7677dda0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e27b5730956fba9 server_cookie=3f752eb3cec6606c in_seq=0 out_seq=0 2024-08-28T20:24:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.020+0000 7f7ebcc00640 1 -- 172.21.15.1:0/778291407 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f76662960 con 0x562f762e01c0 2024-08-28T20:24:09.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.020+0000 7f7ebcc00640 10 client.15498 handle_command_reply: tid=0 2024-08-28T20:24:09.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.020+0000 7f7edcc77740 1 client.15498 shutdown 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.020+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 msgr2=0x562f7670b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.020+0000 7f7edcc77740 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f7670b620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80b4f60 tx=0x7f7ec80e5d30 comp rx=0 tx=0).stop 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 shutdown_connections 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f762e01c0 0x562f7677dda0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f7634c1b0 0x562f7670a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7ebcc00640 0 client.15498 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f7632b4d0 0x562f7670a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 --2- 172.21.15.1:0/778291407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f763232f0 0x562f7670b620 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 >> 172.21.15.1:0/778291407 conn(0x562f76340300 msgr2=0x562f76702060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 shutdown_connections 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.021+0000 7f7edcc77740 1 -- 172.21.15.1:0/778291407 wait complete. 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.022+0000 7f7edcc77740 20 client.15498 trim_cache size 0 max 16384 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:24:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:24:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7eb40b4c20 msgr2=0x7f7eb40b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7eb40b4c20 0x7f7eb40b7130 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00095f0 tx=0x7f7ec0030450 comp rx=0 tx=0).stop 2024-08-28T20:24:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 msgr2=0x7f7ed019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed019bce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c420 tx=0x7f7ec8009f90 comp rx=0 tx=0).stop 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 shutdown_connections 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f7eb40b4c20 0x7f7eb40b7130 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ed0106530 0x7f7ed019c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ed0106ed0 0x7f7ed019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 --2- 172.21.15.1:0/1995611070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed01054b0 0x7f7ed019bce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.023+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 >> 172.21.15.1:0/1995611070 conn(0x7f7ed0100df0 msgr2=0x7f7ed0109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.024+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 shutdown_connections 2024-08-28T20:24:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:09.024+0000 7f7ecfe00640 1 -- 172.21.15.1:0/1995611070 wait complete. 2024-08-28T20:24:09.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:09 smithi001 ceph-mon[20984]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 671 op/s 2024-08-28T20:24:09.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:09 smithi121 ceph-mon[25248]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 671 op/s 2024-08-28T20:24:09.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:09 smithi007 ceph-mon[25357]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 671 op/s 2024-08-28T20:24:10.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:10 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:24:10.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:10 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:24:10.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:10 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:24:11.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:11 smithi001 ceph-mon[20984]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 678 op/s 2024-08-28T20:24:11.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:11 smithi121 ceph-mon[25248]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 678 op/s 2024-08-28T20:24:11.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:11 smithi007 ceph-mon[25357]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 678 op/s 2024-08-28T20:24:13.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:13 smithi001 ceph-mon[20984]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 700 op/s 2024-08-28T20:24:13.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:13 smithi121 ceph-mon[25248]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 700 op/s 2024-08-28T20:24:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 345.0 s, 2621.0 tps, lat 37.810 ms stddev 43.442 2024-08-28T20:24:13.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:13 smithi007 ceph-mon[25357]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 700 op/s 2024-08-28T20:24:15.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:15 smithi001 ceph-mon[20984]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 770 op/s 2024-08-28T20:24:15.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:15 smithi121 ceph-mon[25248]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 770 op/s 2024-08-28T20:24:15.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:15 smithi007 ceph-mon[25357]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 770 op/s 2024-08-28T20:24:17.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:17 smithi007 ceph-mon[25357]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 719 op/s 2024-08-28T20:24:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:17 smithi001 ceph-mon[20984]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 719 op/s 2024-08-28T20:24:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:17 smithi121 ceph-mon[25248]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 719 op/s 2024-08-28T20:24:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 350.0 s, 2341.7 tps, lat 42.995 ms stddev 49.946 2024-08-28T20:24:19.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:19 smithi007 ceph-mon[25357]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 720 op/s 2024-08-28T20:24:19.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:19 smithi001 ceph-mon[20984]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 720 op/s 2024-08-28T20:24:19.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:19 smithi121 ceph-mon[25248]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 720 op/s 2024-08-28T20:24:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:21 smithi007 ceph-mon[25357]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-08-28T20:24:21.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:21 smithi001 ceph-mon[20984]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-08-28T20:24:21.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:21 smithi121 ceph-mon[25248]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 -- 172.21.15.1:0/3561194076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc00076e30 msgr2=0x7fbc000754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 --2- 172.21.15.1:0/3561194076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc00076e30 0x7fbc000754f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009be0 tx=0x7fbbf802a6c0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 -- 172.21.15.1:0/3561194076 shutdown_connections 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 --2- 172.21.15.1:0/3561194076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc0010b2b0 0x7fbc0010d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 --2- 172.21.15.1:0/3561194076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00075a30 0x7fbc00075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 --2- 172.21.15.1:0/3561194076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc00076e30 0x7fbc000754f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 -- 172.21.15.1:0/3561194076 >> 172.21.15.1:0/3561194076 conn(0x7fbc000fec00 msgr2=0x7fbc001010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 -- 172.21.15.1:0/3561194076 shutdown_connections 2024-08-28T20:24:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.339+0000 7fbc06a00640 1 -- 172.21.15.1:0/3561194076 wait complete. 2024-08-28T20:24:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 Processor -- start 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 -- start start 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc00075a30 0x7fbc001979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 0x7fbc00198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0010b2b0 0x7fbc00198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00111150 con 0x7fbc00075a30 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00110fd0 con 0x7fbc00076e30 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.341+0000 7fbc06a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001112d0 con 0x7fbc0010b2b0 2024-08-28T20:24:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 0x7fbc00198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 0x7fbc00198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40462/0 (socket says 172.21.15.1:40462) 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 -- 172.21.15.1:0/274362042 learned_addr learned my addr 172.21.15.1:0/274362042 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc06000640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0010b2b0 0x7fbc00198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc05600640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc00075a30 0x7fbc001979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 -- 172.21.15.1:0/274362042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0010b2b0 msgr2=0x7fbc00198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0010b2b0 0x7fbc00198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 -- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc00075a30 msgr2=0x7fbc001979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.342+0000 7fbc04c00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc00075a30 0x7fbc001979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.343+0000 7fbc04c00640 1 -- 172.21.15.1:0/274362042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc001993e0 con 0x7fbc00076e30 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.343+0000 7fbc05600640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc00075a30 0x7fbc001979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.343+0000 7fbc04c00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 0x7fbc00198010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e9c0 tx=0x7fbbec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.343+0000 7fbbfe000640 1 -- 172.21.15.1:0/274362042 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00cde0 con 0x7fbc00076e30 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.344+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc001996d0 con 0x7fbc00076e30 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.344+0000 7fbbfe000640 1 -- 172.21.15.1:0/274362042 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec0035f0 con 0x7fbc00076e30 2024-08-28T20:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.344+0000 7fbbfe000640 1 -- 172.21.15.1:0/274362042 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec010690 con 0x7fbc00076e30 2024-08-28T20:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.344+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0019ddb0 con 0x7fbc00076e30 2024-08-28T20:24:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.348+0000 7fbc0f1c7740 1 Processor -- start 2024-08-28T20:24:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.348+0000 7fbc0f1c7740 1 -- start start 2024-08-28T20:24:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.349+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.349+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.349+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.349+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564dd9217f70 con 0x564dd8ed62f0 2024-08-28T20:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.349+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564dd9207500 con 0x564dd8ede4d0 2024-08-28T20:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.349+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564dd920b4b0 con 0x564dd8eff1b0 2024-08-28T20:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.350+0000 7fbc05600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.350+0000 7fbc05600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35400/0 (socket says 172.21.15.1:35400) 2024-08-28T20:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.350+0000 7fbc05600640 1 -- 172.21.15.1:0/1539441236 learned_addr learned my addr 172.21.15.1:0/1539441236 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.351+0000 7fbc06000640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.351+0000 7fbbfe000640 1 -- 172.21.15.1:0/274362042 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbbec010830 con 0x7fbc00076e30 2024-08-28T20:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.352+0000 7fbc04c00640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.352+0000 7fbc06000640 1 -- 172.21.15.1:0/1539441236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 msgr2=0x564dd92a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.352+0000 7fbc06000640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.352+0000 7fbc06000640 1 -- 172.21.15.1:0/1539441236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 msgr2=0x564dd92a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.352+0000 7fbc06000640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92a53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.352+0000 7fbc06000640 1 -- 172.21.15.1:0/1539441236 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd91c1c10 con 0x564dd8eff1b0 2024-08-28T20:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.353+0000 7fbc05600640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92a53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.353+0000 7fbc04c00640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.353+0000 7fbc06000640 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92a4d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009ac0 tx=0x7fbbf4009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4977aa1378de436 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.354+0000 7fbbf2600640 1 -- 172.21.15.1:0/1539441236 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4011da0 con 0x564dd8eff1b0 2024-08-28T20:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.354+0000 7fbbf2600640 1 -- 172.21.15.1:0/1539441236 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbf40054d0 con 0x564dd8eff1b0 2024-08-28T20:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.354+0000 7fbbf2600640 1 -- 172.21.15.1:0/1539441236 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40126b0 con 0x564dd8eff1b0 2024-08-28T20:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.356+0000 7fbbfe000640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbe80b4bf0 0x7fbbe80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.356+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/1539441236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 msgr2=0x564dd92a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.356+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92a4d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009ac0 tx=0x7fbbf4009f80 comp rx=0 tx=0).stop 2024-08-28T20:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/1539441236 shutdown_connections 2024-08-28T20:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92a53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/1539441236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92a4d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbbfe000640 1 -- 172.21.15.1:0/274362042 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbbec0e5540 con 0x7fbc00076e30 2024-08-28T20:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/1539441236 >> 172.21.15.1:0/1539441236 conn(0x564dd8ef3300 msgr2=0x564dd92a07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/1539441236 shutdown_connections 2024-08-28T20:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.357+0000 7fbc05600640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbe80b4bf0 0x7fbbe80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.358+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/1539441236 wait complete. 2024-08-28T20:24:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.359+0000 7fbc05600640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbe80b4bf0 0x7fbbe80b7100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009be0 tx=0x7fbbf802abc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.360+0000 7fbc0f1c7740 1 -- start start 2024-08-28T20:24:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.361+0000 7fbc0f1c7740 1 Processor -- start 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564dd9140ab0 con 0x564dd8ed62f0 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564dd91ae320 con 0x564dd8ede4d0 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564dd92a6a20 con 0x564dd8eff1b0 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc0f1c7740 10 client.0 _ll_register_callbacks cb 0x564dd91e7e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc06000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc05600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc04c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc05600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35412/0 (socket says 172.21.15.1:35412) 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.364+0000 7fbc05600640 1 -- 172.21.15.1:0/799926627 learned_addr learned my addr 172.21.15.1:0/799926627 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.365+0000 7fbc04c00640 1 -- 172.21.15.1:0/799926627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 msgr2=0x564dd92af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.365+0000 7fbc04c00640 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.365+0000 7fbc04c00640 1 -- 172.21.15.1:0/799926627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 msgr2=0x564dd92ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.366+0000 7fbc04c00640 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.366+0000 7fbc04c00640 1 -- 172.21.15.1:0/799926627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd8f6a790 con 0x564dd8ede4d0 2024-08-28T20:24:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.366+0000 7fbc05600640 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:24:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.367+0000 7fbc04c00640 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92aea60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e3080 tx=0x7fbbec003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9be3e87bafdb134b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.367+0000 7fbbe6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:24:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.367+0000 7fbbe6a00640 1 -- 172.21.15.1:0/799926627 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0b07d0 con 0x564dd8ede4d0 2024-08-28T20:24:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.367+0000 7fbbe6a00640 1 -- 172.21.15.1:0/799926627 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbbec0ac1c0 con 0x564dd8ede4d0 2024-08-28T20:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.368+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbf40054d0 con 0x564dd8ede4d0 2024-08-28T20:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.368+0000 7fbbe6a00640 1 -- 172.21.15.1:0/799926627 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fbbec0b5280 con 0x564dd8ede4d0 2024-08-28T20:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.369+0000 7fbc0f1c7740 10 client.25682 fetch_fsmap learned FSMap version 40 2024-08-28T20:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.369+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x564dd8fe3620 con 0x564dd8ede4d0 2024-08-28T20:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.369+0000 7fbbe6a00640 1 -- 172.21.15.1:0/799926627 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbf40054d0 con 0x564dd8ede4d0 2024-08-28T20:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.369+0000 7fbbe6a00640 1 -- 172.21.15.1:0/799926627 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7fbbec0971e0 con 0x564dd8ede4d0 2024-08-28T20:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.370+0000 7fbc0f1c7740 10 client.25682 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.370+0000 7fbc0f1c7740 10 client.25682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.370+0000 7fbc0f1c7740 20 client.25682 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.370+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd8ebdd80 0x564dd92bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.370+0000 7fbc0f1c7740 4 client.25682 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:24:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.371+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dd9219ec0 con 0x564dd8ebdd80 2024-08-28T20:24:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.371+0000 7fbc05600640 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd8ebdd80 0x564dd92bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.372+0000 7fbc05600640 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd8ebdd80 0x564dd92bbb80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38df181419cfef6a server_cookie=f90c25a734cb6a84 in_seq=0 out_seq=0 2024-08-28T20:24:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.372+0000 7fbbe6a00640 10 client.25682 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.373+0000 7fbbe6a00640 1 -- 172.21.15.1:0/799926627 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564dd9219ec0 con 0x564dd8ebdd80 2024-08-28T20:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.373+0000 7fbbe6a00640 10 client.25682 handle_command_reply: tid=0 2024-08-28T20:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.373+0000 7fbc0f1c7740 1 client.25682 shutdown 2024-08-28T20:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.374+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 msgr2=0x564dd92aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.374+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92aea60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e3080 tx=0x7fbbec003cd0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 shutdown_connections 2024-08-28T20:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd8ebdd80 0x564dd92bbb80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ede4d0 0x564dd92aea60 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e3080 tx=0x7fbbec003cd0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/799926627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 >> 172.21.15.1:0/799926627 conn(0x564dd8ef3300 msgr2=0x564dd92a07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbbe6a00640 0 client.25682 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.375+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 shutdown_connections 2024-08-28T20:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.376+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/799926627 wait complete. 2024-08-28T20:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.376+0000 7fbc0f1c7740 20 client.25682 trim_cache size 0 max 16384 2024-08-28T20:24:22.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.406+0000 7fbc0f1c7740 1 Processor -- start 2024-08-28T20:24:22.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.406+0000 7fbc0f1c7740 1 -- start start 2024-08-28T20:24:22.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ed62f0 0x564dd929b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8e931c0 0x564dd92b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001bc350 con 0x564dd8e931c0 2024-08-28T20:24:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001b9c20 con 0x564dd8ed62f0 2024-08-28T20:24:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001b7a70 con 0x564dd8eff1b0 2024-08-28T20:24:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.407+0000 7fbc04c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc04c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:56834/0 (socket says 172.21.15.1:56834) 2024-08-28T20:24:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc04c00640 1 -- 172.21.15.1:0/2610288979 learned_addr learned my addr 172.21.15.1:0/2610288979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc05600640 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ed62f0 0x564dd929b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc06000640 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8e931c0 0x564dd92b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc04c00640 1 -- 172.21.15.1:0/2610288979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ed62f0 msgr2=0x564dd929b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc04c00640 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ed62f0 0x564dd929b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.408+0000 7fbc04c00640 1 -- 172.21.15.1:0/2610288979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8e931c0 msgr2=0x564dd92b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.409+0000 7fbc04c00640 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8e931c0 0x564dd92b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.409+0000 7fbc04c00640 1 -- 172.21.15.1:0/2610288979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd8ebdfb0 con 0x564dd8eff1b0 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.409+0000 7fbc06000640 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8e931c0 0x564dd92b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:24:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.409+0000 7fbc04c00640 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92b5d60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e33a0 tx=0x7fbbec0039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25296a996f86064a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.410+0000 7fbbf1c00640 1 -- 172.21.15.1:0/2610288979 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0b07d0 con 0x564dd8eff1b0 2024-08-28T20:24:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.410+0000 7fbbf1c00640 1 -- 172.21.15.1:0/2610288979 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec0e50d0 con 0x564dd8eff1b0 2024-08-28T20:24:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.410+0000 7fbbf1c00640 1 -- 172.21.15.1:0/2610288979 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ab8b0 con 0x564dd8eff1b0 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/2610288979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 msgr2=0x564dd92b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92b5d60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e33a0 tx=0x7fbbec0039b0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/2610288979 shutdown_connections 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8e931c0 0x564dd92b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8eff1b0 0x564dd92b5d60 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e33a0 tx=0x7fbbec0039b0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/2610288979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd8ed62f0 0x564dd929b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/2610288979 >> 172.21.15.1:0/2610288979 conn(0x564dd8ef3300 msgr2=0x564dd929ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/2610288979 shutdown_connections 2024-08-28T20:24:22.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.411+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/2610288979 wait complete. 2024-08-28T20:24:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.412+0000 7fbc0f1c7740 1 -- start start 2024-08-28T20:24:22.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.413+0000 7fbc0f1c7740 1 Processor -- start 2024-08-28T20:24:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8e931c0 0x564dd92b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 0x564dd92b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001b80e0 con 0x564dd8ed62f0 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001b9550 con 0x564dd92b43d0 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001b87b0 con 0x564dd8e931c0 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc0f1c7740 10 client.0 _ll_register_callbacks cb 0x7fbbec003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc06000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 0x564dd92b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc06000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 0x564dd92b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40496/0 (socket says 172.21.15.1:40496) 2024-08-28T20:24:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc06000640 1 -- 172.21.15.1:0/4149315205 learned_addr learned my addr 172.21.15.1:0/4149315205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc05600640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8e931c0 0x564dd92b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.414+0000 7fbc04c00640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc06000640 1 -- 172.21.15.1:0/4149315205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8e931c0 msgr2=0x564dd92b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc06000640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8e931c0 0x564dd92b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc06000640 1 -- 172.21.15.1:0/4149315205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 msgr2=0x564dd92b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc06000640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc06000640 1 -- 172.21.15.1:0/4149315205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd92b4e20 con 0x564dd92b43d0 2024-08-28T20:24:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc05600640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8e931c0 0x564dd92b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:24:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbc06000640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 0x564dd92b47e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbbf401a000 tx=0x7fbbf4011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb25bbb2482686 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:22.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.415+0000 7fbbe6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.416+0000 7fbbe6a00640 1 -- 172.21.15.1:0/4149315205 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf402a070 con 0x564dd92b43d0 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.416+0000 7fbbe6a00640 1 -- 172.21.15.1:0/4149315205 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbbf4005450 con 0x564dd92b43d0 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.416+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbec0e50d0 con 0x564dd92b43d0 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.417+0000 7fbbe6a00640 1 -- 172.21.15.1:0/4149315205 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fbbf4034050 con 0x564dd92b43d0 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.417+0000 7fbc0f1c7740 10 client.25688 fetch_fsmap learned FSMap version 40 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.417+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x564dd9327240 con 0x564dd92b43d0 2024-08-28T20:24:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.417+0000 7fbbe6a00640 1 -- 172.21.15.1:0/4149315205 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec0e50d0 con 0x564dd92b43d0 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbbe6a00640 1 -- 172.21.15.1:0/4149315205 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7fbbf4026790 con 0x564dd92b43d0 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc0f1c7740 10 client.25688 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc0f1c7740 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc0f1c7740 20 client.25688 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd93279f0 0x564dd9329e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc0f1c7740 4 client.25688 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564dd9215960 con 0x564dd93279f0 2024-08-28T20:24:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.418+0000 7fbc05600640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd93279f0 0x564dd9329e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:22.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.420+0000 7fbbe6a00640 10 client.25688 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:22.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.420+0000 7fbc05600640 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd93279f0 0x564dd9329e10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1be8b5022619cc2 server_cookie=8f75a7902cc37e52 in_seq=0 out_seq=0 2024-08-28T20:24:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.478+0000 7fbbe6a00640 1 -- 172.21.15.1:0/4149315205 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564dd9215960 con 0x564dd93279f0 2024-08-28T20:24:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.479+0000 7fbbe6a00640 10 client.25688 handle_command_reply: tid=0 2024-08-28T20:24:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.479+0000 7fbc0f1c7740 1 client.25688 shutdown 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 msgr2=0x564dd92b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 0x564dd92b47e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbbf401a000 tx=0x7fbbf4011d90 comp rx=0 tx=0).stop 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 shutdown_connections 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564dd93279f0 0x564dd9329e10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564dd8ed62f0 0x564dd92b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dd92b43d0 0x564dd92b47e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 --2- 172.21.15.1:0/4149315205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564dd8e931c0 0x564dd92b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 >> 172.21.15.1:0/4149315205 conn(0x564dd8ef3300 msgr2=0x564dd929b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.481+0000 7fbbe6a00640 0 client.25688 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.482+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 shutdown_connections 2024-08-28T20:24:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.483+0000 7fbc0f1c7740 1 -- 172.21.15.1:0/4149315205 wait complete. 2024-08-28T20:24:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.483+0000 7fbc0f1c7740 20 client.25688 trim_cache size 0 max 16384 2024-08-28T20:24:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:24:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:24:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:24:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:24:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.485+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbe80b4bf0 msgr2=0x7fbbe80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.485+0000 7fbc06a00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbe80b4bf0 0x7fbbe80b7100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009be0 tx=0x7fbbf802abc0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.485+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 msgr2=0x7fbc00198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.485+0000 7fbc06a00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 0x7fbc00198010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e9c0 tx=0x7fbbec00ee80 comp rx=0 tx=0).stop 2024-08-28T20:24:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.486+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 shutdown_connections 2024-08-28T20:24:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.486+0000 7fbc06a00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbbe80b4bf0 0x7fbbe80b7100 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.486+0000 7fbc06a00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0010b2b0 0x7fbc00198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.486+0000 7fbc06a00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00076e30 0x7fbc00198010 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.486+0000 7fbc06a00640 1 --2- 172.21.15.1:0/274362042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc00075a30 0x7fbc001979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.486+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 >> 172.21.15.1:0/274362042 conn(0x7fbc000fec00 msgr2=0x7fbc00102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.488+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 shutdown_connections 2024-08-28T20:24:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:22.488+0000 7fbc06a00640 1 -- 172.21.15.1:0/274362042 wait complete. 2024-08-28T20:24:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 355.0 s, 3247.6 tps, lat 30.499 ms stddev 36.698 2024-08-28T20:24:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:23 smithi007 ceph-mon[25357]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 650 op/s 2024-08-28T20:24:23.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:23 smithi001 ceph-mon[20984]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 650 op/s 2024-08-28T20:24:23.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:23 smithi121 ceph-mon[25248]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 650 op/s 2024-08-28T20:24:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:25 smithi007 ceph-mon[25357]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 766 op/s 2024-08-28T20:24:25.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:25 smithi001 ceph-mon[20984]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 766 op/s 2024-08-28T20:24:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:25 smithi121 ceph-mon[25248]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 766 op/s 2024-08-28T20:24:26.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:26 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:24:26.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:26 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:24:26.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:26 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.1 MiB/s wr, 698 op/s 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:24:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:24:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.1 MiB/s wr, 698 op/s 2024-08-28T20:24:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:24:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:24:27.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:24:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.1 MiB/s wr, 698 op/s 2024-08-28T20:24:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T20:24:27.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:24:27.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:24:27.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:24:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 360.0 s, 2508.4 tps, lat 39.817 ms stddev 50.263 2024-08-28T20:24:28.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:28 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi001 to 177.5M 2024-08-28T20:24:28.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:28 smithi007 ceph-mon[25357]: Unable to set osd_memory_target on smithi001 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-08-28T20:24:28.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:28 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi001 to 177.5M 2024-08-28T20:24:28.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:28 smithi001 ceph-mon[20984]: Unable to set osd_memory_target on smithi001 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-08-28T20:24:28.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:28 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi001 to 177.5M 2024-08-28T20:24:28.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:28 smithi121 ceph-mon[25248]: Unable to set osd_memory_target on smithi001 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-08-28T20:24:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:29 smithi007 ceph-mon[25357]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 657 op/s 2024-08-28T20:24:29.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:29 smithi001 ceph-mon[20984]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 657 op/s 2024-08-28T20:24:29.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:29 smithi121 ceph-mon[25248]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 657 op/s 2024-08-28T20:24:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:31 smithi007 ceph-mon[25357]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 744 op/s 2024-08-28T20:24:32.382 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:31 smithi121 ceph-mon[25248]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 744 op/s 2024-08-28T20:24:32.382 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:31 smithi001 ceph-mon[20984]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 744 op/s 2024-08-28T20:24:33.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 365.0 s, 1727.4 tps, lat 57.603 ms stddev 67.879 2024-08-28T20:24:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:33 smithi007 ceph-mon[25357]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 733 op/s 2024-08-28T20:24:33.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:33 smithi001 ceph-mon[20984]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 733 op/s 2024-08-28T20:24:33.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:33 smithi121 ceph-mon[25248]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 733 op/s 2024-08-28T20:24:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.796+0000 7fa61a000640 1 -- 172.21.15.1:0/2181740255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa614106ed0 msgr2=0x7fa61410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.796+0000 7fa61a000640 1 --2- 172.21.15.1:0/2181740255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa614106ed0 0x7fa61410d870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009be0 tx=0x7fa60c02a6c0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 -- 172.21.15.1:0/2181740255 shutdown_connections 2024-08-28T20:24:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 --2- 172.21.15.1:0/2181740255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa614106ed0 0x7fa61410d870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 --2- 172.21.15.1:0/2181740255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106530 0x7fa614106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 --2- 172.21.15.1:0/2181740255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6141054b0 0x7fa614105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 -- 172.21.15.1:0/2181740255 >> 172.21.15.1:0/2181740255 conn(0x7fa614100df0 msgr2=0x7fa6141032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 -- 172.21.15.1:0/2181740255 shutdown_connections 2024-08-28T20:24:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.797+0000 7fa61a000640 1 -- 172.21.15.1:0/2181740255 wait complete. 2024-08-28T20:24:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.799+0000 7fa61a000640 1 Processor -- start 2024-08-28T20:24:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.800+0000 7fa61a000640 1 -- start start 2024-08-28T20:24:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.801+0000 7fa61a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6141054b0 0x7fa614197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.801+0000 7fa61a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa614106530 0x7fa614197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.801+0000 7fa61a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 0x7fa614198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa619600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 0x7fa614198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa619600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 0x7fa614198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34082/0 (socket says 172.21.15.1:34082) 2024-08-28T20:24:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa619600640 1 -- 172.21.15.1:0/28970445 learned_addr learned my addr 172.21.15.1:0/28970445 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa613e00640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa614106530 0x7fa614197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa618c00640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6141054b0 0x7fa614197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa614111150 con 0x7fa614106530 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa614110fd0 con 0x7fa614106ed0 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.802+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141112d0 con 0x7fa6141054b0 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.803+0000 7fa619600640 1 -- 172.21.15.1:0/28970445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6141054b0 msgr2=0x7fa614197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.803+0000 7fa619600640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6141054b0 0x7fa614197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.803+0000 7fa619600640 1 -- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa614106530 msgr2=0x7fa614197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.803+0000 7fa619600640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa614106530 0x7fa614197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.803+0000 7fa619600640 1 -- 172.21.15.1:0/28970445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6141993a0 con 0x7fa614106ed0 2024-08-28T20:24:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.803+0000 7fa619600640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 0x7fa614198b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa60c030800 tx=0x7fa60c030d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.804+0000 7fa611600640 1 -- 172.21.15.1:0/28970445 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c041020 con 0x7fa614106ed0 2024-08-28T20:24:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.804+0000 7fa611600640 1 -- 172.21.15.1:0/28970445 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa60c003e20 con 0x7fa614106ed0 2024-08-28T20:24:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.804+0000 7fa611600640 1 -- 172.21.15.1:0/28970445 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c036040 con 0x7fa614106ed0 2024-08-28T20:24:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.804+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa614199630 con 0x7fa614106ed0 2024-08-28T20:24:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.804+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa61419dc10 con 0x7fa614106ed0 2024-08-28T20:24:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.810+0000 7fa622841740 1 Processor -- start 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.811+0000 7fa611600640 1 -- 172.21.15.1:0/28970445 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fa60c044020 con 0x7fa614106ed0 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.811+0000 7fa622841740 1 -- start start 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa622841740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 0x5619bbed0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa622841740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa622841740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb0a4d0 0x5619bbed1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa622841740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5619bbe43f70 con 0x5619bbb0a4d0 2024-08-28T20:24:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa622841740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619bbe33500 con 0x5619bbb022f0 2024-08-28T20:24:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa622841740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5619bbe374b0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.812+0000 7fa613e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 0x5619bbed0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 0x5619bbed0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45954/0 (socket says 172.21.15.1:45954) 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 -- 172.21.15.1:0/4272422902 learned_addr learned my addr 172.21.15.1:0/4272422902 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 -- 172.21.15.1:0/4272422902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 msgr2=0x5619bbed13b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 -- 172.21.15.1:0/4272422902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb0a4d0 msgr2=0x5619bbed1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb0a4d0 0x5619bbed1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.813+0000 7fa613e00640 1 -- 172.21.15.1:0/4272422902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619bbdedc10 con 0x5619bbb2b1b0 2024-08-28T20:24:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.814+0000 7fa613e00640 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 0x5619bbed0d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6000094b0 tx=0x7fa600011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c4ba6e1646e506 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:35.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:35 smithi007 ceph-mon[25357]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-08-28T20:24:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.814+0000 7fa611600640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5f80b4bf0 0x7fa5f80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.815+0000 7fa611600640 1 -- 172.21.15.1:0/28970445 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa60c1058a0 con 0x7fa614106ed0 2024-08-28T20:24:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.815+0000 7fa618c00640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5f80b4bf0 0x7fa5f80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.815+0000 7fa609c00640 1 -- 172.21.15.1:0/4272422902 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600009e20 con 0x5619bbb2b1b0 2024-08-28T20:24:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.815+0000 7fa609c00640 1 -- 172.21.15.1:0/4272422902 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6000054d0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.815+0000 7fa609c00640 1 -- 172.21.15.1:0/4272422902 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60001a670 con 0x5619bbb2b1b0 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 -- 172.21.15.1:0/4272422902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 msgr2=0x5619bbed0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa618c00640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5f80b4bf0 0x7fa5f80b7100 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa604009990 tx=0x7fa604009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 0x5619bbed0d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6000094b0 tx=0x7fa600011810 comp rx=0 tx=0).stop 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 -- 172.21.15.1:0/4272422902 shutdown_connections 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb0a4d0 0x5619bbed1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 --2- 172.21.15.1:0/4272422902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb2b1b0 0x5619bbed0d40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.816+0000 7fa622841740 1 -- 172.21.15.1:0/4272422902 >> 172.21.15.1:0/4272422902 conn(0x5619bbb1f300 msgr2=0x5619bbecc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.817+0000 7fa622841740 1 -- 172.21.15.1:0/4272422902 shutdown_connections 2024-08-28T20:24:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.817+0000 7fa622841740 1 -- 172.21.15.1:0/4272422902 wait complete. 2024-08-28T20:24:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.817+0000 7fa622841740 1 -- start start 2024-08-28T20:24:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.817+0000 7fa622841740 1 Processor -- start 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbeda4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbedab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb2b1b0 0x5619bbedb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5619bbd6cab0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619bbdda320 con 0x5619bbb022f0 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5619bbed2a20 con 0x5619bbb0a4d0 2024-08-28T20:24:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.818+0000 7fa622841740 10 client.0 _ll_register_callbacks cb 0x5619bbe13e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.819+0000 7fa613e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbedab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.819+0000 7fa613e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbedab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45968/0 (socket says 172.21.15.1:45968) 2024-08-28T20:24:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.819+0000 7fa613e00640 1 -- 172.21.15.1:0/182684380 learned_addr learned my addr 172.21.15.1:0/182684380 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.819+0000 7fa618c00640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbeda4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.819+0000 7fa619600640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb2b1b0 0x5619bbedb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.820+0000 7fa613e00640 1 -- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 msgr2=0x5619bbeda4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.820+0000 7fa613e00640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbeda4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.820+0000 7fa613e00640 1 -- 172.21.15.1:0/182684380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb2b1b0 msgr2=0x5619bbedb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.820+0000 7fa613e00640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb2b1b0 0x5619bbedb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.820+0000 7fa613e00640 1 -- 172.21.15.1:0/182684380 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619bbb96790 con 0x5619bbb0a4d0 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.821+0000 7fa613e00640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbedab70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6000058c0 tx=0x7fa600009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=836ea6639d23559f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.821+0000 7fa5fe000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:24:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.821+0000 7fa5fe000640 1 -- 172.21.15.1:0/182684380 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600028020 con 0x5619bbb0a4d0 2024-08-28T20:24:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.821+0000 7fa5fe000640 1 -- 172.21.15.1:0/182684380 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa600017040 con 0x5619bbb0a4d0 2024-08-28T20:24:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.821+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6000054d0 con 0x5619bbb0a4d0 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa5fe000640 1 -- 172.21.15.1:0/182684380 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa600033050 con 0x5619bbb0a4d0 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 10 client.25663 fetch_fsmap learned FSMap version 40 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5619bbc0f620 con 0x5619bbb0a4d0 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa5fe000640 1 -- 172.21.15.1:0/182684380 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6000054d0 con 0x5619bbb0a4d0 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa5fe000640 1 -- 172.21.15.1:0/182684380 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7fa60001a410 con 0x5619bbb0a4d0 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 10 client.25663 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 10 client.25663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 20 client.25663 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbae9d80 0x5619bbee78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 4 client.25663 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:24:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.822+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619bbe45ec0 con 0x5619bbae9d80 2024-08-28T20:24:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.823+0000 7fa618c00640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbae9d80 0x5619bbee78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.823+0000 7fa618c00640 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbae9d80 0x5619bbee78e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af349aea107d468c server_cookie=6e28bfa2b1d945b6 in_seq=0 out_seq=0 2024-08-28T20:24:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.823+0000 7fa5fe000640 10 client.25663 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.825+0000 7fa5fe000640 1 -- 172.21.15.1:0/182684380 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619bbe45ec0 con 0x5619bbae9d80 2024-08-28T20:24:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.825+0000 7fa5fe000640 10 client.25663 handle_command_reply: tid=0 2024-08-28T20:24:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.825+0000 7fa622841740 1 client.25663 shutdown 2024-08-28T20:24:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.826+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 msgr2=0x5619bbedab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.826+0000 7fa622841740 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbedab70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6000058c0 tx=0x7fa600009b10 comp rx=0 tx=0).stop 2024-08-28T20:24:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.826+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 shutdown_connections 2024-08-28T20:24:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.826+0000 7fa622841740 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbae9d80 0x5619bbee78e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.826+0000 7fa622841740 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb2b1b0 0x5619bbedb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa5fe000640 0 client.25663 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa622841740 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbedab70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa622841740 1 --2- 172.21.15.1:0/182684380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbeda4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 >> 172.21.15.1:0/182684380 conn(0x5619bbb1f300 msgr2=0x5619bbecad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 shutdown_connections 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa622841740 1 -- 172.21.15.1:0/182684380 wait complete. 2024-08-28T20:24:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.827+0000 7fa622841740 20 client.25663 trim_cache size 0 max 16384 2024-08-28T20:24:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.849+0000 7fa622841740 1 Processor -- start 2024-08-28T20:24:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.849+0000 7fa622841740 1 -- start start 2024-08-28T20:24:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.850+0000 7fa622841740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 0x5619bbedabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.850+0000 7fa622841740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.850+0000 7fa622841740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbee25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.850+0000 7fa622841740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141bc2f0 con 0x5619bbae9d80 2024-08-28T20:24:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.850+0000 7fa622841740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141b9bc0 con 0x5619bbb022f0 2024-08-28T20:24:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.850+0000 7fa622841740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141b7a10 con 0x5619bbb0a4d0 2024-08-28T20:24:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.851+0000 7fa618c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 0x5619bbedabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.851+0000 7fa618c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 0x5619bbedabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44620/0 (socket says 172.21.15.1:44620) 2024-08-28T20:24:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.851+0000 7fa618c00640 1 -- 172.21.15.1:0/4267115929 learned_addr learned my addr 172.21.15.1:0/4267115929 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.851+0000 7fa613e00640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.851+0000 7fa619600640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbee25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.851+0000 7fa618c00640 1 -- 172.21.15.1:0/4267115929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 msgr2=0x5619bbee25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa618c00640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbee25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa618c00640 1 -- 172.21.15.1:0/4267115929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 msgr2=0x5619bbed7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa618c00640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa618c00640 1 -- 172.21.15.1:0/4267115929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619bbed8670 con 0x5619bbae9d80 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa613e00640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa619600640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbee25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.852+0000 7fa618c00640 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 0x5619bbedabc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa60400ebb0 tx=0x7fa604015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf899bf568b384a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.853+0000 7fa609200640 1 -- 172.21.15.1:0/4267115929 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60402c030 con 0x5619bbae9d80 2024-08-28T20:24:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.853+0000 7fa609200640 1 -- 172.21.15.1:0/4267115929 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa604015bc0 con 0x5619bbae9d80 2024-08-28T20:24:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.853+0000 7fa609200640 1 -- 172.21.15.1:0/4267115929 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60401b040 con 0x5619bbae9d80 2024-08-28T20:24:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 -- 172.21.15.1:0/4267115929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 msgr2=0x5619bbedabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 0x5619bbedabc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa60400ebb0 tx=0x7fa604015000 comp rx=0 tx=0).stop 2024-08-28T20:24:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 -- 172.21.15.1:0/4267115929 shutdown_connections 2024-08-28T20:24:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbee25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb022f0 0x5619bbed7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 --2- 172.21.15.1:0/4267115929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbae9d80 0x5619bbedabc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.854+0000 7fa622841740 1 -- 172.21.15.1:0/4267115929 >> 172.21.15.1:0/4267115929 conn(0x5619bbb1f300 msgr2=0x5619bbeda4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.855+0000 7fa622841740 1 -- 172.21.15.1:0/4267115929 shutdown_connections 2024-08-28T20:24:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.856+0000 7fa622841740 1 -- 172.21.15.1:0/4267115929 wait complete. 2024-08-28T20:24:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.857+0000 7fa622841740 1 -- start start 2024-08-28T20:24:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.857+0000 7fa622841740 1 Processor -- start 2024-08-28T20:24:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb022f0 0x5619bbee23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbede1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 0x5619bbede850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141b8080 con 0x5619bbb022f0 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141b94f0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141b8750 con 0x5619bbb0a4d0 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.858+0000 7fa622841740 10 client.0 _ll_register_callbacks cb 0x7fa600009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa613e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbede1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 0x5619bbede850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 0x5619bbede850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34130/0 (socket says 172.21.15.1:34130) 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 -- 172.21.15.1:0/2905936747 learned_addr learned my addr 172.21.15.1:0/2905936747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 -- 172.21.15.1:0/2905936747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 msgr2=0x5619bbede1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbede1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 -- 172.21.15.1:0/2905936747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb022f0 msgr2=0x5619bbee23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb022f0 0x5619bbee23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa619600640 1 -- 172.21.15.1:0/2905936747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619bbedf3f0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.859+0000 7fa613e00640 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbede1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:24:35.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.861+0000 7fa619600640 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 0x5619bbede850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa60c103330 tx=0x7fa60c0cba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f788b6e686f542 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:35.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.861+0000 7fa5fe000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:24:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.862+0000 7fa5fe000640 1 -- 172.21.15.1:0/2905936747 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0cc260 con 0x5619bbb2b1b0 2024-08-28T20:24:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.862+0000 7fa5fe000640 1 -- 172.21.15.1:0/2905936747 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa60c031440 con 0x5619bbb2b1b0 2024-08-28T20:24:35.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.863+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa604015bc0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.865+0000 7fa5fe000640 1 -- 172.21.15.1:0/2905936747 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa60c0d0ad0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.865+0000 7fa622841740 10 client.25700 fetch_fsmap learned FSMap version 40 2024-08-28T20:24:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.866+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5619bbf635b0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.866+0000 7fa5fe000640 1 -- 172.21.15.1:0/2905936747 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa604015bc0 con 0x5619bbb2b1b0 2024-08-28T20:24:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.866+0000 7fa5fe000640 1 -- 172.21.15.1:0/2905936747 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7fa60c004b40 con 0x5619bbb2b1b0 2024-08-28T20:24:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.866+0000 7fa622841740 10 client.25700 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:24:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.866+0000 7fa622841740 10 client.25700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.867+0000 7fa622841740 20 client.25700 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.867+0000 7fa622841740 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbabf1c0 0x5619bbf66000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.867+0000 7fa622841740 4 client.25700 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:24:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.867+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619bbe41960 con 0x5619bbabf1c0 2024-08-28T20:24:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.867+0000 7fa618c00640 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbabf1c0 0x5619bbf66000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.869+0000 7fa5fe000640 10 client.25700 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.870+0000 7fa618c00640 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbabf1c0 0x5619bbf66000 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2474ea1e61a21c server_cookie=337cf19b51c12190 in_seq=0 out_seq=0 2024-08-28T20:24:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.888+0000 7fa5fe000640 1 -- 172.21.15.1:0/2905936747 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619bbe41960 con 0x5619bbabf1c0 2024-08-28T20:24:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.888+0000 7fa5fe000640 10 client.25700 handle_command_reply: tid=0 2024-08-28T20:24:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.888+0000 7fa622841740 1 client.25700 shutdown 2024-08-28T20:24:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.889+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 msgr2=0x5619bbede850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.889+0000 7fa622841740 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 0x5619bbede850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa60c103330 tx=0x7fa60c0cba40 comp rx=0 tx=0).stop 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.889+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 shutdown_connections 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.889+0000 7fa622841740 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5619bbabf1c0 0x5619bbf66000 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa5fe000640 0 client.25700 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619bbb2b1b0 0x5619bbede850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5619bbb0a4d0 0x5619bbede1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 1 --2- 172.21.15.1:0/2905936747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5619bbb022f0 0x5619bbee23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 >> 172.21.15.1:0/2905936747 conn(0x5619bbb1f300 msgr2=0x5619bbecb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 shutdown_connections 2024-08-28T20:24:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 1 -- 172.21.15.1:0/2905936747 wait complete. 2024-08-28T20:24:35.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.890+0000 7fa622841740 20 client.25700 trim_cache size 0 max 16384 2024-08-28T20:24:35.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:24:35.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:24:35.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:24:35.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:24:35.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.892+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5f80b4bf0 msgr2=0x7fa5f80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.892+0000 7fa61a000640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5f80b4bf0 0x7fa5f80b7100 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa604009990 tx=0x7fa604009110 comp rx=0 tx=0).stop 2024-08-28T20:24:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.892+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 msgr2=0x7fa614198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.892+0000 7fa61a000640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 0x7fa614198b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa60c030800 tx=0x7fa60c030d10 comp rx=0 tx=0).stop 2024-08-28T20:24:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.893+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 shutdown_connections 2024-08-28T20:24:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.893+0000 7fa61a000640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa5f80b4bf0 0x7fa5f80b7100 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.893+0000 7fa61a000640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa614106530 0x7fa614197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.893+0000 7fa61a000640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa614106ed0 0x7fa614198b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.893+0000 7fa61a000640 1 --2- 172.21.15.1:0/28970445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6141054b0 0x7fa614197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.893+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 >> 172.21.15.1:0/28970445 conn(0x7fa614100df0 msgr2=0x7fa6140795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.894+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 shutdown_connections 2024-08-28T20:24:35.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:35.894+0000 7fa61a000640 1 -- 172.21.15.1:0/28970445 wait complete. 2024-08-28T20:24:35.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:35 smithi001 ceph-mon[20984]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-08-28T20:24:35.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:35 smithi121 ceph-mon[25248]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-08-28T20:24:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:37 smithi001 ceph-mon[20984]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 11 MiB/s wr, 720 op/s 2024-08-28T20:24:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:37 smithi121 ceph-mon[25248]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 11 MiB/s wr, 720 op/s 2024-08-28T20:24:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:37 smithi007 ceph-mon[25357]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 11 MiB/s wr, 720 op/s 2024-08-28T20:24:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 370.0 s, 1859.8 tps, lat 54.364 ms stddev 64.598 2024-08-28T20:24:39.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:39 smithi001 ceph-mon[20984]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 767 op/s 2024-08-28T20:24:39.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:39 smithi121 ceph-mon[25248]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 767 op/s 2024-08-28T20:24:40.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:39 smithi007 ceph-mon[25357]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 767 op/s 2024-08-28T20:24:41.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:41 smithi001 ceph-mon[20984]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 812 op/s 2024-08-28T20:24:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:41 smithi121 ceph-mon[25248]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 812 op/s 2024-08-28T20:24:42.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:41 smithi007 ceph-mon[25357]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 812 op/s 2024-08-28T20:24:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 375.0 s, 1901.0 tps, lat 52.058 ms stddev 62.332 2024-08-28T20:24:43.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:43 smithi001 ceph-mon[20984]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 17 MiB/s wr, 738 op/s 2024-08-28T20:24:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:43 smithi121 ceph-mon[25248]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 17 MiB/s wr, 738 op/s 2024-08-28T20:24:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:43 smithi007 ceph-mon[25357]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 17 MiB/s wr, 738 op/s 2024-08-28T20:24:45.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:45 smithi001 ceph-mon[20984]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 840 op/s 2024-08-28T20:24:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:45 smithi121 ceph-mon[25248]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 840 op/s 2024-08-28T20:24:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:45 smithi007 ceph-mon[25357]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 840 op/s 2024-08-28T20:24:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:47 smithi001 ceph-mon[20984]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 18 MiB/s wr, 700 op/s 2024-08-28T20:24:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:47 smithi121 ceph-mon[25248]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 18 MiB/s wr, 700 op/s 2024-08-28T20:24:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:47 smithi007 ceph-mon[25357]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 18 MiB/s wr, 700 op/s 2024-08-28T20:24:48.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 380.0 s, 1817.4 tps, lat 55.637 ms stddev 70.126 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 -- 172.21.15.1:0/2950710179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35406b620 msgr2=0x7fe354103e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 --2- 172.21.15.1:0/2950710179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35406b620 0x7fe354103e90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe348009900 tx=0x7fe34802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 -- 172.21.15.1:0/2950710179 shutdown_connections 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 --2- 172.21.15.1:0/2950710179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 0x7fe354107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 --2- 172.21.15.1:0/2950710179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3541043d0 0x7fe354106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 --2- 172.21.15.1:0/2950710179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe35406b620 0x7fe354103e90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 -- 172.21.15.1:0/2950710179 >> 172.21.15.1:0/2950710179 conn(0x7fe3540fdca0 msgr2=0x7fe354100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 -- 172.21.15.1:0/2950710179 shutdown_connections 2024-08-28T20:24:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.197+0000 7fe35c200640 1 -- 172.21.15.1:0/2950710179 wait complete. 2024-08-28T20:24:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.199+0000 7fe35c200640 1 Processor -- start 2024-08-28T20:24:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.199+0000 7fe35c200640 1 -- start start 2024-08-28T20:24:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe35c200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35406b620 0x7fe3541a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe35c200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541043d0 0x7fe3541a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe35c200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 0x7fe3541a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe35c200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe354115710 con 0x7fe354106f90 2024-08-28T20:24:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe35c200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe354115590 con 0x7fe3541043d0 2024-08-28T20:24:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe35c200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe354115890 con 0x7fe35406b620 2024-08-28T20:24:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe359800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35406b620 0x7fe3541a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe359800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35406b620 0x7fe3541a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:46210/0 (socket says 172.21.15.1:46210) 2024-08-28T20:24:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe359800640 1 -- 172.21.15.1:0/2664260999 learned_addr learned my addr 172.21.15.1:0/2664260999 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.200+0000 7fe358e00640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541043d0 0x7fe3541a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe35a200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 0x7fe3541a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe358e00640 1 -- 172.21.15.1:0/2664260999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35406b620 msgr2=0x7fe3541a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe358e00640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35406b620 0x7fe3541a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe358e00640 1 -- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 msgr2=0x7fe3541a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe358e00640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 0x7fe3541a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe358e00640 1 -- 172.21.15.1:0/2664260999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3541a1d20 con 0x7fe3541043d0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe35a200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 0x7fe3541a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe358e00640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541043d0 0x7fe3541a09e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe34000d6a0 tx=0x7fe34000db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.201+0000 7fe352000640 1 -- 172.21.15.1:0/2664260999 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340017070 con 0x7fe3541043d0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.202+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3541a2010 con 0x7fe3541043d0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.202+0000 7fe352000640 1 -- 172.21.15.1:0/2664260999 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe340009820 con 0x7fe3541043d0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.202+0000 7fe352000640 1 -- 172.21.15.1:0/2664260999 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340004c40 con 0x7fe3541043d0 2024-08-28T20:24:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.202+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3541a8790 con 0x7fe3541043d0 2024-08-28T20:24:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.207+0000 7fe3631ee740 1 Processor -- start 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.208+0000 7fe3631ee740 1 -- start start 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.209+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.209+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.209+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.209+0000 7fe3631ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b6581ef70 con 0x561b654dd2f0 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.209+0000 7fe3631ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561b6580e500 con 0x561b654e54d0 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.210+0000 7fe35a200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.210+0000 7fe352000640 1 -- 172.21.15.1:0/2664260999 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fe340010460 con 0x7fe3541043d0 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.210+0000 7fe35a200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:46222/0 (socket says 172.21.15.1:46222) 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.210+0000 7fe35a200640 1 -- 172.21.15.1:0/2617306698 learned_addr learned my addr 172.21.15.1:0/2617306698 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.210+0000 7fe3631ee740 1 -- 172.21.15.1:0/2617306698 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b658124b0 con 0x561b655061b0 2024-08-28T20:24:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.211+0000 7fe358e00640 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.211+0000 7fe35a200640 1 -- 172.21.15.1:0/2617306698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 msgr2=0x561b658acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.211+0000 7fe35a200640 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.211+0000 7fe35a200640 1 -- 172.21.15.1:0/2617306698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 msgr2=0x561b658ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.211+0000 7fe359800640 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.211+0000 7fe35a200640 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.212+0000 7fe35a200640 1 -- 172.21.15.1:0/2617306698 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b657c8c10 con 0x561b655061b0 2024-08-28T20:24:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.212+0000 7fe359800640 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.212+0000 7fe35a200640 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658abdc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe34c008e60 tx=0x7fe34c00d710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da30066aa52e0c3a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.213+0000 7fe346a00640 1 -- 172.21.15.1:0/2617306698 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00f830 con 0x561b655061b0 2024-08-28T20:24:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.213+0000 7fe346a00640 1 -- 172.21.15.1:0/2617306698 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe34c018480 con 0x561b655061b0 2024-08-28T20:24:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.213+0000 7fe346a00640 1 -- 172.21.15.1:0/2617306698 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00e5d0 con 0x561b655061b0 2024-08-28T20:24:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.213+0000 7fe352000640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe33c0b4c30 0x7fe33c0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.213+0000 7fe352000640 1 -- 172.21.15.1:0/2664260999 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe3400e49f0 con 0x7fe3541043d0 2024-08-28T20:24:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 -- 172.21.15.1:0/2617306698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 msgr2=0x561b658abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658abdc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe34c008e60 tx=0x7fe34c00d710 comp rx=0 tx=0).stop 2024-08-28T20:24:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 -- 172.21.15.1:0/2617306698 shutdown_connections 2024-08-28T20:24:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2617306698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658abdc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.214+0000 7fe3631ee740 1 -- 172.21.15.1:0/2617306698 >> 172.21.15.1:0/2617306698 conn(0x561b654fa300 msgr2=0x561b658a7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.215+0000 7fe359800640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe33c0b4c30 0x7fe33c0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.215+0000 7fe3631ee740 1 -- 172.21.15.1:0/2617306698 shutdown_connections 2024-08-28T20:24:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.216+0000 7fe3631ee740 1 -- 172.21.15.1:0/2617306698 wait complete. 2024-08-28T20:24:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.217+0000 7fe3631ee740 1 -- start start 2024-08-28T20:24:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.217+0000 7fe359800640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe33c0b4c30 0x7fe33c0b7140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c00 tx=0x7fe3480314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.218+0000 7fe3631ee740 1 Processor -- start 2024-08-28T20:24:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b65747ab0 con 0x561b654dd2f0 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561b657b5320 con 0x561b654e54d0 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b658adaa0 con 0x561b655061b0 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe3631ee740 10 client.0 _ll_register_callbacks cb 0x561b657bb6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe35a200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe35a200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:46238/0 (socket says 172.21.15.1:46238) 2024-08-28T20:24:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.219+0000 7fe35a200640 1 -- 172.21.15.1:0/2822433228 learned_addr learned my addr 172.21.15.1:0/2822433228 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe359800640 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe35a200640 1 -- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 msgr2=0x561b658c6b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:24:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe35a200640 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658c6b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe35a200640 1 -- 172.21.15.1:0/2822433228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 msgr2=0x561b658c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe35a200640 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe35a200640 1 -- 172.21.15.1:0/2822433228 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b65571790 con 0x561b655061b0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe35a200640 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658c7690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe34c005c40 tx=0x7fe34c008ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71669814477c2ffe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe33b400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe33b400640 1 -- 172.21.15.1:0/2822433228 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c028060 con 0x561b655061b0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe34c018480 con 0x561b655061b0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.220+0000 7fe33b400640 1 -- 172.21.15.1:0/2822433228 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe34c004d90 con 0x561b655061b0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.221+0000 7fe33b400640 1 -- 172.21.15.1:0/2822433228 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe34c00f630 con 0x561b655061b0 2024-08-28T20:24:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.221+0000 7fe3631ee740 10 client.25678 fetch_fsmap learned FSMap version 40 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.221+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561b655ea620 con 0x561b655061b0 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.221+0000 7fe33b400640 1 -- 172.21.15.1:0/2822433228 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe34c018480 con 0x561b655061b0 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe33b400640 1 -- 172.21.15.1:0/2822433228 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7fe34c005440 con 0x561b655061b0 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe3631ee740 10 client.25678 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe3631ee740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe3631ee740 20 client.25678 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b654c4d80 0x561b658d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe3631ee740 4 client.25678 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:24:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b65820ec0 con 0x561b654c4d80 2024-08-28T20:24:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.222+0000 7fe359800640 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b654c4d80 0x561b658d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.223+0000 7fe33b400640 10 client.25678 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.224+0000 7fe359800640 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b654c4d80 0x561b658d3860 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e3ab2c1269986 server_cookie=65050b03c819a960 in_seq=0 out_seq=0 2024-08-28T20:24:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.225+0000 7fe33b400640 1 -- 172.21.15.1:0/2822433228 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b65820ec0 con 0x561b654c4d80 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.225+0000 7fe33b400640 10 client.25678 handle_command_reply: tid=0 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.225+0000 7fe3631ee740 1 client.25678 shutdown 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.226+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 msgr2=0x561b658c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.226+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658c7690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe34c005c40 tx=0x7fe34c008ba0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.226+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 shutdown_connections 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b654c4d80 0x561b658d3860 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b655061b0 0x561b658c7690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654e54d0 0x561b658c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 --2- 172.21.15.1:0/2822433228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b654dd2f0 0x561b658c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 >> 172.21.15.1:0/2822433228 conn(0x561b654fa300 msgr2=0x561b658a5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe33b400640 0 client.25678 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 shutdown_connections 2024-08-28T20:24:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 1 -- 172.21.15.1:0/2822433228 wait complete. 2024-08-28T20:24:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.227+0000 7fe3631ee740 20 client.25678 trim_cache size 0 max 16384 2024-08-28T20:24:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 Processor -- start 2024-08-28T20:24:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 -- start start 2024-08-28T20:24:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658acc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3541ab480 con 0x561b655061b0 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe3541a8d50 con 0x561b654dd2f0 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.266+0000 7fe3631ee740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540735d0 con 0x561b654e54d0 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe358e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe358e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:46246/0 (socket says 172.21.15.1:46246) 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe358e00640 1 -- 172.21.15.1:0/295483746 learned_addr learned my addr 172.21.15.1:0/295483746 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe359800640 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe358e00640 1 -- 172.21.15.1:0/295483746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 msgr2=0x561b658acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe358e00640 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.267+0000 7fe358e00640 1 -- 172.21.15.1:0/295483746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 msgr2=0x561b658b0410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:24:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.268+0000 7fe35a200640 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.268+0000 7fe358e00640 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.268+0000 7fe358e00640 1 -- 172.21.15.1:0/295483746 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b658a19f0 con 0x561b654e54d0 2024-08-28T20:24:49.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.269+0000 7fe358e00640 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658afed0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3400a7430 tx=0x7fe3400ab1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39a112921510d29d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.274+0000 7fe346000640 1 -- 172.21.15.1:0/295483746 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340020070 con 0x561b654e54d0 2024-08-28T20:24:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.274+0000 7fe346000640 1 -- 172.21.15.1:0/295483746 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3400aaec0 con 0x561b654e54d0 2024-08-28T20:24:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.274+0000 7fe346000640 1 -- 172.21.15.1:0/295483746 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340009cd0 con 0x561b654e54d0 2024-08-28T20:24:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.276+0000 7fe3631ee740 1 -- 172.21.15.1:0/295483746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 msgr2=0x561b658afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.276+0000 7fe3631ee740 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658afed0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3400a7430 tx=0x7fe3400ab1d0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 -- 172.21.15.1:0/295483746 shutdown_connections 2024-08-28T20:24:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658afed0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 --2- 172.21.15.1:0/295483746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 -- 172.21.15.1:0/295483746 >> 172.21.15.1:0/295483746 conn(0x561b654fa300 msgr2=0x561b658a7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 -- 172.21.15.1:0/295483746 shutdown_connections 2024-08-28T20:24:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.277+0000 7fe3631ee740 1 -- 172.21.15.1:0/295483746 wait complete. 2024-08-28T20:24:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.282+0000 7fe3631ee740 1 -- start start 2024-08-28T20:24:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.282+0000 7fe3631ee740 1 Processor -- start 2024-08-28T20:24:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe354073c40 con 0x561b655061b0 2024-08-28T20:24:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540750b0 con 0x561b654dd2f0 2024-08-28T20:24:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe354074310 con 0x561b654e54d0 2024-08-28T20:24:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe3631ee740 10 client.0 _ll_register_callbacks cb 0x7fe34c00df60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.283+0000 7fe358e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:35390/0 (socket says 172.21.15.1:35390) 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 -- 172.21.15.1:0/738992165 learned_addr learned my addr 172.21.15.1:0/738992165 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe35a200640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 -- 172.21.15.1:0/738992165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 msgr2=0x561b658cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 -- 172.21.15.1:0/738992165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 msgr2=0x561b658cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:24:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.284+0000 7fe359800640 1 -- 172.21.15.1:0/738992165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b658cbb50 con 0x561b654dd2f0 2024-08-28T20:24:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.285+0000 7fe358e00640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:24:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.285+0000 7fe35a200640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:24:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.285+0000 7fe359800640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658cce20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe348006010 tx=0x7fe34803f070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9b90a6ddfd72016 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:24:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.285+0000 7fe33b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:24:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.286+0000 7fe33b400640 1 -- 172.21.15.1:0/738992165 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3480319b0 con 0x561b654dd2f0 2024-08-28T20:24:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.286+0000 7fe33b400640 1 -- 172.21.15.1:0/738992165 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe348031b50 con 0x561b654dd2f0 2024-08-28T20:24:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.286+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3400aaec0 con 0x561b654dd2f0 2024-08-28T20:24:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.289+0000 7fe33b400640 1 -- 172.21.15.1:0/738992165 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe348031d50 con 0x561b654dd2f0 2024-08-28T20:24:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.289+0000 7fe3631ee740 10 client.25715 fetch_fsmap learned FSMap version 40 2024-08-28T20:24:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.289+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561b6593e640 con 0x561b654dd2f0 2024-08-28T20:24:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.290+0000 7fe33b400640 1 -- 172.21.15.1:0/738992165 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3400aaec0 con 0x561b654dd2f0 2024-08-28T20:24:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe33b400640 1 -- 172.21.15.1:0/738992165 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7fe348063420 con 0x561b654dd2f0 2024-08-28T20:24:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe3631ee740 10 client.25715 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:24:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe3631ee740 10 client.25715 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:24:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe3631ee740 20 client.25715 populate_metadata read hostname 'smithi001' 2024-08-28T20:24:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe3631ee740 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b6549a1c0 0x561b65941020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:24:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe3631ee740 4 client.25715 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:24:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b6581c960 con 0x561b6549a1c0 2024-08-28T20:24:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.291+0000 7fe358e00640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b6549a1c0 0x561b65941020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:24:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.293+0000 7fe33b400640 10 client.25715 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.295+0000 7fe358e00640 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b6549a1c0 0x561b65941020 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e15effe2c275e0d server_cookie=b24d1df580a20d8c in_seq=0 out_seq=0 2024-08-28T20:24:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe33b400640 1 -- 172.21.15.1:0/738992165 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b6581c960 con 0x561b6549a1c0 2024-08-28T20:24:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe33b400640 10 client.25715 handle_command_reply: tid=0 2024-08-28T20:24:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe3631ee740 1 client.25715 shutdown 2024-08-28T20:24:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 msgr2=0x561b658cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe3631ee740 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658cce20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe348006010 tx=0x7fe34803f070 comp rx=0 tx=0).stop 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 shutdown_connections 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe3631ee740 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x561b6549a1c0 0x561b65941020 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.363+0000 7fe3631ee740 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b655061b0 0x561b658cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe3631ee740 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b654e54d0 0x561b658cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe3631ee740 1 --2- 172.21.15.1:0/738992165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b654dd2f0 0x561b658cce20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe33b400640 0 client.25715 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 >> 172.21.15.1:0/738992165 conn(0x561b654fa300 msgr2=0x561b658c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 shutdown_connections 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe3631ee740 1 -- 172.21.15.1:0/738992165 wait complete. 2024-08-28T20:24:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.364+0000 7fe3631ee740 20 client.25715 trim_cache size 0 max 16384 2024-08-28T20:24:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:24:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:24:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:24:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:24:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.365+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe33c0b4c30 msgr2=0x7fe33c0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.365+0000 7fe35c200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe33c0b4c30 0x7fe33c0b7140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c00 tx=0x7fe3480314a0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.365+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541043d0 msgr2=0x7fe3541a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.365+0000 7fe35c200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541043d0 0x7fe3541a09e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe34000d6a0 tx=0x7fe34000db60 comp rx=0 tx=0).stop 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 shutdown_connections 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe33c0b4c30 0x7fe33c0b7140 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe354106f90 0x7fe3541a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3541043d0 0x7fe3541a09e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 --2- 172.21.15.1:0/2664260999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35406b620 0x7fe3541a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:24:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 >> 172.21.15.1:0/2664260999 conn(0x7fe3540fdca0 msgr2=0x7fe354105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:24:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.366+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 shutdown_connections 2024-08-28T20:24:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:24:49.367+0000 7fe35c200640 1 -- 172.21.15.1:0/2664260999 wait complete. 2024-08-28T20:24:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:49 smithi001 ceph-mon[20984]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 694 op/s 2024-08-28T20:24:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:49 smithi121 ceph-mon[25248]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 694 op/s 2024-08-28T20:24:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:49 smithi007 ceph-mon[25357]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 694 op/s 2024-08-28T20:24:51.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:51 smithi001 ceph-mon[20984]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 16 MiB/s wr, 670 op/s 2024-08-28T20:24:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:51 smithi121 ceph-mon[25248]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 16 MiB/s wr, 670 op/s 2024-08-28T20:24:52.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:51 smithi007 ceph-mon[25357]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 16 MiB/s wr, 670 op/s 2024-08-28T20:24:53.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 385.0 s, 2051.2 tps, lat 48.750 ms stddev 60.016 2024-08-28T20:24:53.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:53 smithi001 ceph-mon[20984]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 15 MiB/s wr, 625 op/s 2024-08-28T20:24:53.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:53 smithi121 ceph-mon[25248]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 15 MiB/s wr, 625 op/s 2024-08-28T20:24:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:53 smithi007 ceph-mon[25357]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 15 MiB/s wr, 625 op/s 2024-08-28T20:24:55.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:55 smithi001 ceph-mon[20984]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 705 op/s 2024-08-28T20:24:55.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:55 smithi121 ceph-mon[25248]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 705 op/s 2024-08-28T20:24:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:55 smithi007 ceph-mon[25357]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 705 op/s 2024-08-28T20:24:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:57 smithi001 ceph-mon[20984]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 659 op/s 2024-08-28T20:24:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:57 smithi121 ceph-mon[25248]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 659 op/s 2024-08-28T20:24:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:57 smithi007 ceph-mon[25357]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 659 op/s 2024-08-28T20:24:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 390.0 s, 2024.2 tps, lat 48.716 ms stddev 67.883 2024-08-28T20:24:59.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:24:59 smithi001 ceph-mon[20984]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 668 op/s 2024-08-28T20:24:59.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:24:59 smithi121 ceph-mon[25248]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 668 op/s 2024-08-28T20:25:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:24:59 smithi007 ceph-mon[25357]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 668 op/s 2024-08-28T20:25:01.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:01 smithi001 ceph-mon[20984]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 676 op/s 2024-08-28T20:25:01.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:01 smithi121 ceph-mon[25248]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 676 op/s 2024-08-28T20:25:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:01 smithi007 ceph-mon[25357]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 676 op/s 2024-08-28T20:25:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 -- 172.21.15.1:0/1561477549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3900103b90 msgr2=0x7f390010a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 --2- 172.21.15.1:0/1561477549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3900103b90 0x7f390010a530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38f800b9f0 tx=0x7f38f802c0a0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 -- 172.21.15.1:0/1561477549 shutdown_connections 2024-08-28T20:25:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 --2- 172.21.15.1:0/1561477549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39001031f0 0x7f3900103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 --2- 172.21.15.1:0/1561477549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3900103b90 0x7f390010a530 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 --2- 172.21.15.1:0/1561477549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 0x7f39001025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 -- 172.21.15.1:0/1561477549 >> 172.21.15.1:0/1561477549 conn(0x7f39000fdab0 msgr2=0x7f39000fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 -- 172.21.15.1:0/1561477549 shutdown_connections 2024-08-28T20:25:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.663+0000 7f3904c00640 1 -- 172.21.15.1:0/1561477549 wait complete. 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.664+0000 7f3904c00640 1 Processor -- start 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 -- start start 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 0x7f390019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 0x7f390019c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3900103b90 0x7f390019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f390010ccf0 con 0x7f3900103b90 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f390010cb70 con 0x7f39001031f0 2024-08-28T20:25:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.665+0000 7f3904c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f390010ce70 con 0x7f3900102170 2024-08-28T20:25:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 0x7f390019c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 0x7f390019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 0x7f390019c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41704/0 (socket says 172.21.15.1:41704) 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 -- 172.21.15.1:0/2053858872 learned_addr learned my addr 172.21.15.1:0/2053858872 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38ffe00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3900103b90 0x7f390019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 -- 172.21.15.1:0/2053858872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 msgr2=0x7f390019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 0x7f390019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 -- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3900103b90 msgr2=0x7f390019cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3900103b90 0x7f390019cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.666+0000 7f38f6a00640 1 -- 172.21.15.1:0/2053858872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390019d740 con 0x7f39001031f0 2024-08-28T20:25:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.667+0000 7f38ffe00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3900103b90 0x7f390019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:25:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.668+0000 7f38ff400640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 0x7f390019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.668+0000 7f38f6a00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 0x7f390019c370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38e800d950 tx=0x7f38e800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.669+0000 7f38fcc00640 1 -- 172.21.15.1:0/2053858872 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8017070 con 0x7f39001031f0 2024-08-28T20:25:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.669+0000 7f38fcc00640 1 -- 172.21.15.1:0/2053858872 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e8009c30 con 0x7f39001031f0 2024-08-28T20:25:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.669+0000 7f38fcc00640 1 -- 172.21.15.1:0/2053858872 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e800f620 con 0x7f39001031f0 2024-08-28T20:25:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.669+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390019d9d0 con 0x7f39001031f0 2024-08-28T20:25:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.669+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39001a4120 con 0x7f39001031f0 2024-08-28T20:25:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.676+0000 7f38fcc00640 1 -- 172.21.15.1:0/2053858872 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f38e8005070 con 0x7f39001031f0 2024-08-28T20:25:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.676+0000 7f390d1ba740 1 Processor -- start 2024-08-28T20:25:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f390d1ba740 1 -- start start 2024-08-28T20:25:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc998f2f0 0x55fdc9d5e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d5f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f38ffe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f38ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc998f2f0 0x55fdc9d5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.677+0000 7f38ffe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43792/0 (socket says 172.21.15.1:43792) 2024-08-28T20:25:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc998f2f0 0x55fdc9d5e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41708/0 (socket says 172.21.15.1:41708) 2024-08-28T20:25:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ffe00640 1 -- 172.21.15.1:0/3726034694 learned_addr learned my addr 172.21.15.1:0/3726034694 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fdc9cd0f70 con 0x55fdc99974d0 2024-08-28T20:25:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fdc9cc0500 con 0x55fdc998f2f0 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fdc9cc44b0 con 0x55fdc99b81b0 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38f6a00640 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d5f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ffe00640 1 -- 172.21.15.1:0/3726034694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc998f2f0 msgr2=0x55fdc9d5e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ffe00640 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc998f2f0 0x55fdc9d5e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ffe00640 1 -- 172.21.15.1:0/3726034694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 msgr2=0x55fdc9d5f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ffe00640 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d5f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38ffe00640 1 -- 172.21.15.1:0/3726034694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc9c7ac10 con 0x55fdc99b81b0 2024-08-28T20:25:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.678+0000 7f38fcc00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f38e40b4bf0 0x7f38e40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.679+0000 7f38ffe00640 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5dfa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38f8005d00 tx=0x7f38f800b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16c44feb89a4f594 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.679+0000 7f38fcc00640 1 -- 172.21.15.1:0/2053858872 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f38e80e4680 con 0x7f39001031f0 2024-08-28T20:25:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.679+0000 7f38ff400640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f38e40b4bf0 0x7f38e40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.679+0000 7f38efe00640 1 -- 172.21.15.1:0/3726034694 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8041020 con 0x55fdc99b81b0 2024-08-28T20:25:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.679+0000 7f38efe00640 1 -- 172.21.15.1:0/3726034694 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f802cdf0 con 0x55fdc99b81b0 2024-08-28T20:25:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.679+0000 7f38efe00640 1 -- 172.21.15.1:0/3726034694 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8039040 con 0x55fdc99b81b0 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 msgr2=0x55fdc9d5dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5dfa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f38f8005d00 tx=0x7f38f800b730 comp rx=0 tx=0).stop 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f38ff400640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f38e40b4bf0 0x7f38e40b7100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f38f0005fd0 tx=0x7f38f00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 shutdown_connections 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d5f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc998f2f0 0x55fdc9d5e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 --2- 172.21.15.1:0/3726034694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5dfa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.681+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 >> 172.21.15.1:0/3726034694 conn(0x55fdc99ac300 msgr2=0x55fdc9d59a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.682+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 shutdown_connections 2024-08-28T20:25:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.682+0000 7f390d1ba740 1 -- 172.21.15.1:0/3726034694 wait complete. 2024-08-28T20:25:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.683+0000 7f390d1ba740 1 -- start start 2024-08-28T20:25:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.683+0000 7f390d1ba740 1 Processor -- start 2024-08-28T20:25:02.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d6fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99b81b0 0x55fdc9d71010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fdc9bf9ab0 con 0x55fdc99974d0 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fdc9c67320 con 0x55fdc99b81b0 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fdc9d5fc20 con 0x55fdc998f2f0 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f390d1ba740 10 client.0 _ll_register_callbacks cb 0x55fdc9c6d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f38ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d6fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f38ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d6fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43794/0 (socket says 172.21.15.1:43794) 2024-08-28T20:25:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.684+0000 7f38ff400640 1 -- 172.21.15.1:0/2354941142 learned_addr learned my addr 172.21.15.1:0/2354941142 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.685+0000 7f38ffe00640 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99b81b0 0x55fdc9d71010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.685+0000 7f38ff400640 1 -- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99b81b0 msgr2=0x55fdc9d71010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.685+0000 7f38ff400640 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99b81b0 0x55fdc9d71010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.685+0000 7f38ff400640 1 -- 172.21.15.1:0/2354941142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 msgr2=0x55fdc9d704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.685+0000 7f38ff400640 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.685+0000 7f38ff400640 1 -- 172.21.15.1:0/2354941142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdc9a23790 con 0x55fdc998f2f0 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.686+0000 7f38ff400640 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d6fde0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009f70 tx=0x7f38f0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cfe5bacaa7076d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.686+0000 7f38ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.686+0000 7f38ecc00640 1 -- 172.21.15.1:0/2354941142 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f002b060 con 0x55fdc998f2f0 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.686+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f802cdf0 con 0x55fdc998f2f0 2024-08-28T20:25:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.686+0000 7f38ecc00640 1 -- 172.21.15.1:0/2354941142 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f38f0004790 con 0x55fdc998f2f0 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.687+0000 7f38ecc00640 1 -- 172.21.15.1:0/2354941142 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f38f001b420 con 0x55fdc998f2f0 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.687+0000 7f390d1ba740 10 client.25696 fetch_fsmap learned FSMap version 40 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.687+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55fdc9a9c620 con 0x55fdc998f2f0 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.687+0000 7f38ecc00640 1 -- 172.21.15.1:0/2354941142 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f802cdf0 con 0x55fdc998f2f0 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.687+0000 7f38ecc00640 1 -- 172.21.15.1:0/2354941142 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7f38f000b040 con 0x55fdc998f2f0 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f390d1ba740 10 client.25696 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f390d1ba740 10 client.25696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f390d1ba740 20 client.25696 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f390d1ba740 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc9976d80 0x55fdc9d7d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f390d1ba740 4 client.25696 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdc9cd2ec0 con 0x55fdc9976d80 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.688+0000 7f38f6a00640 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc9976d80 0x55fdc9d7d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.689+0000 7f38ecc00640 10 client.25696 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.689+0000 7f38f6a00640 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc9976d80 0x55fdc9d7d6e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb372a1a98bdf33 server_cookie=77963bfcf221910b in_seq=0 out_seq=0 2024-08-28T20:25:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f38ecc00640 1 -- 172.21.15.1:0/2354941142 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fdc9cd2ec0 con 0x55fdc9976d80 2024-08-28T20:25:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f38ecc00640 10 client.25696 handle_command_reply: tid=0 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 client.25696 shutdown 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 msgr2=0x55fdc9d6fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d6fde0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009f70 tx=0x7f38f0004ab0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 shutdown_connections 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc9976d80 0x55fdc9d7d6e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99974d0 0x55fdc9d704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99b81b0 0x55fdc9d71010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f38ecc00640 0 client.25696 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 --2- 172.21.15.1:0/2354941142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d6fde0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 >> 172.21.15.1:0/2354941142 conn(0x55fdc99ac300 msgr2=0x55fdc9d57f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 shutdown_connections 2024-08-28T20:25:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 1 -- 172.21.15.1:0/2354941142 wait complete. 2024-08-28T20:25:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.690+0000 7f390d1ba740 20 client.25696 trim_cache size 0 max 16384 2024-08-28T20:25:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 Processor -- start 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 -- start start 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc998f2f0 0x55fdc9d66230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d6fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f39001ab200 con 0x55fdc998f2f0 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39001a8ad0 con 0x55fdc99974d0 2024-08-28T20:25:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.713+0000 7f390d1ba740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f39001a6920 con 0x55fdc99b81b0 2024-08-28T20:25:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.714+0000 7f38f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d6fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.714+0000 7f38f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d6fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41720/0 (socket says 172.21.15.1:41720) 2024-08-28T20:25:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.714+0000 7f38f6a00640 1 -- 172.21.15.1:0/1707670998 learned_addr learned my addr 172.21.15.1:0/1707670998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.714+0000 7f38ffe00640 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38ffe00640 1 -- 172.21.15.1:0/1707670998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 msgr2=0x55fdc9d6fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38ffe00640 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d6fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38ffe00640 1 -- 172.21.15.1:0/1707670998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc998f2f0 msgr2=0x55fdc9d66230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38ffe00640 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc998f2f0 0x55fdc9d66230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38ffe00640 1 -- 172.21.15.1:0/1707670998 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdc9d782b0 con 0x55fdc99b81b0 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38f6a00640 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d6fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.715+0000 7f38ffe00640 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5ae80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e090 tx=0x7f38f802c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5dee94f03d69bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.716+0000 7f38ef400640 1 -- 172.21.15.1:0/1707670998 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8039050 con 0x55fdc99b81b0 2024-08-28T20:25:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.716+0000 7f38ef400640 1 -- 172.21.15.1:0/1707670998 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f804a070 con 0x55fdc99b81b0 2024-08-28T20:25:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.716+0000 7f38ef400640 1 -- 172.21.15.1:0/1707670998 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8039050 con 0x55fdc99b81b0 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.717+0000 7f390d1ba740 1 -- 172.21.15.1:0/1707670998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 msgr2=0x55fdc9d5ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.717+0000 7f390d1ba740 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5ae80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e090 tx=0x7f38f802c5a0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 -- 172.21.15.1:0/1707670998 shutdown_connections 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc99b81b0 0x55fdc9d5ae80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d6fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 --2- 172.21.15.1:0/1707670998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc998f2f0 0x55fdc9d66230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 -- 172.21.15.1:0/1707670998 >> 172.21.15.1:0/1707670998 conn(0x55fdc99ac300 msgr2=0x55fdc9d65b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 -- 172.21.15.1:0/1707670998 shutdown_connections 2024-08-28T20:25:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 -- 172.21.15.1:0/1707670998 wait complete. 2024-08-28T20:25:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.718+0000 7f390d1ba740 1 -- start start 2024-08-28T20:25:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 Processor -- start 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d73f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d764e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99b81b0 0x55fdc9d76b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f39001a6f90 con 0x55fdc99b81b0 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39001a8400 con 0x55fdc99974d0 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f39001a7660 con 0x55fdc998f2f0 2024-08-28T20:25:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f390d1ba740 10 client.0 _ll_register_callbacks cb 0x7f38f0003e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f38f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f38f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d764e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:41726/0 (socket says 172.21.15.1:41726) 2024-08-28T20:25:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.719+0000 7f38f6a00640 1 -- 172.21.15.1:0/243249800 learned_addr learned my addr 172.21.15.1:0/243249800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38ff400640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d73f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38ffe00640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99b81b0 0x55fdc9d76b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38f6a00640 1 -- 172.21.15.1:0/243249800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 msgr2=0x55fdc9d73f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38f6a00640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d73f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38f6a00640 1 -- 172.21.15.1:0/243249800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99b81b0 msgr2=0x55fdc9d76b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38f6a00640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99b81b0 0x55fdc9d76b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38f6a00640 1 -- 172.21.15.1:0/243249800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdc9d772f0 con 0x55fdc99974d0 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.720+0000 7f38ff400640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d73f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.721+0000 7f38f6a00640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d764e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f38e80e20e0 tx=0x7f38e8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e58d3b7ba04bbf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.721+0000 7f38ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:25:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f38ecc00640 1 -- 172.21.15.1:0/243249800 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8020040 con 0x55fdc99974d0 2024-08-28T20:25:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f38ecc00640 1 -- 172.21.15.1:0/243249800 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f38e80961b0 con 0x55fdc99974d0 2024-08-28T20:25:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f804a070 con 0x55fdc99974d0 2024-08-28T20:25:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f38ecc00640 1 -- 172.21.15.1:0/243249800 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f38e80af8b0 con 0x55fdc99974d0 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f390d1ba740 10 client.25733 fetch_fsmap learned FSMap version 40 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55fdc9df9790 con 0x55fdc99974d0 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.722+0000 7f38ecc00640 1 -- 172.21.15.1:0/243249800 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f804a070 con 0x55fdc99974d0 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f38ecc00640 1 -- 172.21.15.1:0/243249800 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 40) ==== 8354+0+0 (secure 0 0 0) 0x7f38e8005360 con 0x55fdc99974d0 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f390d1ba740 10 client.25733 fetch_fsmap finished waiting for FSMap version 40 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f390d1ba740 10 client.25733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f390d1ba740 20 client.25733 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f390d1ba740 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc994c1c0 0x55fdc9dfc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f390d1ba740 4 client.25733 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdc9cce960 con 0x55fdc994c1c0 2024-08-28T20:25:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f38ff400640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc994c1c0 0x55fdc9dfc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f38ff400640 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc994c1c0 0x55fdc9dfc170 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff56f7c94ff394cc server_cookie=5ca94cd76b43e270 in_seq=0 out_seq=0 2024-08-28T20:25:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.723+0000 7f38ecc00640 10 client.25733 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f38ecc00640 1 -- 172.21.15.1:0/243249800 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdc9cce960 con 0x55fdc994c1c0 2024-08-28T20:25:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f38ecc00640 10 client.25733 handle_command_reply: tid=0 2024-08-28T20:25:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 client.25733 shutdown 2024-08-28T20:25:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 msgr2=0x55fdc9d764e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d764e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f38e80e20e0 tx=0x7f38e8005880 comp rx=0 tx=0).stop 2024-08-28T20:25:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 shutdown_connections 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fdc994c1c0 0x55fdc9dfc170 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdc99b81b0 0x55fdc9d76b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fdc99974d0 0x55fdc9d764e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 --2- 172.21.15.1:0/243249800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdc998f2f0 0x55fdc9d73f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 >> 172.21.15.1:0/243249800 conn(0x55fdc99ac300 msgr2=0x55fdc9d656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.736+0000 7f38ecc00640 0 client.25733 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 shutdown_connections 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f390d1ba740 1 -- 172.21.15.1:0/243249800 wait complete. 2024-08-28T20:25:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f390d1ba740 20 client.25733 trim_cache size 0 max 16384 2024-08-28T20:25:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:25:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:25:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:25:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f38e40b4bf0 msgr2=0x7f38e40b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f3904c00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f38e40b4bf0 0x7f38e40b7100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f38f0005fd0 tx=0x7f38f00095c0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 msgr2=0x7f390019c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.737+0000 7f3904c00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 0x7f390019c370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38e800d950 tx=0x7f38e800de10 comp rx=0 tx=0).stop 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 shutdown_connections 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f38e40b4bf0 0x7f38e40b7100 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3900103b90 0x7f390019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39001031f0 0x7f390019c370 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 --2- 172.21.15.1:0/2053858872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3900102170 0x7f390019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 >> 172.21.15.1:0/2053858872 conn(0x7f39000fdab0 msgr2=0x7f39001064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 shutdown_connections 2024-08-28T20:25:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:02.738+0000 7f3904c00640 1 -- 172.21.15.1:0/2053858872 wait complete. 2024-08-28T20:25:03.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 395.0 s, 2192.1 tps, lat 46.254 ms stddev 53.694 2024-08-28T20:25:03.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:03 smithi001 ceph-mon[20984]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 675 op/s 2024-08-28T20:25:03.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:03 smithi121 ceph-mon[25248]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 675 op/s 2024-08-28T20:25:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:03 smithi007 ceph-mon[25357]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 675 op/s 2024-08-28T20:25:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:05 smithi001 ceph-mon[20984]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 755 op/s 2024-08-28T20:25:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:05 smithi121 ceph-mon[25248]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 755 op/s 2024-08-28T20:25:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:05 smithi007 ceph-mon[25357]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 755 op/s 2024-08-28T20:25:06.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:06 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:06.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:06 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:07.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:06 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:07 smithi001 ceph-mon[20984]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 767 op/s 2024-08-28T20:25:07.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:07 smithi121 ceph-mon[25248]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 767 op/s 2024-08-28T20:25:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:07 smithi007 ceph-mon[25357]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 14 MiB/s wr, 767 op/s 2024-08-28T20:25:08.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 400.0 s, 609.7 tps, lat 67.086 ms stddev 161.530 2024-08-28T20:25:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:09 smithi001 ceph-mon[20984]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 989 op/s 2024-08-28T20:25:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:09 smithi121 ceph-mon[25248]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 989 op/s 2024-08-28T20:25:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:09 smithi007 ceph-mon[25357]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 989 op/s 2024-08-28T20:25:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:11 smithi001 ceph-mon[20984]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 1.26k op/s 2024-08-28T20:25:11.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:11 smithi121 ceph-mon[25248]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 1.26k op/s 2024-08-28T20:25:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:11 smithi007 ceph-mon[25357]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 1.26k op/s 2024-08-28T20:25:13.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 405.0 s, 848.6 tps, lat 187.921 ms stddev 959.142 2024-08-28T20:25:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:13 smithi001 ceph-mon[20984]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 1.36k op/s 2024-08-28T20:25:13.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:13 smithi121 ceph-mon[25248]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 1.36k op/s 2024-08-28T20:25:14.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:13 smithi007 ceph-mon[25357]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 1.36k op/s 2024-08-28T20:25:15.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:14 smithi007 ceph-mon[25357]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:25:15.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:14 smithi001 ceph-mon[20984]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:25:15.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:14 smithi121 ceph-mon[25248]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 -- 172.21.15.1:0/3403914515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f300779c0 msgr2=0x7f4f30077e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 --2- 172.21.15.1:0/3403914515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f300779c0 0x7f4f30077e30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009900 tx=0x7f4f2402a410 comp rx=0 tx=0).stop 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 -- 172.21.15.1:0/3403914515 shutdown_connections 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 --2- 172.21.15.1:0/3403914515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f300793e0 0x7f4f30079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 --2- 172.21.15.1:0/3403914515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f30078a40 0x7f4f30078e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 --2- 172.21.15.1:0/3403914515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f300779c0 0x7f4f30077e30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 -- 172.21.15.1:0/3403914515 >> 172.21.15.1:0/3403914515 conn(0x7f4f30100fd0 msgr2=0x7f4f30103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 -- 172.21.15.1:0/3403914515 shutdown_connections 2024-08-28T20:25:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.036+0000 7f4f38800640 1 -- 172.21.15.1:0/3403914515 wait complete. 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.037+0000 7f4f38800640 1 Processor -- start 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.037+0000 7f4f38800640 1 -- start start 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f38800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f300779c0 0x7f4f301a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f38800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 0x7f4f301a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f38800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f300793e0 0x7f4f301a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f38800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30115750 con 0x7f4f300793e0 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f38800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301155d0 con 0x7f4f30078a40 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f38800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301158d0 con 0x7f4f300779c0 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f35400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 0x7f4f301a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f36800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f300793e0 0x7f4f301a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f35400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 0x7f4f301a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58614/0 (socket says 172.21.15.1:58614) 2024-08-28T20:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f35400640 1 -- 172.21.15.1:0/2330003713 learned_addr learned my addr 172.21.15.1:0/2330003713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.038+0000 7f4f35e00640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f300779c0 0x7f4f301a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.039+0000 7f4f35400640 1 -- 172.21.15.1:0/2330003713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f300779c0 msgr2=0x7f4f301a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.039+0000 7f4f35400640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f300779c0 0x7f4f301a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.039+0000 7f4f35400640 1 -- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f300793e0 msgr2=0x7f4f301a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.039+0000 7f4f35400640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f300793e0 0x7f4f301a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.039+0000 7f4f35400640 1 -- 172.21.15.1:0/2330003713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f301a1d40 con 0x7f4f30078a40 2024-08-28T20:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.040+0000 7f4f35e00640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f300779c0 0x7f4f301a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.040+0000 7f4f35400640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 0x7f4f301a0970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e9f0 tx=0x7f4f2000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.041+0000 7f4f2aa00640 1 -- 172.21.15.1:0/2330003713 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000cd80 con 0x7f4f30078a40 2024-08-28T20:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.041+0000 7f4f2aa00640 1 -- 172.21.15.1:0/2330003713 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f200108e0 con 0x7f4f30078a40 2024-08-28T20:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.041+0000 7f4f2aa00640 1 -- 172.21.15.1:0/2330003713 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20018980 con 0x7f4f30078a40 2024-08-28T20:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.041+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f301a2030 con 0x7f4f30078a40 2024-08-28T20:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.041+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f301a8720 con 0x7f4f30078a40 2024-08-28T20:25:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.047+0000 7f4f2aa00640 1 -- 172.21.15.1:0/2330003713 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f4f20010430 con 0x7f4f30078a40 2024-08-28T20:25:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.048+0000 7f4f3f885740 1 Processor -- start 2024-08-28T20:25:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.049+0000 7f4f2aa00640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f180b4c80 0x7f4f180b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.049+0000 7f4f2aa00640 1 -- 172.21.15.1:0/2330003713 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4f200e53a0 con 0x7f4f30078a40 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 -- start start 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f36800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f180b4c80 0x7f4f180b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59481b0 0x558ab5cedb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 0x558ab5cee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab59274d0 0x558ab5ceecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558ab5c60f70 con 0x558ab59274d0 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558ab5c50500 con 0x558ab59481b0 2024-08-28T20:25:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.050+0000 7f4f3f885740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558ab5c544b0 con 0x558ab591f2f0 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.051+0000 7f4f35400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 0x558ab5cee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.051+0000 7f4f35e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59481b0 0x558ab5cedb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.051+0000 7f4f35400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 0x558ab5cee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36936/0 (socket says 172.21.15.1:36936) 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.051+0000 7f4f35400640 1 -- 172.21.15.1:0/2471678618 learned_addr learned my addr 172.21.15.1:0/2471678618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f36800640 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab59274d0 0x558ab5ceecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f35e00640 1 -- 172.21.15.1:0/2471678618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 msgr2=0x558ab5cee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f35e00640 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 0x558ab5cee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f35e00640 1 -- 172.21.15.1:0/2471678618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab59274d0 msgr2=0x558ab5ceecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f35e00640 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab59274d0 0x558ab5ceecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f35e00640 1 -- 172.21.15.1:0/2471678618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab5c0ac10 con 0x558ab59481b0 2024-08-28T20:25:16.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f35400640 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 0x558ab5cee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:25:16.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.052+0000 7f4f36800640 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab59274d0 0x558ab5ceecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:25:16.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.053+0000 7f4f35e00640 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59481b0 0x558ab5cedb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402aa00 tx=0x7f4f240043f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e441b85e1c5b2171 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:16.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.053+0000 7f4f36800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f180b4c80 0x7f4f180b7190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c005fd0 tx=0x7f4f2c013a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:16.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.054+0000 7f4f1f000640 1 -- 172.21.15.1:0/2471678618 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24035030 con 0x558ab59481b0 2024-08-28T20:25:16.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.055+0000 7f4f1f000640 1 -- 172.21.15.1:0/2471678618 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f24040070 con 0x558ab59481b0 2024-08-28T20:25:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.055+0000 7f4f1f000640 1 -- 172.21.15.1:0/2471678618 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24031c50 con 0x558ab59481b0 2024-08-28T20:25:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.056+0000 7f4f3f885740 1 -- 172.21.15.1:0/2471678618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59481b0 msgr2=0x558ab5cedb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.056+0000 7f4f3f885740 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59481b0 0x558ab5cedb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402aa00 tx=0x7f4f240043f0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.057+0000 7f4f3f885740 1 -- 172.21.15.1:0/2471678618 shutdown_connections 2024-08-28T20:25:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.057+0000 7f4f3f885740 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab59274d0 0x558ab5ceecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.057+0000 7f4f3f885740 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab591f2f0 0x558ab5cee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.057+0000 7f4f3f885740 1 --2- 172.21.15.1:0/2471678618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59481b0 0x558ab5cedb30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.057+0000 7f4f3f885740 1 -- 172.21.15.1:0/2471678618 >> 172.21.15.1:0/2471678618 conn(0x558ab593c300 msgr2=0x558ab5ce95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.058+0000 7f4f3f885740 1 -- 172.21.15.1:0/2471678618 shutdown_connections 2024-08-28T20:25:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.058+0000 7f4f3f885740 1 -- 172.21.15.1:0/2471678618 wait complete. 2024-08-28T20:25:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.059+0000 7f4f3f885740 1 -- start start 2024-08-28T20:25:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.059+0000 7f4f3f885740 1 Processor -- start 2024-08-28T20:25:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.060+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 0x558ab5cf7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.060+0000 7f4f35e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 0x558ab5cf7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.060+0000 7f4f35e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 0x558ab5cf7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38504/0 (socket says 172.21.15.1:38504) 2024-08-28T20:25:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.060+0000 7f4f35e00640 1 -- 172.21.15.1:0/11282475 learned_addr learned my addr 172.21.15.1:0/11282475 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.060+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.061+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cf8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.061+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558ab5b89ab0 con 0x558ab591f2f0 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.061+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558ab5bf7320 con 0x558ab59274d0 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.061+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558ab5cef7b0 con 0x558ab59481b0 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.061+0000 7f4f3f885740 10 client.0 _ll_register_callbacks cb 0x558ab5c30e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.062+0000 7f4f35400640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.062+0000 7f4f36800640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cf8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:15 smithi007 ceph-mon[25357]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 MiB/s wr, 1.44k op/s 2024-08-28T20:25:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.063+0000 7f4f35e00640 1 -- 172.21.15.1:0/11282475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 msgr2=0x558ab5cf8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.063+0000 7f4f35e00640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cf8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.063+0000 7f4f35e00640 1 -- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 msgr2=0x558ab5cf7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.063+0000 7f4f35e00640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.063+0000 7f4f35e00640 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab59b3790 con 0x558ab591f2f0 2024-08-28T20:25:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.064+0000 7f4f35e00640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 0x558ab5cf7150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402a450 tx=0x7f4f240319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a68982328188ec server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.064+0000 7f4f13400640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:25:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.065+0000 7f4f13400640 1 -- 172.21.15.1:0/11282475 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24053060 con 0x558ab591f2f0 2024-08-28T20:25:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.065+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f24040070 con 0x558ab591f2f0 2024-08-28T20:25:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.065+0000 7f4f13400640 1 -- 172.21.15.1:0/11282475 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4f240037f0 con 0x558ab591f2f0 2024-08-28T20:25:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.066+0000 7f4f13400640 1 -- 172.21.15.1:0/11282475 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4f24035070 con 0x558ab591f2f0 2024-08-28T20:25:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.066+0000 7f4f3f885740 10 client.15543 fetch_fsmap learned FSMap version 41 2024-08-28T20:25:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.066+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558ab5a2c620 con 0x558ab591f2f0 2024-08-28T20:25:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.067+0000 7f4f13400640 1 -- 172.21.15.1:0/11282475 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f24040070 con 0x558ab591f2f0 2024-08-28T20:25:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.068+0000 7f4f13400640 1 -- 172.21.15.1:0/11282475 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f4f2404d030 con 0x558ab591f2f0 2024-08-28T20:25:16.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.068+0000 7f4f3f885740 10 client.15543 fetch_fsmap finished waiting for FSMap version 41 2024-08-28T20:25:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.068+0000 7f4f3f885740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.068+0000 7f4f3f885740 20 client.15543 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.068+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5906d80 0x558ab5d043b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.069+0000 7f4f3f885740 4 client.15543 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:25:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.069+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ab5c62ec0 con 0x558ab5906d80 2024-08-28T20:25:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.069+0000 7f4f35400640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5906d80 0x558ab5d043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.070+0000 7f4f35400640 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5906d80 0x558ab5d043b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0a7d55052d752e server_cookie=c0e7ef687290c26c in_seq=0 out_seq=0 2024-08-28T20:25:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.070+0000 7f4f13400640 10 client.15543 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.071+0000 7f4f13400640 1 -- 172.21.15.1:0/11282475 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ab5c62ec0 con 0x558ab5906d80 2024-08-28T20:25:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.071+0000 7f4f13400640 10 client.15543 handle_command_reply: tid=0 2024-08-28T20:25:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.071+0000 7f4f3f885740 1 client.15543 shutdown 2024-08-28T20:25:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 msgr2=0x558ab5cf7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 0x558ab5cf7150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402a450 tx=0x7f4f240319d0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 shutdown_connections 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5906d80 0x558ab5d043b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cf8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 --2- 172.21.15.1:0/11282475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab591f2f0 0x558ab5cf7150 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 >> 172.21.15.1:0/11282475 conn(0x558ab593c300 msgr2=0x558ab5ce7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.072+0000 7f4f13400640 0 client.15543 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.073+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 shutdown_connections 2024-08-28T20:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.073+0000 7f4f3f885740 1 -- 172.21.15.1:0/11282475 wait complete. 2024-08-28T20:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.073+0000 7f4f3f885740 20 client.15543 trim_cache size 0 max 16384 2024-08-28T20:25:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.100+0000 7f4f3f885740 1 Processor -- start 2024-08-28T20:25:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 -- start start 2024-08-28T20:25:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5ce8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5ce9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301b3b60 con 0x558ab58dc1c0 2024-08-28T20:25:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301b1430 con 0x558ab59274d0 2024-08-28T20:25:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.101+0000 7f4f3f885740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301af280 con 0x558ab59481b0 2024-08-28T20:25:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.102+0000 7f4f35e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.102+0000 7f4f35e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58644/0 (socket says 172.21.15.1:58644) 2024-08-28T20:25:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.102+0000 7f4f35e00640 1 -- 172.21.15.1:0/3487299715 learned_addr learned my addr 172.21.15.1:0/3487299715 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.102+0000 7f4f35400640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5ce8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f36800640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5ce9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f35400640 1 -- 172.21.15.1:0/3487299715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 msgr2=0x558ab5cf2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f35400640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f35400640 1 -- 172.21.15.1:0/3487299715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 msgr2=0x558ab5ce9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f35400640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5ce9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f35400640 1 -- 172.21.15.1:0/3487299715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab5cef870 con 0x558ab59481b0 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f35e00640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.103+0000 7f4f36800640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5ce9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:25:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.104+0000 7f4f35400640 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5ce8f00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f200a7e90 tx=0x7f4f200a7df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58411e12553789f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.104+0000 7f4f1e600640 1 -- 172.21.15.1:0/3487299715 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200b0040 con 0x558ab59481b0 2024-08-28T20:25:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.105+0000 7f4f1e600640 1 -- 172.21.15.1:0/3487299715 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f200d0e50 con 0x558ab59481b0 2024-08-28T20:25:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.105+0000 7f4f1e600640 1 -- 172.21.15.1:0/3487299715 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200b01e0 con 0x558ab59481b0 2024-08-28T20:25:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.106+0000 7f4f3f885740 1 -- 172.21.15.1:0/3487299715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 msgr2=0x558ab5ce8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.106+0000 7f4f3f885740 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5ce8f00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f200a7e90 tx=0x7f4f200a7df0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 -- 172.21.15.1:0/3487299715 shutdown_connections 2024-08-28T20:25:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5ce9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5ce8f00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 --2- 172.21.15.1:0/3487299715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cf2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 -- 172.21.15.1:0/3487299715 >> 172.21.15.1:0/3487299715 conn(0x558ab593c300 msgr2=0x558ab5cf88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 -- 172.21.15.1:0/3487299715 shutdown_connections 2024-08-28T20:25:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 -- 172.21.15.1:0/3487299715 wait complete. 2024-08-28T20:25:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.107+0000 7f4f3f885740 1 -- start start 2024-08-28T20:25:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 Processor -- start 2024-08-28T20:25:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5cfed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cfaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cfb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301af8f0 con 0x558ab58dc1c0 2024-08-28T20:25:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301b0d60 con 0x558ab59274d0 2024-08-28T20:25:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301affc0 con 0x558ab59481b0 2024-08-28T20:25:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.108+0000 7f4f3f885740 10 client.0 _ll_register_callbacks cb 0x7f4f24009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.110+0000 7f4f35400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cfaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.110+0000 7f4f35400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cfaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:58652/0 (socket says 172.21.15.1:58652) 2024-08-28T20:25:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.110+0000 7f4f35400640 1 -- 172.21.15.1:0/498241774 learned_addr learned my addr 172.21.15.1:0/498241774 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.110+0000 7f4f35e00640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5cfed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.110+0000 7f4f36800640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cfb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f36800640 1 -- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 msgr2=0x558ab5cfaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f36800640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cfaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f36800640 1 -- 172.21.15.1:0/498241774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 msgr2=0x558ab5cfed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f36800640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5cfed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f36800640 1 -- 172.21.15.1:0/498241774 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab5cfbcf0 con 0x558ab59481b0 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f35e00640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5cfed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.111+0000 7f4f35400640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cfaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.112+0000 7f4f36800640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cfb1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c013f80 tx=0x7f4f2c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334d785f79023ad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.112+0000 7f4f13400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:25:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.112+0000 7f4f13400640 1 -- 172.21.15.1:0/498241774 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00fe10 con 0x558ab59481b0 2024-08-28T20:25:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.113+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f200d0e50 con 0x558ab59481b0 2024-08-28T20:25:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.113+0000 7f4f13400640 1 -- 172.21.15.1:0/498241774 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4f2c009040 con 0x558ab59481b0 2024-08-28T20:25:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.113+0000 7f4f13400640 1 -- 172.21.15.1:0/498241774 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4f2c0045b0 con 0x558ab59481b0 2024-08-28T20:25:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.114+0000 7f4f3f885740 10 client.25720 fetch_fsmap learned FSMap version 41 2024-08-28T20:25:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.114+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558ab5d800a0 con 0x558ab59481b0 2024-08-28T20:25:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.114+0000 7f4f13400640 1 -- 172.21.15.1:0/498241774 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f200d0e50 con 0x558ab59481b0 2024-08-28T20:25:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f13400640 1 -- 172.21.15.1:0/498241774 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f4f2c031420 con 0x558ab59481b0 2024-08-28T20:25:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f3f885740 10 client.25720 fetch_fsmap finished waiting for FSMap version 41 2024-08-28T20:25:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f3f885740 10 client.25720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f3f885740 20 client.25720 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f3f885740 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5d80a80 0x558ab5d82ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f3f885740 4 client.25720 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:25:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ab5c5e960 con 0x558ab5d80a80 2024-08-28T20:25:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.115+0000 7f4f35e00640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5d80a80 0x558ab5d82ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.116+0000 7f4f35e00640 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5d80a80 0x558ab5d82ea0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d379cd3476c7d2 server_cookie=7091a4e2917b4caf in_seq=0 out_seq=0 2024-08-28T20:25:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.116+0000 7f4f13400640 10 client.25720 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.190+0000 7f4f13400640 1 -- 172.21.15.1:0/498241774 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ab5c5e960 con 0x558ab5d80a80 2024-08-28T20:25:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.190+0000 7f4f13400640 10 client.25720 handle_command_reply: tid=0 2024-08-28T20:25:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.190+0000 7f4f3f885740 1 client.25720 shutdown 2024-08-28T20:25:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 msgr2=0x558ab5cfb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cfb1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c013f80 tx=0x7f4f2c004ab0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 shutdown_connections 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558ab5d80a80 0x558ab5d82ea0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558ab59481b0 0x558ab5cfb1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558ab59274d0 0x558ab5cfaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 --2- 172.21.15.1:0/498241774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ab58dc1c0 0x558ab5cfed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f13400640 0 client.25720 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 >> 172.21.15.1:0/498241774 conn(0x558ab593c300 msgr2=0x558ab5cf6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.191+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 shutdown_connections 2024-08-28T20:25:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.192+0000 7f4f3f885740 1 -- 172.21.15.1:0/498241774 wait complete. 2024-08-28T20:25:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.192+0000 7f4f3f885740 20 client.25720 trim_cache size 0 max 16384 2024-08-28T20:25:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:25:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:25:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:25:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:25:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f180b4c80 msgr2=0x7f4f180b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f180b4c80 0x7f4f180b7190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c005fd0 tx=0x7f4f2c013a80 comp rx=0 tx=0).stop 2024-08-28T20:25:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 msgr2=0x7f4f301a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 0x7f4f301a0970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000e9f0 tx=0x7f4f2000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 shutdown_connections 2024-08-28T20:25:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f180b4c80 0x7f4f180b7190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f300793e0 0x7f4f301a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f30078a40 0x7f4f301a0970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 --2- 172.21.15.1:0/2330003713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f300779c0 0x7f4f301a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:16.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.195+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 >> 172.21.15.1:0/2330003713 conn(0x7f4f30100fd0 msgr2=0x7f4f30103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:16.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.196+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 shutdown_connections 2024-08-28T20:25:16.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:16.196+0000 7f4f38800640 1 -- 172.21.15.1:0/2330003713 wait complete. 2024-08-28T20:25:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:15 smithi001 ceph-mon[20984]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 MiB/s wr, 1.44k op/s 2024-08-28T20:25:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:15 smithi121 ceph-mon[25248]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 33 MiB/s wr, 1.44k op/s 2024-08-28T20:25:18.032 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:17 smithi121 ceph-mon[25248]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 33 MiB/s wr, 1.37k op/s 2024-08-28T20:25:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:17 smithi007 ceph-mon[25357]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 33 MiB/s wr, 1.37k op/s 2024-08-28T20:25:18.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:17 smithi001 ceph-mon[20984]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 33 MiB/s wr, 1.37k op/s 2024-08-28T20:25:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 410.0 s, 2235.6 tps, lat 44.166 ms stddev 50.941 2024-08-28T20:25:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:19 smithi007 ceph-mon[25357]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2024-08-28T20:25:20.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:19 smithi001 ceph-mon[20984]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2024-08-28T20:25:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:19 smithi121 ceph-mon[25248]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2024-08-28T20:25:22.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:21 smithi007 ceph-mon[25357]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 1.09k op/s 2024-08-28T20:25:22.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:21 smithi001 ceph-mon[20984]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 1.09k op/s 2024-08-28T20:25:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:21 smithi121 ceph-mon[25248]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 1.09k op/s 2024-08-28T20:25:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 415.0 s, 2183.2 tps, lat 46.156 ms stddev 56.733 2024-08-28T20:25:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:23 smithi007 ceph-mon[25357]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 773 op/s 2024-08-28T20:25:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:23 smithi001 ceph-mon[20984]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 773 op/s 2024-08-28T20:25:24.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:23 smithi121 ceph-mon[25248]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 17 MiB/s wr, 773 op/s 2024-08-28T20:25:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:25 smithi001 ceph-mon[20984]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 733 op/s 2024-08-28T20:25:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:25 smithi121 ceph-mon[25248]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 733 op/s 2024-08-28T20:25:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:25 smithi007 ceph-mon[25357]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 733 op/s 2024-08-28T20:25:27.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:26 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:27.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:26 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:27.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:26 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:28.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:27 smithi001 ceph-mon[20984]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 658 op/s 2024-08-28T20:25:28.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:27 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:25:28.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:27 smithi121 ceph-mon[25248]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 658 op/s 2024-08-28T20:25:28.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:27 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:25:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:27 smithi007 ceph-mon[25357]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 658 op/s 2024-08-28T20:25:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:27 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:25:28.765 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 420.0 s, 1748.0 tps, lat 56.729 ms stddev 67.274 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:28 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:28 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:28 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T20:25:29.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 -- 172.21.15.1:0/1846944888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10cb50 msgr2=0x7ffbbc10f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 --2- 172.21.15.1:0/1846944888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10cb50 0x7ffbbc10f030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009860 tx=0x7ffba802a380 comp rx=0 tx=0).stop 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 -- 172.21.15.1:0/1846944888 shutdown_connections 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 --2- 172.21.15.1:0/1846944888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbbc10f770 0x7ffbbc11a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 --2- 172.21.15.1:0/1846944888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10cb50 0x7ffbbc10f030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 --2- 172.21.15.1:0/1846944888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffbbc10a160 0x7ffbbc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 -- 172.21.15.1:0/1846944888 >> 172.21.15.1:0/1846944888 conn(0x7ffbbc0705b0 msgr2=0x7ffbbc072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.502+0000 7ffbc3000640 1 -- 172.21.15.1:0/1846944888 shutdown_connections 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.503+0000 7ffbc3000640 1 -- 172.21.15.1:0/1846944888 wait complete. 2024-08-28T20:25:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.505+0000 7ffbc3000640 1 Processor -- start 2024-08-28T20:25:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.506+0000 7ffbc3000640 1 -- start start 2024-08-28T20:25:29.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.508+0000 7ffbc3000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbbc10a160 0x7ffbbc1a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.508+0000 7ffbc3000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffbbc10cb50 0x7ffbbc1a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.508+0000 7ffbc3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 0x7ffbbc1a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.508+0000 7ffbc3000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc11dee0 con 0x7ffbbc10a160 2024-08-28T20:25:29.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.508+0000 7ffbc3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc11dd60 con 0x7ffbbc10f770 2024-08-28T20:25:29.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.508+0000 7ffbc3000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc11e060 con 0x7ffbbc10cb50 2024-08-28T20:25:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.509+0000 7ffbc1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 0x7ffbbc1a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.509+0000 7ffbc1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 0x7ffbbc1a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:60198/0 (socket says 172.21.15.1:60198) 2024-08-28T20:25:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.509+0000 7ffbc1000640 1 -- 172.21.15.1:0/2520172936 learned_addr learned my addr 172.21.15.1:0/2520172936 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.509+0000 7ffbbb400640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffbbc10cb50 0x7ffbbc1a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.509+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbbc10a160 0x7ffbbc1a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.510+0000 7ffbc1000640 1 -- 172.21.15.1:0/2520172936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffbbc10cb50 msgr2=0x7ffbbc1a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.510+0000 7ffbc1000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffbbc10cb50 0x7ffbbc1a9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.510+0000 7ffbc1000640 1 -- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbbc10a160 msgr2=0x7ffbbc1a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.510+0000 7ffbc1000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbbc10a160 0x7ffbbc1a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.511+0000 7ffbc1000640 1 -- 172.21.15.1:0/2520172936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbbc1aa550 con 0x7ffbbc10f770 2024-08-28T20:25:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.516+0000 7ffbc1000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 0x7ffbbc1a9d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400b970 tx=0x7ffbb400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.517+0000 7ffbb8c00640 1 -- 172.21.15.1:0/2520172936 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4019070 con 0x7ffbbc10f770 2024-08-28T20:25:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.517+0000 7ffbb8c00640 1 -- 172.21.15.1:0/2520172936 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb4014440 con 0x7ffbbc10f770 2024-08-28T20:25:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.517+0000 7ffbb8c00640 1 -- 172.21.15.1:0/2520172936 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40075d0 con 0x7ffbbc10f770 2024-08-28T20:25:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.520+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbbc1aa840 con 0x7ffbbc10f770 2024-08-28T20:25:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.520+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbbc1b0f30 con 0x7ffbbc10f770 2024-08-28T20:25:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.525+0000 7ffbc9d22740 1 Processor -- start 2024-08-28T20:25:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.525+0000 7ffbc9d22740 1 -- start start 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.526+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1c61b0 0x56191c56bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.526+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.526+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1a54d0 0x56191c56ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.526+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56191c4def70 con 0x56191c19d2f0 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.526+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56191c4ce500 con 0x56191c1c61b0 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.526+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56191c4d24b0 con 0x56191c1a54d0 2024-08-28T20:25:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.527+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.527+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41842/0 (socket says 172.21.15.1:41842) 2024-08-28T20:25:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.527+0000 7ffbbbe00640 1 -- 172.21.15.1:0/4236333823 learned_addr learned my addr 172.21.15.1:0/4236333823 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.528+0000 7ffbbbe00640 1 -- 172.21.15.1:0/4236333823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1a54d0 msgr2=0x56191c56ccf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:25:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.528+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1a54d0 0x56191c56ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.528+0000 7ffbbbe00640 1 -- 172.21.15.1:0/4236333823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1c61b0 msgr2=0x56191c56bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.528+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1c61b0 0x56191c56bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.528+0000 7ffbbbe00640 1 -- 172.21.15.1:0/4236333823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56191c488c10 con 0x56191c19d2f0 2024-08-28T20:25:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.529+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56c1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009c20 tx=0x7ffbac0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d9952ba83dcceb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.529+0000 7ffbb8c00640 1 -- 172.21.15.1:0/2520172936 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ffbb400cb40 con 0x7ffbbc10f770 2024-08-28T20:25:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.530+0000 7ffbb1600640 1 -- 172.21.15.1:0/4236333823 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac012450 con 0x56191c19d2f0 2024-08-28T20:25:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.530+0000 7ffbb1600640 1 -- 172.21.15.1:0/4236333823 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbac012aa0 con 0x56191c19d2f0 2024-08-28T20:25:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.530+0000 7ffbb1600640 1 -- 172.21.15.1:0/4236333823 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac00faf0 con 0x56191c19d2f0 2024-08-28T20:25:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.532+0000 7ffbb8c00640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffba00b4c30 0x7ffba00b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.532+0000 7ffbc9d22740 1 -- 172.21.15.1:0/4236333823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 msgr2=0x56191c56c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.532+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56c1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009c20 tx=0x7ffbac0117b0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbc9d22740 1 -- 172.21.15.1:0/4236333823 shutdown_connections 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56c1a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1a54d0 0x56191c56ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/4236333823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1c61b0 0x56191c56bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbc9d22740 1 -- 172.21.15.1:0/4236333823 >> 172.21.15.1:0/4236333823 conn(0x56191c1ba300 msgr2=0x56191c5675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbbb400640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffba00b4c30 0x7ffba00b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.533+0000 7ffbc9d22740 1 -- 172.21.15.1:0/4236333823 shutdown_connections 2024-08-28T20:25:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.534+0000 7ffbb8c00640 1 -- 172.21.15.1:0/2520172936 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ffbb40e4530 con 0x7ffbbc10f770 2024-08-28T20:25:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.535+0000 7ffbc9d22740 1 -- 172.21.15.1:0/4236333823 wait complete. 2024-08-28T20:25:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.535+0000 7ffbbb400640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffba00b4c30 0x7ffba00b7140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009830 tx=0x7ffba8009490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.535+0000 7ffbc9d22740 1 -- start start 2024-08-28T20:25:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.536+0000 7ffbc9d22740 1 Processor -- start 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.536+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 0x56191c5751e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c5758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c1c61b0 0x56191c576410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56191c407ab0 con 0x56191c1c61b0 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56191c475320 con 0x56191c1a54d0 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56191c56d810 con 0x56191c19d2f0 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbc9d22740 10 client.0 _ll_register_callbacks cb 0x56191c4aee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 0x56191c5751e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 0x56191c5751e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:48806/0 (socket says 172.21.15.1:48806) 2024-08-28T20:25:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 -- 172.21.15.1:0/2547705887 learned_addr learned my addr 172.21.15.1:0/2547705887 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 -- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 msgr2=0x56191c5758a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:25:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c5758a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 -- 172.21.15.1:0/2547705887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c1c61b0 msgr2=0x56191c576410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:25:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c1c61b0 0x56191c576410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.537+0000 7ffbbbe00640 1 -- 172.21.15.1:0/2547705887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56191c231790 con 0x56191c19d2f0 2024-08-28T20:25:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.538+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 0x56191c5751e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0097f0 tx=0x7ffbac004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3af03caffb1782 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.539+0000 7ffba6000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:25:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.539+0000 7ffba6000640 1 -- 172.21.15.1:0/2547705887 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac028070 con 0x56191c19d2f0 2024-08-28T20:25:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.539+0000 7ffba6000640 1 -- 172.21.15.1:0/2547705887 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ffbac012450 con 0x56191c19d2f0 2024-08-28T20:25:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.539+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbac012aa0 con 0x56191c19d2f0 2024-08-28T20:25:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.542+0000 7ffba6000640 1 -- 172.21.15.1:0/2547705887 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ffbac032050 con 0x56191c19d2f0 2024-08-28T20:25:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.542+0000 7ffbc9d22740 10 client.25729 fetch_fsmap learned FSMap version 43 2024-08-28T20:25:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.542+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56191c2aa620 con 0x56191c19d2f0 2024-08-28T20:25:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.542+0000 7ffba6000640 1 -- 172.21.15.1:0/2547705887 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbac012aa0 con 0x56191c19d2f0 2024-08-28T20:25:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffba6000640 1 -- 172.21.15.1:0/2547705887 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 43) ==== 8350+0+0 (secure 0 0 0) 0x7ffbac0037b0 con 0x56191c19d2f0 2024-08-28T20:25:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbc9d22740 10 client.25729 fetch_fsmap finished waiting for FSMap version 43 2024-08-28T20:25:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbc9d22740 10 client.25729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbc9d22740 20 client.25729 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c184d80 0x56191c582760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbc9d22740 4 client.25729 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:25:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56191c4e0ec0 con 0x56191c184d80 2024-08-28T20:25:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.543+0000 7ffbbb400640 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c184d80 0x56191c582760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.546+0000 7ffba6000640 10 client.25729 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.546+0000 7ffbbb400640 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c184d80 0x56191c582760 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8498bf017de74e7d server_cookie=db0065ff025269d7 in_seq=0 out_seq=0 2024-08-28T20:25:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.547+0000 7ffba6000640 1 -- 172.21.15.1:0/2547705887 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56191c4e0ec0 con 0x56191c184d80 2024-08-28T20:25:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.547+0000 7ffba6000640 10 client.25729 handle_command_reply: tid=0 2024-08-28T20:25:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.547+0000 7ffbc9d22740 1 client.25729 shutdown 2024-08-28T20:25:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.548+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 msgr2=0x56191c5751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.548+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 0x56191c5751e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0097f0 tx=0x7ffbac004040 comp rx=0 tx=0).stop 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.549+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 shutdown_connections 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.549+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c184d80 0x56191c582760 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.549+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c1c61b0 0x56191c576410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.549+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c5758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.549+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/2547705887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c19d2f0 0x56191c5751e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.549+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 >> 172.21.15.1:0/2547705887 conn(0x56191c1ba300 msgr2=0x56191c565b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.550+0000 7ffba6000640 0 client.25729 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.550+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 shutdown_connections 2024-08-28T20:25:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.551+0000 7ffbc9d22740 1 -- 172.21.15.1:0/2547705887 wait complete. 2024-08-28T20:25:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.551+0000 7ffbc9d22740 20 client.25729 trim_cache size 0 max 16384 2024-08-28T20:25:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.597+0000 7ffbc9d22740 1 Processor -- start 2024-08-28T20:25:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.597+0000 7ffbc9d22740 1 -- start start 2024-08-28T20:25:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c573d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c574270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc1bc420 con 0x56191c19d2f0 2024-08-28T20:25:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc1b9cc0 con 0x56191c1a54d0 2024-08-28T20:25:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc1b7b10 con 0x56191c1c61b0 2024-08-28T20:25:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbbb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c573d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbbb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c573d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:60216/0 (socket says 172.21.15.1:60216) 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbbb400640 1 -- 172.21.15.1:0/581405618 learned_addr learned my addr 172.21.15.1:0/581405618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.598+0000 7ffbc1000640 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c574270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbbb400640 1 -- 172.21.15.1:0/581405618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 msgr2=0x56191c574270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbbb400640 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c574270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbbb400640 1 -- 172.21.15.1:0/581405618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 msgr2=0x56191c56ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbbb400640 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbbb400640 1 -- 172.21.15.1:0/581405618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56191c5617c0 con 0x56191c1a54d0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbbb400640 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c573d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009780 tx=0x7ffba8030340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7311723eb082bfd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbb0c00640 1 -- 172.21.15.1:0/581405618 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8055070 con 0x56191c1a54d0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbb0c00640 1 -- 172.21.15.1:0/581405618 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba8043040 con 0x56191c1a54d0 2024-08-28T20:25:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.599+0000 7ffbb0c00640 1 -- 172.21.15.1:0/581405618 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8037040 con 0x56191c1a54d0 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 -- 172.21.15.1:0/581405618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 msgr2=0x56191c573d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c573d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009780 tx=0x7ffba8030340 comp rx=0 tx=0).stop 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 -- 172.21.15.1:0/581405618 shutdown_connections 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c574270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c573d30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/581405618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c56ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 -- 172.21.15.1:0/581405618 >> 172.21.15.1:0/581405618 conn(0x56191c1ba300 msgr2=0x56191c562240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.600+0000 7ffbc9d22740 1 -- 172.21.15.1:0/581405618 shutdown_connections 2024-08-28T20:25:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.601+0000 7ffbc9d22740 1 -- 172.21.15.1:0/581405618 wait complete. 2024-08-28T20:25:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.602+0000 7ffbc9d22740 1 -- start start 2024-08-28T20:25:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.602+0000 7ffbc9d22740 1 Processor -- start 2024-08-28T20:25:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c57a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c57ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c57b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc1b8180 con 0x56191c19d2f0 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc1b95f0 con 0x56191c1a54d0 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc1b8850 con 0x56191c1c61b0 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbc9d22740 10 client.0 _ll_register_callbacks cb 0x7ffbac009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbbb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c57ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbbb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c57ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:60218/0 (socket says 172.21.15.1:60218) 2024-08-28T20:25:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.603+0000 7ffbbb400640 1 -- 172.21.15.1:0/3728929046 learned_addr learned my addr 172.21.15.1:0/3728929046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.604+0000 7ffbc1000640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c57b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.604+0000 7ffbbb400640 1 -- 172.21.15.1:0/3728929046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 msgr2=0x56191c57b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.604+0000 7ffbbb400640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c57b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.604+0000 7ffbbb400640 1 -- 172.21.15.1:0/3728929046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 msgr2=0x56191c57a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.604+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c57a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.605+0000 7ffbbb400640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c57a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.605+0000 7ffbbb400640 1 -- 172.21.15.1:0/3728929046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56191c57bed0 con 0x56191c1a54d0 2024-08-28T20:25:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.605+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c57a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.605+0000 7ffbbb400640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c57ac00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffba802a8a0 tx=0x7ffba8004220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a4974406fc2d84 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.605+0000 7ffba6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.605+0000 7ffba6000640 1 -- 172.21.15.1:0/3728929046 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba805d070 con 0x56191c1a54d0 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.606+0000 7ffba6000640 1 -- 172.21.15.1:0/3728929046 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ffba8003a00 con 0x56191c1a54d0 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.606+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba8043040 con 0x56191c1a54d0 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.606+0000 7ffba6000640 1 -- 172.21.15.1:0/3728929046 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ffba8069050 con 0x56191c1a54d0 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.606+0000 7ffbc9d22740 10 client.25763 fetch_fsmap learned FSMap version 43 2024-08-28T20:25:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.606+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56191c57d260 con 0x56191c1a54d0 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffba6000640 1 -- 172.21.15.1:0/3728929046 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba8043040 con 0x56191c1a54d0 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffba6000640 1 -- 172.21.15.1:0/3728929046 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) ==== 8350+0+0 (secure 0 0 0) 0x7ffba8048040 con 0x56191c1a54d0 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffbc9d22740 10 client.25763 fetch_fsmap finished waiting for FSMap version 43 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffbc9d22740 10 client.25763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffbc9d22740 20 client.25763 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c15a1c0 0x56191c5ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffbc9d22740 4 client.25763 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:25:29.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.607+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56191c4dc960 con 0x56191c15a1c0 2024-08-28T20:25:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.608+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c15a1c0 0x56191c5ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.608+0000 7ffbbbe00640 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c15a1c0 0x56191c5ef4a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d9c4b48e9f02dd server_cookie=fa37b82e575edbbd in_seq=0 out_seq=0 2024-08-28T20:25:29.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.608+0000 7ffba6000640 10 client.25763 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.625+0000 7ffba6000640 1 -- 172.21.15.1:0/3728929046 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56191c4dc960 con 0x56191c15a1c0 2024-08-28T20:25:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.625+0000 7ffba6000640 10 client.25763 handle_command_reply: tid=0 2024-08-28T20:25:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.625+0000 7ffbc9d22740 1 client.25763 shutdown 2024-08-28T20:25:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.625+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 msgr2=0x56191c57ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.625+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c57ac00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffba802a8a0 tx=0x7ffba8004220 comp rx=0 tx=0).stop 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 shutdown_connections 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56191c15a1c0 0x56191c5ef4a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffba6000640 0 client.25763 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56191c1c61b0 0x56191c57b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56191c1a54d0 0x56191c57ac00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 --2- 172.21.15.1:0/3728929046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56191c19d2f0 0x56191c57a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 >> 172.21.15.1:0/3728929046 conn(0x56191c1ba300 msgr2=0x56191c565b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 shutdown_connections 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 1 -- 172.21.15.1:0/3728929046 wait complete. 2024-08-28T20:25:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.626+0000 7ffbc9d22740 20 client.25763 trim_cache size 0 max 16384 2024-08-28T20:25:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:25:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:25:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:25:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.627+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffba00b4c30 msgr2=0x7ffba00b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.627+0000 7ffbc3000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffba00b4c30 0x7ffba00b7140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009830 tx=0x7ffba8009490 comp rx=0 tx=0).stop 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.627+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 msgr2=0x7ffbbc1a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.627+0000 7ffbc3000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 0x7ffbbc1a9d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400b970 tx=0x7ffbb400be30 comp rx=0 tx=0).stop 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 shutdown_connections 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffba00b4c30 0x7ffba00b7140 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbbc10f770 0x7ffbbc1a9d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffbbc10cb50 0x7ffbbc1a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 --2- 172.21.15.1:0/2520172936 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbbc10a160 0x7ffbbc1a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 >> 172.21.15.1:0/2520172936 conn(0x7ffbbc0705b0 msgr2=0x7ffbbc10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 shutdown_connections 2024-08-28T20:25:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:29.628+0000 7ffbc3000640 1 -- 172.21.15.1:0/2520172936 wait complete. 2024-08-28T20:25:30.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: Unable to set osd_memory_target on smithi121 to 184532992: error parsing value: Value '184532992' is below minimum 939524096 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: Unable to set osd_memory_target on smithi007 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.5 MiB/s wr, 664 op/s 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:25:30.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:25:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-08-28T20:25:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: Unable to set osd_memory_target on smithi121 to 184532992: error parsing value: Value '184532992' is below minimum 939524096 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: Unable to set osd_memory_target on smithi007 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.5 MiB/s wr, 664 op/s 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:25:30.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: Unable to set osd_memory_target on smithi121 to 184532992: error parsing value: Value '184532992' is below minimum 939524096 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: Unable to set osd_memory_target on smithi007 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.5 MiB/s wr, 664 op/s 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:25:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:25:30.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:25:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:31 smithi001 ceph-mon[20984]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-08-28T20:25:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:31 smithi121 ceph-mon[25248]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-08-28T20:25:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:31 smithi007 ceph-mon[25357]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-08-28T20:25:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 425.0 s, 2420.9 tps, lat 41.803 ms stddev 47.817 2024-08-28T20:25:34.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:33 smithi001 ceph-mon[20984]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 637 op/s 2024-08-28T20:25:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:33 smithi121 ceph-mon[25248]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 637 op/s 2024-08-28T20:25:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:33 smithi007 ceph-mon[25357]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 637 op/s 2024-08-28T20:25:35.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:34 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:35.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:34 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:35.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:34 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:25:36.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:35 smithi001 ceph-mon[20984]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-08-28T20:25:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:35 smithi121 ceph-mon[25248]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-08-28T20:25:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:35 smithi007 ceph-mon[25357]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-08-28T20:25:38.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:37 smithi001 ceph-mon[20984]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 706 op/s 2024-08-28T20:25:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:37 smithi121 ceph-mon[25248]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 706 op/s 2024-08-28T20:25:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:37 smithi007 ceph-mon[25357]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 706 op/s 2024-08-28T20:25:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 430.0 s, 2021.6 tps, lat 49.340 ms stddev 55.803 2024-08-28T20:25:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:39 smithi001 ceph-mon[20984]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 724 op/s 2024-08-28T20:25:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:39 smithi121 ceph-mon[25248]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 724 op/s 2024-08-28T20:25:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:39 smithi007 ceph-mon[25357]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 724 op/s 2024-08-28T20:25:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:41 smithi001 ceph-mon[20984]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 776 op/s 2024-08-28T20:25:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:41 smithi121 ceph-mon[25248]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 776 op/s 2024-08-28T20:25:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:41 smithi007 ceph-mon[25357]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 776 op/s 2024-08-28T20:25:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.932+0000 7fecd8200640 1 -- 172.21.15.1:0/184493329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 msgr2=0x7fecd0106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.932+0000 7fecd8200640 1 --2- 172.21.15.1:0/184493329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 0x7fecd0106b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009900 tx=0x7fecc002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.933+0000 7fecd8200640 1 -- 172.21.15.1:0/184493329 shutdown_connections 2024-08-28T20:25:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.933+0000 7fecd8200640 1 --2- 172.21.15.1:0/184493329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.933+0000 7fecd8200640 1 --2- 172.21.15.1:0/184493329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 0x7fecd0106b10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.933+0000 7fecd8200640 1 --2- 172.21.15.1:0/184493329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 0x7fecd0105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.933+0000 7fecd8200640 1 -- 172.21.15.1:0/184493329 >> 172.21.15.1:0/184493329 conn(0x7fecd0101000 msgr2=0x7fecd0103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.934+0000 7fecd8200640 1 -- 172.21.15.1:0/184493329 shutdown_connections 2024-08-28T20:25:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.934+0000 7fecd8200640 1 -- 172.21.15.1:0/184493329 wait complete. 2024-08-28T20:25:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.936+0000 7fecd8200640 1 Processor -- start 2024-08-28T20:25:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.936+0000 7fecd8200640 1 -- start start 2024-08-28T20:25:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd8200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 0x7fecd00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 0x7fecd0072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd8200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd0073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd8200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fecd01112d0 con 0x7fecd01070a0 2024-08-28T20:25:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd8200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fecd0111150 con 0x7fecd0106700 2024-08-28T20:25:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd8200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fecd0111450 con 0x7fecd0105680 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd6200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd0073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd6200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd0073310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60132/0 (socket says 172.21.15.1:60132) 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd6200640 1 -- 172.21.15.1:0/1173114366 learned_addr learned my addr 172.21.15.1:0/1173114366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.937+0000 7fecd5800640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 0x7fecd00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd5800640 1 -- 172.21.15.1:0/1173114366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 msgr2=0x7fecd0072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd5800640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 0x7fecd0072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd5800640 1 -- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 msgr2=0x7fecd0073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd5800640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd0073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd5800640 1 -- 172.21.15.1:0/1173114366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd0073b30 con 0x7fecd0105680 2024-08-28T20:25:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd6200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd0073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.938+0000 7fecd5800640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 0x7fecd00720f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009fd0 tx=0x7fecc800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.939+0000 7fecce000640 1 -- 172.21.15.1:0/1173114366 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8004b20 con 0x7fecd0105680 2024-08-28T20:25:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.939+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd0073e20 con 0x7fecd0105680 2024-08-28T20:25:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.939+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd00744e0 con 0x7fecd0105680 2024-08-28T20:25:42.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.940+0000 7fecce000640 1 -- 172.21.15.1:0/1173114366 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc8004cc0 con 0x7fecd0105680 2024-08-28T20:25:42.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.940+0000 7fecce000640 1 -- 172.21.15.1:0/1173114366 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8010720 con 0x7fecd0105680 2024-08-28T20:25:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.944+0000 7fecdf230740 1 Processor -- start 2024-08-28T20:25:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 -- start start 2024-08-28T20:25:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e95c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e96790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55daa1dfff70 con 0x55daa1ac64d0 2024-08-28T20:25:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55daa1def500 con 0x55daa1ae71b0 2024-08-28T20:25:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.945+0000 7fecdf230740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55daa1df34b0 con 0x55daa1abe2f0 2024-08-28T20:25:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.946+0000 7fecd6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.946+0000 7fecd6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39014/0 (socket says 172.21.15.1:39014) 2024-08-28T20:25:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.946+0000 7fecd6200640 1 -- 172.21.15.1:0/179081315 learned_addr learned my addr 172.21.15.1:0/179081315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecd6200640 1 -- 172.21.15.1:0/179081315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 msgr2=0x55daa1e95c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecd6200640 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e95c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecd6200640 1 -- 172.21.15.1:0/179081315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 msgr2=0x55daa1e96790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecd6200640 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e96790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecd6200640 1 -- 172.21.15.1:0/179081315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daa1da9c10 con 0x55daa1ae71b0 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecce000640 1 -- 172.21.15.1:0/1173114366 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fecc80108c0 con 0x7fecd0105680 2024-08-28T20:25:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.947+0000 7fecd6200640 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e955d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fecc4011600 tx=0x7fecc4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ab4035835c052a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.948+0000 7fecbea00640 1 -- 172.21.15.1:0/179081315 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc401e070 con 0x55daa1ae71b0 2024-08-28T20:25:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.948+0000 7fecbea00640 1 -- 172.21.15.1:0/179081315 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc400faf0 con 0x55daa1ae71b0 2024-08-28T20:25:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.948+0000 7fecbea00640 1 -- 172.21.15.1:0/179081315 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4019b90 con 0x55daa1ae71b0 2024-08-28T20:25:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.951+0000 7fecdf230740 1 -- 172.21.15.1:0/179081315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 msgr2=0x55daa1e955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.951+0000 7fecdf230740 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e955d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fecc4011600 tx=0x7fecc4009f90 comp rx=0 tx=0).stop 2024-08-28T20:25:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.952+0000 7fecdf230740 1 -- 172.21.15.1:0/179081315 shutdown_connections 2024-08-28T20:25:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.952+0000 7fecdf230740 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e96790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.952+0000 7fecdf230740 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e95c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.952+0000 7fecdf230740 1 --2- 172.21.15.1:0/179081315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e955d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.952+0000 7fecdf230740 1 -- 172.21.15.1:0/179081315 >> 172.21.15.1:0/179081315 conn(0x55daa1adb300 msgr2=0x55daa1e88850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.954+0000 7fecdf230740 1 -- 172.21.15.1:0/179081315 shutdown_connections 2024-08-28T20:25:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.954+0000 7fecce000640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fecb80b4b40 0x7fecb80b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.954+0000 7fecce000640 1 -- 172.21.15.1:0/1173114366 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fecc80e5980 con 0x7fecd0105680 2024-08-28T20:25:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.955+0000 7fecdf230740 1 -- 172.21.15.1:0/179081315 wait complete. 2024-08-28T20:25:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.956+0000 7fecdf230740 1 -- start start 2024-08-28T20:25:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.956+0000 7fecdf230740 1 Processor -- start 2024-08-28T20:25:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.956+0000 7fecd4e00640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fecb80b4b40 0x7fecb80b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.957+0000 7fecd4e00640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fecb80b4b40 0x7fecb80b7050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005940 tx=0x7fecc0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e9ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e9f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e9ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55daa1d28ab0 con 0x55daa1ac64d0 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55daa1d96320 con 0x55daa1ae71b0 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55daa1e972b0 con 0x55daa1abe2f0 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecdf230740 10 client.0 _ll_register_callbacks cb 0x55daa1d9c6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e9ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e9ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e9ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39024/0 (socket says 172.21.15.1:39024) 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 -- 172.21.15.1:0/303247739 learned_addr learned my addr 172.21.15.1:0/303247739 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd4e00640 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e9f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 -- 172.21.15.1:0/303247739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 msgr2=0x55daa1e9ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e9ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 -- 172.21.15.1:0/303247739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 msgr2=0x55daa1e9f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.958+0000 7fecd6200640 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e9f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.959+0000 7fecd6200640 1 -- 172.21.15.1:0/303247739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daa1b52790 con 0x55daa1ae71b0 2024-08-28T20:25:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.959+0000 7fecd6200640 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e9ff50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fecc400f8a0 tx=0x7fecc400f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f4a32814365056 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.959+0000 7fecb3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:25:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.959+0000 7fecb3400640 1 -- 172.21.15.1:0/303247739 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc401e070 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.959+0000 7fecb3400640 1 -- 172.21.15.1:0/303247739 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fecc4019ae0 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.959+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc400faf0 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.960+0000 7fecb3400640 1 -- 172.21.15.1:0/303247739 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fecc4019ce0 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.960+0000 7fecdf230740 10 client.25772 fetch_fsmap learned FSMap version 44 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.960+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55daa1bcb620 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.960+0000 7fecb3400640 1 -- 172.21.15.1:0/303247739 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc400faf0 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecb3400640 1 -- 172.21.15.1:0/303247739 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fecc402c020 con 0x55daa1ae71b0 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecdf230740 10 client.25772 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecdf230740 10 client.25772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecdf230740 20 client.25772 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecdf230740 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1aa5d80 0x55daa1eac190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecdf230740 4 client.25772 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:25:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daa1e01ec0 con 0x55daa1aa5d80 2024-08-28T20:25:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.961+0000 7fecd5800640 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1aa5d80 0x55daa1eac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.962+0000 7fecb3400640 10 client.25772 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.962+0000 7fecd5800640 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1aa5d80 0x55daa1eac190 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1731939e12dedf1d server_cookie=333aebc775aff604 in_seq=0 out_seq=0 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.962+0000 7fecb3400640 1 -- 172.21.15.1:0/303247739 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55daa1e01ec0 con 0x55daa1aa5d80 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.962+0000 7fecb3400640 10 client.25772 handle_command_reply: tid=0 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 client.25772 shutdown 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 msgr2=0x55daa1e9ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e9ff50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fecc400f8a0 tx=0x7fecc400f8d0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 shutdown_connections 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1aa5d80 0x55daa1eac190 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1e9f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecb3400640 0 client.25772 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1e9ff50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 --2- 172.21.15.1:0/303247739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1e9ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 >> 172.21.15.1:0/303247739 conn(0x55daa1adb300 msgr2=0x55daa1e86cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.963+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 shutdown_connections 2024-08-28T20:25:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.964+0000 7fecdf230740 1 -- 172.21.15.1:0/303247739 wait complete. 2024-08-28T20:25:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:42.964+0000 7fecdf230740 20 client.25772 trim_cache size 0 max 16384 2024-08-28T20:25:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.000+0000 7fecdf230740 1 Processor -- start 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 -- start start 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 0x55daa1e9a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1ac64d0 0x55daa1e96530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ae71b0 0x55daa1e9d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fecd01b3ca0 con 0x55daa1ae71b0 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fecd01b1510 con 0x55daa1abe2f0 2024-08-28T20:25:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecdf230740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fecd007b7f0 con 0x55daa1ac64d0 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecd5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 0x55daa1e9a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecd5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 0x55daa1e9a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39038/0 (socket says 172.21.15.1:39038) 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.001+0000 7fecd5800640 1 -- 172.21.15.1:0/4195186262 learned_addr learned my addr 172.21.15.1:0/4195186262 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd4e00640 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1ac64d0 0x55daa1e96530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd5800640 1 -- 172.21.15.1:0/4195186262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1ac64d0 msgr2=0x55daa1e96530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd5800640 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1ac64d0 0x55daa1e96530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd5800640 1 -- 172.21.15.1:0/4195186262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ae71b0 msgr2=0x55daa1e9d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd5800640 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ae71b0 0x55daa1e9d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd5800640 1 -- 172.21.15.1:0/4195186262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daa1e82990 con 0x55daa1abe2f0 2024-08-28T20:25:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.002+0000 7fecd4e00640 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1ac64d0 0x55daa1e96530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:25:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.003+0000 7fecd5800640 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 0x55daa1e9a0e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fecc80a8580 tx=0x7fecc80cf040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a73b63113adf0ea4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.003+0000 7fecbe000640 1 -- 172.21.15.1:0/4195186262 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80b2030 con 0x55daa1abe2f0 2024-08-28T20:25:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.003+0000 7fecbe000640 1 -- 172.21.15.1:0/4195186262 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc80e3520 con 0x55daa1abe2f0 2024-08-28T20:25:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.003+0000 7fecbe000640 1 -- 172.21.15.1:0/4195186262 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80a80d0 con 0x55daa1abe2f0 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 -- 172.21.15.1:0/4195186262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 msgr2=0x55daa1e9a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 0x55daa1e9a0e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fecc80a8580 tx=0x7fecc80cf040 comp rx=0 tx=0).stop 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 -- 172.21.15.1:0/4195186262 shutdown_connections 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ae71b0 0x55daa1e9d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1ac64d0 0x55daa1e96530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 --2- 172.21.15.1:0/4195186262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1abe2f0 0x55daa1e9a0e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.004+0000 7fecdf230740 1 -- 172.21.15.1:0/4195186262 >> 172.21.15.1:0/4195186262 conn(0x55daa1adb300 msgr2=0x55daa1e86cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.005+0000 7fecdf230740 1 -- 172.21.15.1:0/4195186262 shutdown_connections 2024-08-28T20:25:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.005+0000 7fecdf230740 1 -- 172.21.15.1:0/4195186262 wait complete. 2024-08-28T20:25:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.005+0000 7fecdf230740 1 -- start start 2024-08-28T20:25:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.005+0000 7fecdf230740 1 Processor -- start 2024-08-28T20:25:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1ea6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1ea5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1ea5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fecd01af9d0 con 0x55daa1ac64d0 2024-08-28T20:25:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fecd01b0e40 con 0x55daa1ae71b0 2024-08-28T20:25:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fecd01b00a0 con 0x55daa1abe2f0 2024-08-28T20:25:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecdf230740 10 client.0 _ll_register_callbacks cb 0x7fecc4019450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecd4e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1ea5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecd6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1ea5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecd4e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1ea5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60164/0 (socket says 172.21.15.1:60164) 2024-08-28T20:25:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecd4e00640 1 -- 172.21.15.1:0/261659076 learned_addr learned my addr 172.21.15.1:0/261659076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.006+0000 7fecd5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1ea6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.007+0000 7fecd6200640 1 -- 172.21.15.1:0/261659076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 msgr2=0x55daa1ea6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.007+0000 7fecd6200640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1ea6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.007+0000 7fecd6200640 1 -- 172.21.15.1:0/261659076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 msgr2=0x55daa1ea5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.007+0000 7fecd6200640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1ea5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.007+0000 7fecd6200640 1 -- 172.21.15.1:0/261659076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daa1ea5eb0 con 0x55daa1ae71b0 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.008+0000 7fecd5800640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1ea6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.008+0000 7fecd4e00640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1ea5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.009+0000 7fecd6200640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1ea5940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecc4005bc0 tx=0x7fecc400fc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f388309518fa6c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.009+0000 7fecb3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.010+0000 7fecb3400640 1 -- 172.21.15.1:0/261659076 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc401e030 con 0x55daa1ae71b0 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.010+0000 7fecb3400640 1 -- 172.21.15.1:0/261659076 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fecc4005210 con 0x55daa1ae71b0 2024-08-28T20:25:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.010+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc80e3520 con 0x55daa1ae71b0 2024-08-28T20:25:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.010+0000 7fecb3400640 1 -- 172.21.15.1:0/261659076 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fecc4009e70 con 0x55daa1ae71b0 2024-08-28T20:25:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.011+0000 7fecdf230740 10 client.25778 fetch_fsmap learned FSMap version 44 2024-08-28T20:25:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.011+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55daa1ea4ce0 con 0x55daa1ae71b0 2024-08-28T20:25:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.011+0000 7fecb3400640 1 -- 172.21.15.1:0/261659076 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc80e3520 con 0x55daa1ae71b0 2024-08-28T20:25:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecb3400640 1 -- 172.21.15.1:0/261659076 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fecc4036070 con 0x55daa1ae71b0 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecdf230740 10 client.25778 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecdf230740 10 client.25778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecdf230740 20 client.25778 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecdf230740 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1a7b1c0 0x55daa1f191b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecdf230740 4 client.25778 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55daa1dfd960 con 0x55daa1a7b1c0 2024-08-28T20:25:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.012+0000 7fecd5800640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1a7b1c0 0x55daa1f191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.013+0000 7fecd5800640 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1a7b1c0 0x55daa1f191b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be13cb2112ba3d2 server_cookie=a123c28f60e81cd0 in_seq=0 out_seq=0 2024-08-28T20:25:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.013+0000 7fecb3400640 10 client.25778 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecb3400640 1 -- 172.21.15.1:0/261659076 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55daa1dfd960 con 0x55daa1a7b1c0 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecb3400640 10 client.25778 handle_command_reply: tid=0 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 client.25778 shutdown 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 msgr2=0x55daa1ea5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1ea5940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecc4005bc0 tx=0x7fecc400fc20 comp rx=0 tx=0).stop 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 shutdown_connections 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55daa1a7b1c0 0x55daa1f191b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55daa1ac64d0 0x55daa1ea5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55daa1ae71b0 0x55daa1ea5940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 --2- 172.21.15.1:0/261659076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55daa1abe2f0 0x55daa1ea6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 >> 172.21.15.1:0/261659076 conn(0x55daa1adb300 msgr2=0x55daa1e9d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecb3400640 0 client.25778 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.028+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 shutdown_connections 2024-08-28T20:25:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.029+0000 7fecdf230740 1 -- 172.21.15.1:0/261659076 wait complete. 2024-08-28T20:25:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.029+0000 7fecdf230740 20 client.25778 trim_cache size 0 max 16384 2024-08-28T20:25:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.030+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fecb80b4b40 msgr2=0x7fecb80b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.030+0000 7fecd8200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fecb80b4b40 0x7fecb80b7050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005940 tx=0x7fecc0000bc0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.030+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 msgr2=0x7fecd00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.030+0000 7fecd8200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 0x7fecd00720f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009fd0 tx=0x7fecc800ef90 comp rx=0 tx=0).stop 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 shutdown_connections 2024-08-28T20:25:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fecb80b4b40 0x7fecb80b7050 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecd01070a0 0x7fecd0073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecd0106700 0x7fecd0072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 --2- 172.21.15.1:0/1173114366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecd0105680 0x7fecd00720f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 >> 172.21.15.1:0/1173114366 conn(0x7fecd0101000 msgr2=0x7fecd0109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.031+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 shutdown_connections 2024-08-28T20:25:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:43.032+0000 7fecd8200640 1 -- 172.21.15.1:0/1173114366 wait complete. 2024-08-28T20:25:43.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 435.0 s, 2079.2 tps, lat 47.609 ms stddev 57.004 2024-08-28T20:25:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:43 smithi001 ceph-mon[20984]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 674 op/s 2024-08-28T20:25:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:43 smithi121 ceph-mon[25248]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 674 op/s 2024-08-28T20:25:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:43 smithi007 ceph-mon[25357]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 674 op/s 2024-08-28T20:25:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:45 smithi001 ceph-mon[20984]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 800 op/s 2024-08-28T20:25:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:45 smithi121 ceph-mon[25248]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 800 op/s 2024-08-28T20:25:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:45 smithi007 ceph-mon[25357]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 800 op/s 2024-08-28T20:25:48.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:47 smithi001 ceph-mon[20984]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.3 MiB/s wr, 724 op/s 2024-08-28T20:25:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:47 smithi121 ceph-mon[25248]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.3 MiB/s wr, 724 op/s 2024-08-28T20:25:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:47 smithi007 ceph-mon[25357]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.3 MiB/s wr, 724 op/s 2024-08-28T20:25:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 440.0 s, 2214.0 tps, lat 45.557 ms stddev 55.785 2024-08-28T20:25:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:49 smithi001 ceph-mon[20984]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 MiB/s wr, 730 op/s 2024-08-28T20:25:50.232 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:49 smithi121 ceph-mon[25248]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 MiB/s wr, 730 op/s 2024-08-28T20:25:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:49 smithi007 ceph-mon[25357]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 MiB/s wr, 730 op/s 2024-08-28T20:25:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:51 smithi121 ceph-mon[25248]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.2 MiB/s wr, 753 op/s 2024-08-28T20:25:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:51 smithi007 ceph-mon[25357]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.2 MiB/s wr, 753 op/s 2024-08-28T20:25:52.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:51 smithi001 ceph-mon[20984]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.2 MiB/s wr, 753 op/s 2024-08-28T20:25:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 445.0 s, 2220.2 tps, lat 44.666 ms stddev 55.060 2024-08-28T20:25:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:53 smithi007 ceph-mon[25357]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.0 MiB/s wr, 636 op/s 2024-08-28T20:25:54.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:53 smithi001 ceph-mon[20984]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.0 MiB/s wr, 636 op/s 2024-08-28T20:25:54.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:53 smithi121 ceph-mon[25248]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.0 MiB/s wr, 636 op/s 2024-08-28T20:25:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:55 smithi007 ceph-mon[25357]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 735 op/s 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.349+0000 7f912cc00640 1 -- 172.21.15.1:0/3392600201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f912806b620 msgr2=0x7f9128103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.349+0000 7f912cc00640 1 --2- 172.21.15.1:0/3392600201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f912806b620 0x7f9128103ca0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9118009860 tx=0x7f911802a340 comp rx=0 tx=0).stop 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 -- 172.21.15.1:0/3392600201 shutdown_connections 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 --2- 172.21.15.1:0/3392600201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91281041e0 0x7f9128106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 --2- 172.21.15.1:0/3392600201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9128106da0 0x7f91281072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 --2- 172.21.15.1:0/3392600201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f912806b620 0x7f9128103ca0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 -- 172.21.15.1:0/3392600201 >> 172.21.15.1:0/3392600201 conn(0x7f91280fdab0 msgr2=0x7f91280fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 -- 172.21.15.1:0/3392600201 shutdown_connections 2024-08-28T20:25:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.350+0000 7f912cc00640 1 -- 172.21.15.1:0/3392600201 wait complete. 2024-08-28T20:25:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.351+0000 7f912cc00640 1 Processor -- start 2024-08-28T20:25:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 -- start start 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912806b620 0x7f91281a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 0x7f91281a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128106da0 0x7f91281a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91281154d0 con 0x7f9128106da0 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9128115350 con 0x7f912806b620 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f912cc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9128115650 con 0x7f91281041e0 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f9127400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912806b620 0x7f91281a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f9126a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 0x7f91281a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.352+0000 7f9126a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 0x7f91281a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:56184/0 (socket says 172.21.15.1:56184) 2024-08-28T20:25:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9126a00640 1 -- 172.21.15.1:0/2003856080 learned_addr learned my addr 172.21.15.1:0/2003856080 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9127e00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128106da0 0x7f91281a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9126a00640 1 -- 172.21.15.1:0/2003856080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912806b620 msgr2=0x7f91281a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9126a00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912806b620 0x7f91281a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9126a00640 1 -- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128106da0 msgr2=0x7f91281a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9126a00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128106da0 0x7f91281a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9126a00640 1 -- 172.21.15.1:0/2003856080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91281a1ba0 con 0x7f91281041e0 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9127400640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912806b620 0x7f91281a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.353+0000 7f9127e00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128106da0 0x7f91281a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.354+0000 7f9126a00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 0x7f91281a07d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f911400e9f0 tx=0x7f911400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.354+0000 7f911fe00640 1 -- 172.21.15.1:0/2003856080 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911400ccc0 con 0x7f91281041e0 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.354+0000 7f911fe00640 1 -- 172.21.15.1:0/2003856080 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91140108e0 con 0x7f91281041e0 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.354+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281a1e90 con 0x7f91281041e0 2024-08-28T20:25:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.354+0000 7f911fe00640 1 -- 172.21.15.1:0/2003856080 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114018880 con 0x7f91281041e0 2024-08-28T20:25:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.354+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91281a8580 con 0x7f91281041e0 2024-08-28T20:25:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.358+0000 7f913524d740 1 Processor -- start 2024-08-28T20:25:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 -- start start 2024-08-28T20:25:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f911fe00640 1 -- 172.21.15.1:0/2003856080 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f9114018a20 con 0x7f91281041e0 2024-08-28T20:25:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cf10637f70 con 0x55cf102fe4d0 2024-08-28T20:25:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf10627500 con 0x55cf1031f1b0 2024-08-28T20:25:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.361+0000 7f913524d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf1062b4b0 con 0x55cf102f62f0 2024-08-28T20:25:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:56188/0 (socket says 172.21.15.1:56188) 2024-08-28T20:25:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 -- 172.21.15.1:0/523084364 learned_addr learned my addr 172.21.15.1:0/523084364 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127e00640 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 -- 172.21.15.1:0/523084364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 msgr2=0x55cf106c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 -- 172.21.15.1:0/523084364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 msgr2=0x55cf106c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.362+0000 7f9127400640 1 -- 172.21.15.1:0/523084364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf105e1c10 con 0x55cf102f62f0 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.363+0000 7f9127400640 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106c5610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9118009830 tx=0x7f9118005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f92cd4cdf7f79f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.363+0000 7f911fe00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f910c0b4ba0 0x7f910c0b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.363+0000 7f9113e00640 1 -- 172.21.15.1:0/523084364 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118041020 con 0x55cf102f62f0 2024-08-28T20:25:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.363+0000 7f9113e00640 1 -- 172.21.15.1:0/523084364 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9118030dd0 con 0x55cf102f62f0 2024-08-28T20:25:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.363+0000 7f9113e00640 1 -- 172.21.15.1:0/523084364 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118037040 con 0x55cf102f62f0 2024-08-28T20:25:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.363+0000 7f911fe00640 1 -- 172.21.15.1:0/2003856080 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f91140e5420 con 0x7f91281041e0 2024-08-28T20:25:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.364+0000 7f9127e00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f910c0b4ba0 0x7f910c0b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.366+0000 7f913524d740 1 -- 172.21.15.1:0/523084364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 msgr2=0x55cf106c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.366+0000 7f913524d740 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106c5610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9118009830 tx=0x7f9118005d30 comp rx=0 tx=0).stop 2024-08-28T20:25:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.366+0000 7f9127e00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f910c0b4ba0 0x7f910c0b70b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9120005fd0 tx=0x7f9120009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 -- 172.21.15.1:0/523084364 shutdown_connections 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106c5610 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 --2- 172.21.15.1:0/523084364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 -- 172.21.15.1:0/523084364 >> 172.21.15.1:0/523084364 conn(0x55cf10313300 msgr2=0x55cf106c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 -- 172.21.15.1:0/523084364 shutdown_connections 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 -- 172.21.15.1:0/523084364 wait complete. 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.368+0000 7f913524d740 1 -- start start 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 Processor -- start 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cf10560ab0 con 0x55cf102fe4d0 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf105ce320 con 0x55cf1031f1b0 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf106c6c20 con 0x55cf102f62f0 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.369+0000 7f913524d740 10 client.0 _ll_register_callbacks cb 0x55cf105d46a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:56198/0 (socket says 172.21.15.1:56198) 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 -- 172.21.15.1:0/3901826455 learned_addr learned my addr 172.21.15.1:0/3901826455 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127e00640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9126a00640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 -- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 msgr2=0x55cf106cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 -- 172.21.15.1:0/3901826455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 msgr2=0x55cf106ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.370+0000 7f9127400640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.371+0000 7f9127400640 1 -- 172.21.15.1:0/3901826455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1038a790 con 0x55cf102f62f0 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.371+0000 7f9126a00640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f9127400640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106ce640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9118030930 tx=0x7f9118030960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e14719f680e3995 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f9110c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f9110c00640 1 -- 172.21.15.1:0/3901826455 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911804c070 con 0x55cf102f62f0 2024-08-28T20:25:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f9110c00640 1 -- 172.21.15.1:0/3901826455 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f9118004040 con 0x55cf102f62f0 2024-08-28T20:25:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9118030dd0 con 0x55cf102f62f0 2024-08-28T20:25:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f9110c00640 1 -- 172.21.15.1:0/3901826455 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9118058050 con 0x55cf102f62f0 2024-08-28T20:25:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f913524d740 10 client.25762 fetch_fsmap learned FSMap version 44 2024-08-28T20:25:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.372+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cf10403620 con 0x55cf102f62f0 2024-08-28T20:25:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f9110c00640 1 -- 172.21.15.1:0/3901826455 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9118030dd0 con 0x55cf102f62f0 2024-08-28T20:25:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f9110c00640 1 -- 172.21.15.1:0/3901826455 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f9118003c30 con 0x55cf102f62f0 2024-08-28T20:25:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f913524d740 10 client.25762 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:25:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f913524d740 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f913524d740 20 client.25762 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f913524d740 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102ddd80 0x55cf106db950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f913524d740 4 client.25762 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:25:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.373+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf10639ec0 con 0x55cf102ddd80 2024-08-28T20:25:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.374+0000 7f9126a00640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102ddd80 0x55cf106db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.377+0000 7f9126a00640 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102ddd80 0x55cf106db950 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35025dca08ae3410 server_cookie=43c79b9abc5621e in_seq=0 out_seq=0 2024-08-28T20:25:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.377+0000 7f9110c00640 10 client.25762 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.378+0000 7f9110c00640 1 -- 172.21.15.1:0/3901826455 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf10639ec0 con 0x55cf102ddd80 2024-08-28T20:25:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.378+0000 7f9110c00640 10 client.25762 handle_command_reply: tid=0 2024-08-28T20:25:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.378+0000 7f913524d740 1 client.25762 shutdown 2024-08-28T20:25:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 msgr2=0x55cf106ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106ce640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9118030930 tx=0x7f9118030960 comp rx=0 tx=0).stop 2024-08-28T20:25:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 shutdown_connections 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102ddd80 0x55cf106db950 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102fe4d0 0x55cf106ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 --2- 172.21.15.1:0/3901826455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106ce640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 >> 172.21.15.1:0/3901826455 conn(0x55cf10313300 msgr2=0x55cf106bef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f9110c00640 0 client.25762 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 shutdown_connections 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.379+0000 7f913524d740 1 -- 172.21.15.1:0/3901826455 wait complete. 2024-08-28T20:25:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.380+0000 7f913524d740 20 client.25762 trim_cache size 0 max 16384 2024-08-28T20:25:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.403+0000 7f913524d740 1 Processor -- start 2024-08-28T20:25:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 -- start start 2024-08-28T20:25:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102f62f0 0x55cf106cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102fe4d0 0x55cf106d6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91281b3b00 con 0x55cf102f62f0 2024-08-28T20:25:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91281b1370 con 0x55cf1031f1b0 2024-08-28T20:25:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f913524d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91281af1c0 con 0x55cf102fe4d0 2024-08-28T20:25:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f9126a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102fe4d0 0x55cf106d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f9127e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f9127e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47082/0 (socket says 172.21.15.1:47082) 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f9127400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102f62f0 0x55cf106cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.404+0000 7f9127e00640 1 -- 172.21.15.1:0/1410806625 learned_addr learned my addr 172.21.15.1:0/1410806625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127e00640 1 -- 172.21.15.1:0/1410806625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102fe4d0 msgr2=0x55cf106d6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127e00640 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102fe4d0 0x55cf106d6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127e00640 1 -- 172.21.15.1:0/1410806625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102f62f0 msgr2=0x55cf106cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127e00640 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102f62f0 0x55cf106cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127e00640 1 -- 172.21.15.1:0/1410806625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf106cc7d0 con 0x55cf1031f1b0 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127400640 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102f62f0 0x55cf106cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.405+0000 7f9127e00640 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106ccb50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f91200108f0 tx=0x7f9120012f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c0046a49c3cf44 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.406+0000 7f9113400640 1 -- 172.21.15.1:0/1410806625 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120004b20 con 0x55cf1031f1b0 2024-08-28T20:25:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.406+0000 7f9113400640 1 -- 172.21.15.1:0/1410806625 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f912001fde0 con 0x55cf1031f1b0 2024-08-28T20:25:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.406+0000 7f9113400640 1 -- 172.21.15.1:0/1410806625 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120005660 con 0x55cf1031f1b0 2024-08-28T20:25:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 -- 172.21.15.1:0/1410806625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 msgr2=0x55cf106ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106ccb50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f91200108f0 tx=0x7f9120012f90 comp rx=0 tx=0).stop 2024-08-28T20:25:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 -- 172.21.15.1:0/1410806625 shutdown_connections 2024-08-28T20:25:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf1031f1b0 0x55cf106ccb50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102fe4d0 0x55cf106d6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 --2- 172.21.15.1:0/1410806625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf102f62f0 0x55cf106cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.407+0000 7f913524d740 1 -- 172.21.15.1:0/1410806625 >> 172.21.15.1:0/1410806625 conn(0x55cf10313300 msgr2=0x55cf106c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.408+0000 7f913524d740 1 -- 172.21.15.1:0/1410806625 shutdown_connections 2024-08-28T20:25:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.408+0000 7f913524d740 1 -- 172.21.15.1:0/1410806625 wait complete. 2024-08-28T20:25:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.408+0000 7f913524d740 1 -- start start 2024-08-28T20:25:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.408+0000 7f913524d740 1 Processor -- start 2024-08-28T20:25:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.409+0000 7f913524d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106d6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f913524d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 0x55cf106d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f913524d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf1031f1b0 0x55cf106d5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f9126a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 0x55cf106d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f9126a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 0x55cf106d4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47096/0 (socket says 172.21.15.1:47096) 2024-08-28T20:25:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f9127400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f9127400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106d6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:56214/0 (socket says 172.21.15.1:56214) 2024-08-28T20:25:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f913524d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91281af830 con 0x55cf1031f1b0 2024-08-28T20:25:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f913524d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91281b0ca0 con 0x55cf102fe4d0 2024-08-28T20:25:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.410+0000 7f913524d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91281aff00 con 0x55cf102f62f0 2024-08-28T20:25:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9126a00640 1 -- 172.21.15.1:0/1991646704 learned_addr learned my addr 172.21.15.1:0/1991646704 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:25:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f913524d740 10 client.0 _ll_register_callbacks cb 0x7f9118005f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:25:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9126a00640 1 -- 172.21.15.1:0/1991646704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 msgr2=0x55cf106d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9126a00640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106d6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9127e00640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf1031f1b0 0x55cf106d5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9126a00640 1 -- 172.21.15.1:0/1991646704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf1031f1b0 msgr2=0x55cf106d5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9126a00640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf1031f1b0 0x55cf106d5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.411+0000 7f9126a00640 1 -- 172.21.15.1:0/1991646704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf106d5ba0 con 0x55cf102fe4d0 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.412+0000 7f9127e00640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf1031f1b0 0x55cf106d5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.412+0000 7f9110c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.412+0000 7f9126a00640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 0x55cf106d4ff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91140a90b0 tx=0x7f91140a7df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8a1e2f0d628b5a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f9110c00640 1 -- 172.21.15.1:0/1991646704 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140ae070 con 0x55cf102fe4d0 2024-08-28T20:25:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f9110c00640 1 -- 172.21.15.1:0/1991646704 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f9114010a90 con 0x55cf102fe4d0 2024-08-28T20:25:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912001fde0 con 0x55cf102fe4d0 2024-08-28T20:25:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f9110c00640 1 -- 172.21.15.1:0/1991646704 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f91140b06b0 con 0x55cf102fe4d0 2024-08-28T20:25:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f913524d740 10 client.25796 fetch_fsmap learned FSMap version 44 2024-08-28T20:25:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cf107462c0 con 0x55cf102fe4d0 2024-08-28T20:25:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f9110c00640 1 -- 172.21.15.1:0/1991646704 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f912001fde0 con 0x55cf102fe4d0 2024-08-28T20:25:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.413+0000 7f9110c00640 1 -- 172.21.15.1:0/1991646704 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f91140b0220 con 0x55cf102fe4d0 2024-08-28T20:25:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f913524d740 10 client.25796 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:25:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f913524d740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:25:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f913524d740 20 client.25796 populate_metadata read hostname 'smithi001' 2024-08-28T20:25:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f913524d740 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102b31c0 0x55cf10748bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:25:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f913524d740 4 client.25796 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:25:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf10635960 con 0x55cf102b31c0 2024-08-28T20:25:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f9127400640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102b31c0 0x55cf10748bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:25:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f9127400640 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102b31c0 0x55cf10748bf0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee163e4934512274 server_cookie=40359621fb51d2a4 in_seq=0 out_seq=0 2024-08-28T20:25:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.414+0000 7f9110c00640 10 client.25796 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.431+0000 7f9110c00640 1 -- 172.21.15.1:0/1991646704 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf10635960 con 0x55cf102b31c0 2024-08-28T20:25:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.431+0000 7f9110c00640 10 client.25796 handle_command_reply: tid=0 2024-08-28T20:25:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.431+0000 7f913524d740 1 client.25796 shutdown 2024-08-28T20:25:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 msgr2=0x55cf106d4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 0x55cf106d4ff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91140a90b0 tx=0x7f91140a7df0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 shutdown_connections 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cf102b31c0 0x55cf10748bf0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cf1031f1b0 0x55cf106d5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf102fe4d0 0x55cf106d4ff0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 --2- 172.21.15.1:0/1991646704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf102f62f0 0x55cf106d6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 >> 172.21.15.1:0/1991646704 conn(0x55cf10313300 msgr2=0x55cf106cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f9110c00640 0 client.25796 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.432+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 shutdown_connections 2024-08-28T20:25:56.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.433+0000 7f913524d740 1 -- 172.21.15.1:0/1991646704 wait complete. 2024-08-28T20:25:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.433+0000 7f913524d740 20 client.25796 trim_cache size 0 max 16384 2024-08-28T20:25:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:25:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:25:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:25:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:25:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f910c0b4ba0 msgr2=0x7f910c0b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f910c0b4ba0 0x7f910c0b70b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9120005fd0 tx=0x7f9120009500 comp rx=0 tx=0).stop 2024-08-28T20:25:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 msgr2=0x7f91281a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 0x7f91281a07d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f911400e9f0 tx=0x7f911400eeb0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 shutdown_connections 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f910c0b4ba0 0x7f910c0b70b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9128106da0 0x7f91281a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91281041e0 0x7f91281a07d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.434+0000 7f912cc00640 1 --2- 172.21.15.1:0/2003856080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f912806b620 0x7f91281a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.435+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 >> 172.21.15.1:0/2003856080 conn(0x7f91280fdab0 msgr2=0x7f9128105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:25:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.435+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 shutdown_connections 2024-08-28T20:25:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:25:56.435+0000 7f912cc00640 1 -- 172.21.15.1:0/2003856080 wait complete. 2024-08-28T20:25:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:55 smithi001 ceph-mon[20984]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 735 op/s 2024-08-28T20:25:56.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:55 smithi121 ceph-mon[25248]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 735 op/s 2024-08-28T20:25:58.279 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:57 smithi001 ceph-mon[20984]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.5 MiB/s wr, 677 op/s 2024-08-28T20:25:58.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:57 smithi007 ceph-mon[25357]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.5 MiB/s wr, 677 op/s 2024-08-28T20:25:58.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:57 smithi121 ceph-mon[25248]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.5 MiB/s wr, 677 op/s 2024-08-28T20:25:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 450.0 s, 2268.0 tps, lat 44.428 ms stddev 56.557 2024-08-28T20:26:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:25:59 smithi007 ceph-mon[25357]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.7 MiB/s wr, 676 op/s 2024-08-28T20:26:00.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:25:59 smithi001 ceph-mon[20984]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.7 MiB/s wr, 676 op/s 2024-08-28T20:26:00.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:25:59 smithi121 ceph-mon[25248]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.7 MiB/s wr, 676 op/s 2024-08-28T20:26:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:02 smithi007 ceph-mon[25357]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 689 op/s 2024-08-28T20:26:02.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:02 smithi001 ceph-mon[20984]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 689 op/s 2024-08-28T20:26:02.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:02 smithi121 ceph-mon[25248]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 689 op/s 2024-08-28T20:26:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 455.0 s, 2287.4 tps, lat 43.354 ms stddev 50.871 2024-08-28T20:26:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:04 smithi007 ceph-mon[25357]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.2 MiB/s wr, 633 op/s 2024-08-28T20:26:04.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:04 smithi001 ceph-mon[20984]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.2 MiB/s wr, 633 op/s 2024-08-28T20:26:04.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:04 smithi121 ceph-mon[25248]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.2 MiB/s wr, 633 op/s 2024-08-28T20:26:06.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:06 smithi007 ceph-mon[25357]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-08-28T20:26:06.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:06 smithi001 ceph-mon[20984]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-08-28T20:26:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:06 smithi121 ceph-mon[25248]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-08-28T20:26:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:08 smithi007 ceph-mon[25357]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.8 MiB/s wr, 715 op/s 2024-08-28T20:26:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:08 smithi001 ceph-mon[20984]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.8 MiB/s wr, 715 op/s 2024-08-28T20:26:08.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:08 smithi121 ceph-mon[25248]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.8 MiB/s wr, 715 op/s 2024-08-28T20:26:08.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 460.0 s, 2034.3 tps, lat 49.208 ms stddev 64.055 2024-08-28T20:26:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 -- 172.21.15.1:0/3383499711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c1031f0 msgr2=0x7fbc9c103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3383499711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c1031f0 0x7fbc9c103600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009900 tx=0x7fbc8c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 -- 172.21.15.1:0/3383499711 shutdown_connections 2024-08-28T20:26:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3383499711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c103b90 0x7fbc9c10a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3383499711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c1031f0 0x7fbc9c103600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3383499711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.713+0000 7fbc9be00640 1 -- 172.21.15.1:0/3383499711 >> 172.21.15.1:0/3383499711 conn(0x7fbc9c0fdab0 msgr2=0x7fbc9c0fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.714+0000 7fbc9be00640 1 -- 172.21.15.1:0/3383499711 shutdown_connections 2024-08-28T20:26:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.714+0000 7fbc9be00640 1 -- 172.21.15.1:0/3383499711 wait complete. 2024-08-28T20:26:09.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.715+0000 7fbc9be00640 1 Processor -- start 2024-08-28T20:26:09.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.715+0000 7fbc9be00640 1 -- start start 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c1031f0 0x7fbc9c1a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c103b90 0x7fbc9c1a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9be00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c10de40 con 0x7fbc9c1031f0 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c10dcc0 con 0x7fbc9c102170 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9be00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c10dfc0 con 0x7fbc9c103b90 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51932/0 (socket says 172.21.15.1:51932) 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 -- 172.21.15.1:0/3647462978 learned_addr learned my addr 172.21.15.1:0/3647462978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9b400640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c103b90 0x7fbc9c1a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9a000640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c1031f0 0x7fbc9c1a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 -- 172.21.15.1:0/3647462978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c103b90 msgr2=0x7fbc9c1a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c103b90 0x7fbc9c1a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 -- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c1031f0 msgr2=0x7fbc9c1a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c1031f0 0x7fbc9c1a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.716+0000 7fbc9aa00640 1 -- 172.21.15.1:0/3647462978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9c1a1b60 con 0x7fbc9c102170 2024-08-28T20:26:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.717+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1a0380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800ea60 tx=0x7fbc8800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.717+0000 7fbc93400640 1 -- 172.21.15.1:0/3647462978 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800cde0 con 0x7fbc9c102170 2024-08-28T20:26:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.717+0000 7fbc93400640 1 -- 172.21.15.1:0/3647462978 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc880035f0 con 0x7fbc9c102170 2024-08-28T20:26:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.717+0000 7fbc93400640 1 -- 172.21.15.1:0/3647462978 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88010690 con 0x7fbc9c102170 2024-08-28T20:26:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.717+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9c1a1e50 con 0x7fbc9c102170 2024-08-28T20:26:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.718+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9c1a8540 con 0x7fbc9c102170 2024-08-28T20:26:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.721+0000 7fbc93400640 1 -- 172.21.15.1:0/3647462978 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbc88004020 con 0x7fbc9c102170 2024-08-28T20:26:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.722+0000 7fbca85c6740 1 Processor -- start 2024-08-28T20:26:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.723+0000 7fbca85c6740 1 -- start start 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbc93400640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc800b4ba0 0x7fbc800b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204afafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d20472c2f0 0x55d204afb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204afc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbca85c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d204a6df70 con 0x55d20472c2f0 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbca85c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d204a5d500 con 0x55d2047344d0 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbca85c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d204a614b0 con 0x55d2047551b0 2024-08-28T20:26:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.724+0000 7fbc93400640 1 -- 172.21.15.1:0/3647462978 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbc880e5480 con 0x7fbc9c102170 2024-08-28T20:26:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.725+0000 7fbc9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204afc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.725+0000 7fbc9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204afc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51936/0 (socket says 172.21.15.1:51936) 2024-08-28T20:26:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.725+0000 7fbc9b400640 1 -- 172.21.15.1:0/160353980 learned_addr learned my addr 172.21.15.1:0/160353980 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.725+0000 7fbc9b400640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc800b4ba0 0x7fbc800b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.725+0000 7fbc9a000640 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d20472c2f0 0x55d204afb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.726+0000 7fbc9b400640 1 -- 172.21.15.1:0/160353980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 msgr2=0x55d204afafa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.726+0000 7fbc9b400640 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204afafa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.726+0000 7fbc9b400640 1 -- 172.21.15.1:0/160353980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d20472c2f0 msgr2=0x55d204afb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.726+0000 7fbc9b400640 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d20472c2f0 0x55d204afb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.726+0000 7fbc9b400640 1 -- 172.21.15.1:0/160353980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d204a17c10 con 0x55d2047344d0 2024-08-28T20:26:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.727+0000 7fbc9b400640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc800b4ba0 0x7fbc800b70b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400fc90 tx=0x7fbc94018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.727+0000 7fbc9b400640 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204afc160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc94011e20 tx=0x7fbc9400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4003df127c80715 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.728+0000 7fbc87400640 1 -- 172.21.15.1:0/160353980 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94022070 con 0x55d2047344d0 2024-08-28T20:26:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.728+0000 7fbc87400640 1 -- 172.21.15.1:0/160353980 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9400ed10 con 0x55d2047344d0 2024-08-28T20:26:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.728+0000 7fbc87400640 1 -- 172.21.15.1:0/160353980 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94004290 con 0x55d2047344d0 2024-08-28T20:26:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 -- 172.21.15.1:0/160353980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 msgr2=0x55d204afc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204afc160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc94011e20 tx=0x7fbc9400f790 comp rx=0 tx=0).stop 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 -- 172.21.15.1:0/160353980 shutdown_connections 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d20472c2f0 0x55d204afb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204afc160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 --2- 172.21.15.1:0/160353980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204afafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 -- 172.21.15.1:0/160353980 >> 172.21.15.1:0/160353980 conn(0x55d204749300 msgr2=0x55d204af6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 -- 172.21.15.1:0/160353980 shutdown_connections 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.729+0000 7fbca85c6740 1 -- 172.21.15.1:0/160353980 wait complete. 2024-08-28T20:26:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.730+0000 7fbca85c6740 1 -- start start 2024-08-28T20:26:09.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 Processor -- start 2024-08-28T20:26:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d20472c2f0 0x55d204b04660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204b04d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b05890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d204996ab0 con 0x55d2047551b0 2024-08-28T20:26:09.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d204a04320 con 0x55d2047344d0 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.731+0000 7fbca85c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d204afcc20 con 0x55d20472c2f0 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbca85c6740 10 client.0 _ll_register_callbacks cb 0x55d204a0a6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204b04d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204b04d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51948/0 (socket says 172.21.15.1:51948) 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9a000640 1 -- 172.21.15.1:0/4225282728 learned_addr learned my addr 172.21.15.1:0/4225282728 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d20472c2f0 0x55d204b04660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9b400640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b05890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9aa00640 1 -- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 msgr2=0x55d204b04d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204b04d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.732+0000 7fbc9aa00640 1 -- 172.21.15.1:0/4225282728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 msgr2=0x55d204b05890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b05890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc9aa00640 1 -- 172.21.15.1:0/4225282728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2047c0790 con 0x55d20472c2f0 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc9b400640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b05890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d20472c2f0 0x55d204b04660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800d010 tx=0x7fbc880ab670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352d0b706be099dd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc7be00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:26:09.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc7be00640 1 -- 172.21.15.1:0/4225282728 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880ae070 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc7be00640 1 -- 172.21.15.1:0/4225282728 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbc880037a0 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc9400ed10 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbc7be00640 1 -- 172.21.15.1:0/4225282728 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbc880abe40 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbca85c6740 10 client.25777 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.733+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55d204839620 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbc7be00640 1 -- 172.21.15.1:0/4225282728 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9400ed10 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbc7be00640 1 -- 172.21.15.1:0/4225282728 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fbc880a80d0 con 0x55d20472c2f0 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbca85c6740 10 client.25777 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbca85c6740 10 client.25777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbca85c6740 20 client.25777 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbca85c6740 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d204713d80 0x55d204b22d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbca85c6740 4 client.25777 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d204a6fec0 con 0x55d204713d80 2024-08-28T20:26:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.734+0000 7fbc9a000640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d204713d80 0x55d204b22d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.735+0000 7fbc7be00640 10 client.25777 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:09.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.735+0000 7fbc9a000640 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d204713d80 0x55d204b22d80 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d2e0afe1f01079 server_cookie=4230f201adfe036d in_seq=0 out_seq=0 2024-08-28T20:26:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.737+0000 7fbc7be00640 1 -- 172.21.15.1:0/4225282728 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d204a6fec0 con 0x55d204713d80 2024-08-28T20:26:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.737+0000 7fbc7be00640 10 client.25777 handle_command_reply: tid=0 2024-08-28T20:26:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.737+0000 7fbca85c6740 1 client.25777 shutdown 2024-08-28T20:26:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d20472c2f0 msgr2=0x55d204b04660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d20472c2f0 0x55d204b04660 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800d010 tx=0x7fbc880ab670 comp rx=0 tx=0).stop 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 shutdown_connections 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d204713d80 0x55d204b22d80 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b05890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbc7be00640 0 client.25777 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d2047344d0 0x55d204b04d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 --2- 172.21.15.1:0/4225282728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d20472c2f0 0x55d204b04660 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 >> 172.21.15.1:0/4225282728 conn(0x55d204749300 msgr2=0x55d204af4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.738+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 shutdown_connections 2024-08-28T20:26:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.739+0000 7fbca85c6740 1 -- 172.21.15.1:0/4225282728 wait complete. 2024-08-28T20:26:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.739+0000 7fbca85c6740 20 client.25777 trim_cache size 0 max 16384 2024-08-28T20:26:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.761+0000 7fbca85c6740 1 Processor -- start 2024-08-28T20:26:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 -- start start 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204affab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047344d0 0x55d204af5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204af6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1ab210 con 0x55d2047344d0 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1a8a80 con 0x55d20472c2f0 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.769+0000 7fbca85c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c073560 con 0x55d2047551b0 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.770+0000 7fbc9b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204af6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.770+0000 7fbc9b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204af6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36338/0 (socket says 172.21.15.1:36338) 2024-08-28T20:26:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.770+0000 7fbc9b400640 1 -- 172.21.15.1:0/1645641831 learned_addr learned my addr 172.21.15.1:0/1645641831 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.771+0000 7fbc9a000640 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047344d0 0x55d204af5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.772+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204affab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.772+0000 7fbc9b400640 1 -- 172.21.15.1:0/1645641831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 msgr2=0x55d204affab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.772+0000 7fbc9b400640 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204affab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.772+0000 7fbc9b400640 1 -- 172.21.15.1:0/1645641831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047344d0 msgr2=0x55d204af5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.772+0000 7fbc9b400640 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047344d0 0x55d204af5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.772+0000 7fbc9b400640 1 -- 172.21.15.1:0/1645641831 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d204b05c00 con 0x55d2047551b0 2024-08-28T20:26:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.774+0000 7fbc9b400640 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204af6300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400ec20 tx=0x7fbc94003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643150feb2b55415 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.775+0000 7fbc86a00640 1 -- 172.21.15.1:0/1645641831 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94034070 con 0x55d2047551b0 2024-08-28T20:26:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.775+0000 7fbc86a00640 1 -- 172.21.15.1:0/1645641831 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc940039e0 con 0x55d2047551b0 2024-08-28T20:26:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.775+0000 7fbc86a00640 1 -- 172.21.15.1:0/1645641831 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94022040 con 0x55d2047551b0 2024-08-28T20:26:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.777+0000 7fbca85c6740 1 -- 172.21.15.1:0/1645641831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 msgr2=0x55d204af6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.777+0000 7fbca85c6740 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204af6300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400ec20 tx=0x7fbc94003970 comp rx=0 tx=0).stop 2024-08-28T20:26:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.778+0000 7fbca85c6740 1 -- 172.21.15.1:0/1645641831 shutdown_connections 2024-08-28T20:26:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.778+0000 7fbca85c6740 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047344d0 0x55d204af5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.778+0000 7fbca85c6740 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047551b0 0x55d204af6300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.778+0000 7fbca85c6740 1 --2- 172.21.15.1:0/1645641831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204affab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.778+0000 7fbca85c6740 1 -- 172.21.15.1:0/1645641831 >> 172.21.15.1:0/1645641831 conn(0x55d204749300 msgr2=0x55d204af56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.779+0000 7fbca85c6740 1 -- 172.21.15.1:0/1645641831 shutdown_connections 2024-08-28T20:26:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.779+0000 7fbca85c6740 1 -- 172.21.15.1:0/1645641831 wait complete. 2024-08-28T20:26:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.780+0000 7fbca85c6740 1 -- start start 2024-08-28T20:26:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.780+0000 7fbca85c6740 1 Processor -- start 2024-08-28T20:26:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204b0b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047344d0 0x55d204b0c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b0a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c073bb0 con 0x55d2047551b0 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c075020 con 0x55d20472c2f0 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c074280 con 0x55d2047344d0 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.784+0000 7fbca85c6740 10 client.0 _ll_register_callbacks cb 0x7fbc880abd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204b0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204b0b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51964/0 (socket says 172.21.15.1:51964) 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9aa00640 1 -- 172.21.15.1:0/3428027271 learned_addr learned my addr 172.21.15.1:0/3428027271 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9a000640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047344d0 0x55d204b0c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9b400640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b0a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9a000640 1 -- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 msgr2=0x55d204b0b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9a000640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204b0b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9a000640 1 -- 172.21.15.1:0/3428027271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 msgr2=0x55d204b0a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9a000640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b0a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9a000640 1 -- 172.21.15.1:0/3428027271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d204b0aa60 con 0x55d2047344d0 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.785+0000 7fbc9b400640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b0a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.786+0000 7fbc9a000640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047344d0 0x55d204b0c010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55d204b23520 tx=0x7fbc8c004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c19dc1fdb28a1b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.786+0000 7fbc7be00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:26:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.787+0000 7fbc7be00640 1 -- 172.21.15.1:0/3428027271 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c049070 con 0x55d2047344d0 2024-08-28T20:26:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.788+0000 7fbc7be00640 1 -- 172.21.15.1:0/3428027271 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbc8c005450 con 0x55d2047344d0 2024-08-28T20:26:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.788+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc940039e0 con 0x55d2047344d0 2024-08-28T20:26:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.792+0000 7fbc7be00640 1 -- 172.21.15.1:0/3428027271 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c053050 con 0x55d2047344d0 2024-08-28T20:26:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.793+0000 7fbca85c6740 10 client.25783 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.793+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55d204b8e240 con 0x55d2047344d0 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.793+0000 7fbc7be00640 1 -- 172.21.15.1:0/3428027271 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc940039e0 con 0x55d2047344d0 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbc7be00640 1 -- 172.21.15.1:0/3428027271 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fbc8c003790 con 0x55d2047344d0 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbca85c6740 10 client.25783 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbca85c6740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbca85c6740 20 client.25783 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbca85c6740 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d2046e91c0 0x55d204b90c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbca85c6740 4 client.25783 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:26:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d204a6b960 con 0x55d2046e91c0 2024-08-28T20:26:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.794+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d2046e91c0 0x55d204b90c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.796+0000 7fbc9aa00640 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d2046e91c0 0x55d204b90c50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ba43b43c7ceb4ba server_cookie=fdca9c730aa42a5a in_seq=0 out_seq=0 2024-08-28T20:26:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.796+0000 7fbc7be00640 10 client.25783 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbc7be00640 1 -- 172.21.15.1:0/3428027271 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d204a6b960 con 0x55d2046e91c0 2024-08-28T20:26:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbc7be00640 10 client.25783 handle_command_reply: tid=0 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 client.25783 shutdown 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047344d0 msgr2=0x55d204b0c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047344d0 0x55d204b0c010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55d204b23520 tx=0x7fbc8c004340 comp rx=0 tx=0).stop 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 shutdown_connections 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55d2046e91c0 0x55d204b90c50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d2047551b0 0x55d204b0a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d2047344d0 0x55d204b0c010 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 --2- 172.21.15.1:0/3428027271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d20472c2f0 0x55d204b0b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 >> 172.21.15.1:0/3428027271 conn(0x55d204749300 msgr2=0x55d204aff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.850+0000 7fbc7be00640 0 client.25783 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.851+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 shutdown_connections 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.851+0000 7fbca85c6740 1 -- 172.21.15.1:0/3428027271 wait complete. 2024-08-28T20:26:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.851+0000 7fbca85c6740 20 client.25783 trim_cache size 0 max 16384 2024-08-28T20:26:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:26:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:26:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:26:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc800b4ba0 msgr2=0x7fbc800b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc800b4ba0 0x7fbc800b70b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400fc90 tx=0x7fbc94018000 comp rx=0 tx=0).stop 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 msgr2=0x7fbc9c1a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1a0380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800ea60 tx=0x7fbc8800ef20 comp rx=0 tx=0).stop 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 shutdown_connections 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc800b4ba0 0x7fbc800b70b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c1031f0 0x7fbc9c1a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc9c103b90 0x7fbc9c1a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 --2- 172.21.15.1:0/3647462978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc9c102170 0x7fbc9c1a0380 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 >> 172.21.15.1:0/3647462978 conn(0x7fbc9c0fdab0 msgr2=0x7fbc9c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 shutdown_connections 2024-08-28T20:26:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:09.852+0000 7fbc9be00640 1 -- 172.21.15.1:0/3647462978 wait complete. 2024-08-28T20:26:10.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:10 smithi007 ceph-mon[25357]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.4 MiB/s wr, 653 op/s 2024-08-28T20:26:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:10 smithi001 ceph-mon[20984]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.4 MiB/s wr, 653 op/s 2024-08-28T20:26:10.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:10 smithi121 ceph-mon[25248]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.4 MiB/s wr, 653 op/s 2024-08-28T20:26:12.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:12 smithi007 ceph-mon[25357]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 712 op/s 2024-08-28T20:26:12.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:12 smithi001 ceph-mon[20984]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 712 op/s 2024-08-28T20:26:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:12 smithi121 ceph-mon[25248]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 712 op/s 2024-08-28T20:26:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 465.0 s, 1806.1 tps, lat 55.367 ms stddev 69.144 2024-08-28T20:26:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:14 smithi007 ceph-mon[25357]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.1 MiB/s wr, 655 op/s 2024-08-28T20:26:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:14 smithi001 ceph-mon[20984]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.1 MiB/s wr, 655 op/s 2024-08-28T20:26:14.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:14 smithi121 ceph-mon[25248]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.1 MiB/s wr, 655 op/s 2024-08-28T20:26:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:16 smithi007 ceph-mon[25357]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 753 op/s 2024-08-28T20:26:16.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:16 smithi001 ceph-mon[20984]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 753 op/s 2024-08-28T20:26:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:16 smithi121 ceph-mon[25248]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 753 op/s 2024-08-28T20:26:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:18 smithi007 ceph-mon[25357]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.8 MiB/s wr, 682 op/s 2024-08-28T20:26:18.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:18 smithi001 ceph-mon[20984]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.8 MiB/s wr, 682 op/s 2024-08-28T20:26:18.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:18 smithi121 ceph-mon[25248]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.8 MiB/s wr, 682 op/s 2024-08-28T20:26:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 470.0 s, 2215.3 tps, lat 44.614 ms stddev 54.953 2024-08-28T20:26:19.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:19 smithi001 ceph-mon[20984]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-08-28T20:26:19.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:19 smithi121 ceph-mon[25248]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-08-28T20:26:19.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:19 smithi007 ceph-mon[25357]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-08-28T20:26:21.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:21 smithi007 ceph-mon[25357]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 737 op/s 2024-08-28T20:26:21.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:21 smithi001 ceph-mon[20984]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 737 op/s 2024-08-28T20:26:21.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:21 smithi121 ceph-mon[25248]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 737 op/s 2024-08-28T20:26:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.132+0000 7f3617000640 1 -- 172.21.15.1:0/1960362255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 msgr2=0x7f3610113e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.132+0000 7f3617000640 1 --2- 172.21.15.1:0/1960362255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f3610113e00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3608009be0 tx=0x7f360802a6f0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.136+0000 7f3617000640 1 -- 172.21.15.1:0/1960362255 shutdown_connections 2024-08-28T20:26:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.136+0000 7f3617000640 1 --2- 172.21.15.1:0/1960362255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f3610113e00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.136+0000 7f3617000640 1 --2- 172.21.15.1:0/1960362255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010aab0 0x7f36101114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.136+0000 7f3617000640 1 --2- 172.21.15.1:0/1960362255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f361010a160 0x7f361010a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.136+0000 7f3617000640 1 -- 172.21.15.1:0/1960362255 >> 172.21.15.1:0/1960362255 conn(0x7f3610070440 msgr2=0x7f3610072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.137+0000 7f3617000640 1 -- 172.21.15.1:0/1960362255 shutdown_connections 2024-08-28T20:26:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.137+0000 7f3617000640 1 -- 172.21.15.1:0/1960362255 wait complete. 2024-08-28T20:26:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.138+0000 7f3617000640 1 Processor -- start 2024-08-28T20:26:23.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.141+0000 7f3617000640 1 -- start start 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3617000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010a160 0x7f36101a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3617000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f361010aab0 0x7f36101a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3617000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f36101a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3617000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36101198c0 con 0x7f361010aab0 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3617000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3610119740 con 0x7f36101119e0 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3617000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3610119a40 con 0x7f361010a160 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3615c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010a160 0x7f36101a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3615c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010a160 0x7f36101a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:38206/0 (socket says 172.21.15.1:38206) 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3615c00640 1 -- 172.21.15.1:0/1663494435 learned_addr learned my addr 172.21.15.1:0/1663494435 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.142+0000 7f3616600640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f36101a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.143+0000 7f3615200640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f361010aab0 0x7f36101a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.143+0000 7f3616600640 1 -- 172.21.15.1:0/1663494435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010a160 msgr2=0x7f36101a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.143+0000 7f3616600640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010a160 0x7f36101a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.143+0000 7f3616600640 1 -- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f361010aab0 msgr2=0x7f36101a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.143+0000 7f3616600640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f361010aab0 0x7f36101a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.143+0000 7f3616600640 1 -- 172.21.15.1:0/1663494435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101a5f30 con 0x7f36101119e0 2024-08-28T20:26:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.144+0000 7f3616600640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f36101a5710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3608009b30 tx=0x7f3608031670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.144+0000 7f360e000640 1 -- 172.21.15.1:0/1663494435 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608041020 con 0x7f36101119e0 2024-08-28T20:26:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.144+0000 7f360e000640 1 -- 172.21.15.1:0/1663494435 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360803c920 con 0x7f36101119e0 2024-08-28T20:26:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.144+0000 7f360e000640 1 -- 172.21.15.1:0/1663494435 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608036040 con 0x7f36101119e0 2024-08-28T20:26:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.144+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101a61c0 con 0x7f36101119e0 2024-08-28T20:26:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.144+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101ac730 con 0x7f36101119e0 2024-08-28T20:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.151+0000 7f360e000640 1 -- 172.21.15.1:0/1663494435 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f3608044020 con 0x7f36101119e0 2024-08-28T20:26:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.153+0000 7f361f62c740 1 Processor -- start 2024-08-28T20:26:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.154+0000 7f360e000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f35f40b4bf0 0x7f35f40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.155+0000 7f360e000640 1 -- 172.21.15.1:0/1663494435 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f36081062a0 con 0x7f36101119e0 2024-08-28T20:26:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 -- start start 2024-08-28T20:26:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6a41b0 0x56271ea49d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea4a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271e9bcf70 con 0x56271e6a41b0 2024-08-28T20:26:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56271e9ac500 con 0x56271e6834d0 2024-08-28T20:26:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.156+0000 7f361f62c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56271e9b04b0 con 0x56271e67b2f0 2024-08-28T20:26:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.157+0000 7f3615200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea4a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.157+0000 7f3615200640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f35f40b4bf0 0x7f35f40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.157+0000 7f3615200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea4a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:38214/0 (socket says 172.21.15.1:38214) 2024-08-28T20:26:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.157+0000 7f3615200640 1 -- 172.21.15.1:0/2851366842 learned_addr learned my addr 172.21.15.1:0/2851366842 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.157+0000 7f3615c00640 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6a41b0 0x56271ea49d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.157+0000 7f3616600640 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.158+0000 7f3616600640 1 -- 172.21.15.1:0/2851366842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 msgr2=0x56271ea4a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.158+0000 7f3616600640 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea4a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.158+0000 7f3616600640 1 -- 172.21.15.1:0/2851366842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6a41b0 msgr2=0x56271ea49d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.158+0000 7f3616600640 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6a41b0 0x56271ea49d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.158+0000 7f3616600640 1 -- 172.21.15.1:0/2851366842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271e966c10 con 0x56271e6834d0 2024-08-28T20:26:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.159+0000 7f3616600640 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4af00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3608104100 tx=0x7f3608009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf4fd3e286ba0a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.159+0000 7f3606a00640 1 -- 172.21.15.1:0/2851366842 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080cccc0 con 0x56271e6834d0 2024-08-28T20:26:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.159+0000 7f3606a00640 1 -- 172.21.15.1:0/2851366842 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36080d1530 con 0x56271e6834d0 2024-08-28T20:26:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.159+0000 7f3606a00640 1 -- 172.21.15.1:0/2851366842 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080c8f50 con 0x56271e6834d0 2024-08-28T20:26:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.159+0000 7f3615200640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f35f40b4bf0 0x7f35f40b7100 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f35f8014b10 tx=0x7f35f800e8a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.161+0000 7f361f62c740 1 -- 172.21.15.1:0/2851366842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 msgr2=0x56271ea4af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.161+0000 7f361f62c740 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4af00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3608104100 tx=0x7f3608009500 comp rx=0 tx=0).stop 2024-08-28T20:26:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.161+0000 7f361f62c740 1 -- 172.21.15.1:0/2851366842 shutdown_connections 2024-08-28T20:26:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.162+0000 7f361f62c740 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4af00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.162+0000 7f361f62c740 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea4a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.162+0000 7f361f62c740 1 --2- 172.21.15.1:0/2851366842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6a41b0 0x56271ea49d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.162+0000 7f361f62c740 1 -- 172.21.15.1:0/2851366842 >> 172.21.15.1:0/2851366842 conn(0x56271e698300 msgr2=0x56271ea457d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.166+0000 7f361f62c740 1 -- 172.21.15.1:0/2851366842 shutdown_connections 2024-08-28T20:26:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.166+0000 7f361f62c740 1 -- 172.21.15.1:0/2851366842 wait complete. 2024-08-28T20:26:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.167+0000 7f361f62c740 1 -- start start 2024-08-28T20:26:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.168+0000 7f361f62c740 1 Processor -- start 2024-08-28T20:26:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea5b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 0x56271ea5bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56271e8e5ab0 con 0x56271e67b2f0 2024-08-28T20:26:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56271e953320 con 0x56271e6a41b0 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56271ea4b7e0 con 0x56271e6834d0 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f361f62c740 10 client.0 _ll_register_callbacks cb 0x56271e98ce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f3615c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea5b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f3615200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 0x56271ea5bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f3615200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 0x56271ea5bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:38222/0 (socket says 172.21.15.1:38222) 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f3615200640 1 -- 172.21.15.1:0/1141667907 learned_addr learned my addr 172.21.15.1:0/1141667907 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.169+0000 7f3616600640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.170+0000 7f3616600640 1 -- 172.21.15.1:0/1141667907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 msgr2=0x56271ea5bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.170+0000 7f3616600640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 0x56271ea5bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.170+0000 7f3616600640 1 -- 172.21.15.1:0/1141667907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 msgr2=0x56271ea5b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.170+0000 7f3616600640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea5b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.170+0000 7f3616600640 1 -- 172.21.15.1:0/1141667907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271e70f790 con 0x56271e6a41b0 2024-08-28T20:26:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.170+0000 7f3615200640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 0x56271ea5bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:26:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.171+0000 7f3616600640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea5cb00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36080b8230 tx=0x7f36080b81c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f097a8d727409c12 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.171+0000 7f35ff400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:26:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.171+0000 7f3615c00640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea5b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:26:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.172+0000 7f35ff400640 1 -- 172.21.15.1:0/1141667907 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080cccc0 con 0x56271e6a41b0 2024-08-28T20:26:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.172+0000 7f35ff400640 1 -- 172.21.15.1:0/1141667907 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f36080d1140 con 0x56271e6a41b0 2024-08-28T20:26:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.172+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36080d1530 con 0x56271e6a41b0 2024-08-28T20:26:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.173+0000 7f35ff400640 1 -- 172.21.15.1:0/1141667907 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f36080d5fe0 con 0x56271e6a41b0 2024-08-28T20:26:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.173+0000 7f361f62c740 10 client.25826 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.173+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56271e788620 con 0x56271e6a41b0 2024-08-28T20:26:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.174+0000 7f35ff400640 1 -- 172.21.15.1:0/1141667907 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36080d1530 con 0x56271e6a41b0 2024-08-28T20:26:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f35ff400640 1 -- 172.21.15.1:0/1141667907 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f3608004c60 con 0x56271e6a41b0 2024-08-28T20:26:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f361f62c740 10 client.25826 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f361f62c740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f361f62c740 20 client.25826 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f361f62c740 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e662d80 0x56271ea68cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f361f62c740 4 client.25826 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:26:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.175+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56271e9beec0 con 0x56271e662d80 2024-08-28T20:26:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.176+0000 7f3615c00640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e662d80 0x56271ea68cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.178+0000 7f3615c00640 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e662d80 0x56271ea68cc0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4730e9ba9f647e server_cookie=7c23124bd481f58c in_seq=0 out_seq=0 2024-08-28T20:26:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.178+0000 7f35ff400640 10 client.25826 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f35ff400640 1 -- 172.21.15.1:0/1141667907 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56271e9beec0 con 0x56271e662d80 2024-08-28T20:26:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f35ff400640 10 client.25826 handle_command_reply: tid=0 2024-08-28T20:26:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 client.25826 shutdown 2024-08-28T20:26:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 msgr2=0x56271ea5cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea5cb00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36080b8230 tx=0x7f36080b81c0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 shutdown_connections 2024-08-28T20:26:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e662d80 0x56271ea68cc0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea5cb00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f35ff400640 0 client.25826 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6834d0 0x56271ea5bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 --2- 172.21.15.1:0/1141667907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea5b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.179+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 >> 172.21.15.1:0/1141667907 conn(0x56271e698300 msgr2=0x56271ea43d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.180+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 shutdown_connections 2024-08-28T20:26:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.180+0000 7f361f62c740 1 -- 172.21.15.1:0/1141667907 wait complete. 2024-08-28T20:26:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.180+0000 7f361f62c740 20 client.25826 trim_cache size 0 max 16384 2024-08-28T20:26:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.206+0000 7f361f62c740 1 Processor -- start 2024-08-28T20:26:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.206+0000 7f361f62c740 1 -- start start 2024-08-28T20:26:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f361f62c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea46c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f361f62c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f361f62c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 0x56271ea4e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f361f62c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b3900 con 0x56271e67b2f0 2024-08-28T20:26:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f361f62c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b1170 con 0x56271e6834d0 2024-08-28T20:26:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f361f62c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36101aefa0 con 0x56271e6a41b0 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f3616600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 0x56271ea4e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f3615200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f3616600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 0x56271ea4e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:38224/0 (socket says 172.21.15.1:38224) 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f3615200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:54546/0 (socket says 172.21.15.1:54546) 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f3616600640 1 -- 172.21.15.1:0/279150806 learned_addr learned my addr 172.21.15.1:0/279150806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.207+0000 7f3615c00640 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea46c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3616600640 1 -- 172.21.15.1:0/279150806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 msgr2=0x56271ea4db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3616600640 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3616600640 1 -- 172.21.15.1:0/279150806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 msgr2=0x56271ea46c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3616600640 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea46c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3616600640 1 -- 172.21.15.1:0/279150806 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271ea4b910 con 0x56271e6a41b0 2024-08-28T20:26:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3616600640 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 0x56271ea4e0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f36080c9260 tx=0x7f36080f3b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efc32d3e2eb8b7e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3606000640 1 -- 172.21.15.1:0/279150806 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080d5fe0 con 0x56271e6a41b0 2024-08-28T20:26:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3606000640 1 -- 172.21.15.1:0/279150806 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360803ce20 con 0x56271e6a41b0 2024-08-28T20:26:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.208+0000 7f3606000640 1 -- 172.21.15.1:0/279150806 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080cd650 con 0x56271e6a41b0 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 -- 172.21.15.1:0/279150806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 msgr2=0x56271ea4e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 0x56271ea4e0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f36080c9260 tx=0x7f36080f3b20 comp rx=0 tx=0).stop 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 -- 172.21.15.1:0/279150806 shutdown_connections 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e6a41b0 0x56271ea4e0d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6834d0 0x56271ea4db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 --2- 172.21.15.1:0/279150806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e67b2f0 0x56271ea46c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 -- 172.21.15.1:0/279150806 >> 172.21.15.1:0/279150806 conn(0x56271e698300 msgr2=0x56271ea40490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 -- 172.21.15.1:0/279150806 shutdown_connections 2024-08-28T20:26:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.209+0000 7f361f62c740 1 -- 172.21.15.1:0/279150806 wait complete. 2024-08-28T20:26:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.210+0000 7f361f62c740 1 -- start start 2024-08-28T20:26:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.210+0000 7f361f62c740 1 Processor -- start 2024-08-28T20:26:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.210+0000 7f361f62c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f361f62c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6834d0 0x56271ea62170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f361f62c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f361f62c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36101af630 con 0x56271e6834d0 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f361f62c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b0aa0 con 0x56271e6a41b0 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f361f62c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36101afd00 con 0x56271e67b2f0 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f361f62c740 10 client.0 _ll_register_callbacks cb 0x7f35f800ed30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f3615c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f3615c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:38234/0 (socket says 172.21.15.1:38234) 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.211+0000 7f3615c00640 1 -- 172.21.15.1:0/1950313122 learned_addr learned my addr 172.21.15.1:0/1950313122 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3616600640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615200640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6834d0 0x56271ea62170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615c00640 1 -- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 msgr2=0x56271ea626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615c00640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615c00640 1 -- 172.21.15.1:0/1950313122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6834d0 msgr2=0x56271ea62170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615c00640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6834d0 0x56271ea62170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615c00640 1 -- 172.21.15.1:0/1950313122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271ea62c20 con 0x56271e67b2f0 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.212+0000 7f3615200640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6834d0 0x56271ea62170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f3615c00640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea634b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3600009d10 tx=0x7f3600014af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9895329e7445a3d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f35ff400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f35ff400640 1 -- 172.21.15.1:0/1950313122 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600004030 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f35ff400640 1 -- 172.21.15.1:0/1950313122 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f36000041d0 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56271e9ba960 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f35ff400640 1 -- 172.21.15.1:0/1950313122 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f36000043d0 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f361f62c740 10 client.25801 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.213+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56271ea61b50 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f35ff400640 1 -- 172.21.15.1:0/1950313122 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56271e9ba960 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f35ff400640 1 -- 172.21.15.1:0/1950313122 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f3600004b70 con 0x56271e67b2f0 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f361f62c740 10 client.25801 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f361f62c740 10 client.25801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f361f62c740 20 client.25801 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f361f62c740 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e6381c0 0x56271ead5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f361f62c740 4 client.25801 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:26:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.214+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56271e9b80a0 con 0x56271e6381c0 2024-08-28T20:26:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.215+0000 7f3615200640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e6381c0 0x56271ead5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.215+0000 7f35ff400640 10 client.25801 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.215+0000 7f3615200640 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e6381c0 0x56271ead5e10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d381b0fa8136f70 server_cookie=6df13208b45488f9 in_seq=0 out_seq=0 2024-08-28T20:26:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f35ff400640 1 -- 172.21.15.1:0/1950313122 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56271e9b80a0 con 0x56271e6381c0 2024-08-28T20:26:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f35ff400640 10 client.25801 handle_command_reply: tid=0 2024-08-28T20:26:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 client.25801 shutdown 2024-08-28T20:26:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 msgr2=0x56271ea634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea634b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3600009d10 tx=0x7f3600014af0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 shutdown_connections 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56271e6381c0 0x56271ead5e10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56271e6834d0 0x56271ea62170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56271e6a41b0 0x56271ea626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 --2- 172.21.15.1:0/1950313122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56271e67b2f0 0x56271ea634b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f35ff400640 0 client.25801 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 >> 172.21.15.1:0/1950313122 conn(0x56271e698300 msgr2=0x56271ea40490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.231+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 shutdown_connections 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.232+0000 7f361f62c740 1 -- 172.21.15.1:0/1950313122 wait complete. 2024-08-28T20:26:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.232+0000 7f361f62c740 20 client.25801 trim_cache size 0 max 16384 2024-08-28T20:26:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:26:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:26:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:26:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.232+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f35f40b4bf0 msgr2=0x7f35f40b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.232+0000 7f3617000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f35f40b4bf0 0x7f35f40b7100 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f35f8014b10 tx=0x7f35f800e8a0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.232+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 msgr2=0x7f36101a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.232+0000 7f3617000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f36101a5710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3608009b30 tx=0x7f3608031670 comp rx=0 tx=0).stop 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 shutdown_connections 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f35f40b4bf0 0x7f35f40b7100 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f361010aab0 0x7f36101a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36101119e0 0x7f36101a5710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 --2- 172.21.15.1:0/1663494435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f361010a160 0x7f36101a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 >> 172.21.15.1:0/1663494435 conn(0x7f3610070440 msgr2=0x7f361010d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 shutdown_connections 2024-08-28T20:26:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:23.233+0000 7f3617000640 1 -- 172.21.15.1:0/1663494435 wait complete. 2024-08-28T20:26:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 475.0 s, 1954.4 tps, lat 51.251 ms stddev 64.151 2024-08-28T20:26:23.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:23 smithi007 ceph-mon[25357]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 MiB/s wr, 594 op/s 2024-08-28T20:26:23.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:23 smithi001 ceph-mon[20984]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 MiB/s wr, 594 op/s 2024-08-28T20:26:23.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:23 smithi121 ceph-mon[25248]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 MiB/s wr, 594 op/s 2024-08-28T20:26:25.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:25 smithi007 ceph-mon[25357]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 746 op/s 2024-08-28T20:26:25.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:25 smithi001 ceph-mon[20984]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 746 op/s 2024-08-28T20:26:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:25 smithi121 ceph-mon[25248]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 746 op/s 2024-08-28T20:26:27.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:27 smithi007 ceph-mon[25357]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 631 op/s 2024-08-28T20:26:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:27 smithi001 ceph-mon[20984]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 631 op/s 2024-08-28T20:26:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:27 smithi121 ceph-mon[25248]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 631 op/s 2024-08-28T20:26:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 480.0 s, 2196.0 tps, lat 45.751 ms stddev 62.049 2024-08-28T20:26:29.779 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:29 smithi001 ceph-mon[20984]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 616 op/s 2024-08-28T20:26:29.779 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:29 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:26:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:29 smithi007 ceph-mon[25357]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 616 op/s 2024-08-28T20:26:29.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:29 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:26:29.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:29 smithi121 ceph-mon[25248]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 616 op/s 2024-08-28T20:26:29.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:29 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:26:30.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:26:30.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:26:30.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:30 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:26:30.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:26:30.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:26:30.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:30 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:26:30.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:26:30.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:26:30.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:30 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:26:31.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:31 smithi007 ceph-mon[25357]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 670 op/s 2024-08-28T20:26:31.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:31 smithi001 ceph-mon[20984]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 670 op/s 2024-08-28T20:26:31.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:31 smithi121 ceph-mon[25248]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 670 op/s 2024-08-28T20:26:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 485.0 s, 1742.6 tps, lat 57.800 ms stddev 70.645 2024-08-28T20:26:33.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:33 smithi007 ceph-mon[25357]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 572 op/s 2024-08-28T20:26:33.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:33 smithi001 ceph-mon[20984]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 572 op/s 2024-08-28T20:26:33.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:33 smithi121 ceph-mon[25248]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 572 op/s 2024-08-28T20:26:35.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:35 smithi007 ceph-mon[25357]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-08-28T20:26:35.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:35 smithi001 ceph-mon[20984]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-08-28T20:26:35.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:35 smithi121 ceph-mon[25248]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-08-28T20:26:36.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.528+0000 7fbc44c00640 1 -- 172.21.15.1:0/3897144630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc40078a40 msgr2=0x7fbc40078e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.528+0000 7fbc44c00640 1 --2- 172.21.15.1:0/3897144630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc40078a40 0x7fbc40078e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009900 tx=0x7fbc2802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.530+0000 7fbc44c00640 1 -- 172.21.15.1:0/3897144630 shutdown_connections 2024-08-28T20:26:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.530+0000 7fbc44c00640 1 --2- 172.21.15.1:0/3897144630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc40078a40 0x7fbc40078e50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.530+0000 7fbc44c00640 1 --2- 172.21.15.1:0/3897144630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc400793e0 0x7fbc40079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.530+0000 7fbc44c00640 1 --2- 172.21.15.1:0/3897144630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc400779c0 0x7fbc40077e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.530+0000 7fbc44c00640 1 -- 172.21.15.1:0/3897144630 >> 172.21.15.1:0/3897144630 conn(0x7fbc40100df0 msgr2=0x7fbc401032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.533+0000 7fbc44c00640 1 -- 172.21.15.1:0/3897144630 shutdown_connections 2024-08-28T20:26:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.533+0000 7fbc44c00640 1 -- 172.21.15.1:0/3897144630 wait complete. 2024-08-28T20:26:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.537+0000 7fbc44c00640 1 Processor -- start 2024-08-28T20:26:36.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.537+0000 7fbc44c00640 1 -- start start 2024-08-28T20:26:36.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc44c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc400779c0 0x7fbc401a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc44c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 0x7fbc401a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc44c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc400793e0 0x7fbc401a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc44c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc401155b0 con 0x7fbc400779c0 2024-08-28T20:26:36.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc44c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc40115430 con 0x7fbc400793e0 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc44c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc40115730 con 0x7fbc40078a40 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc3ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 0x7fbc401a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc3ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 0x7fbc401a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36472/0 (socket says 172.21.15.1:36472) 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc3ea00640 1 -- 172.21.15.1:0/2854568009 learned_addr learned my addr 172.21.15.1:0/2854568009 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.538+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc400793e0 0x7fbc401a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.539+0000 7fbc3ea00640 1 -- 172.21.15.1:0/2854568009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc400793e0 msgr2=0x7fbc401a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.539+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc400793e0 0x7fbc401a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.539+0000 7fbc3ea00640 1 -- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc400779c0 msgr2=0x7fbc401a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.539+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc400779c0 0x7fbc401a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.539+0000 7fbc3ea00640 1 -- 172.21.15.1:0/2854568009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc401a1bc0 con 0x7fbc40078a40 2024-08-28T20:26:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.539+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 0x7fbc401a07f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc28031440 tx=0x7fbc28003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.541+0000 7fbc37e00640 1 -- 172.21.15.1:0/2854568009 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2803f070 con 0x7fbc40078a40 2024-08-28T20:26:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.541+0000 7fbc37e00640 1 -- 172.21.15.1:0/2854568009 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc28031c50 con 0x7fbc40078a40 2024-08-28T20:26:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.541+0000 7fbc37e00640 1 -- 172.21.15.1:0/2854568009 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28035030 con 0x7fbc40078a40 2024-08-28T20:26:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.541+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc401a1e50 con 0x7fbc40078a40 2024-08-28T20:26:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.541+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc40105110 con 0x7fbc40078a40 2024-08-28T20:26:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.549+0000 7fbc4d208740 1 Processor -- start 2024-08-28T20:26:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 -- start start 2024-08-28T20:26:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 0x5646af2d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2d93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef124d0 0x5646af2d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646af24bf70 con 0x5646aef0a2f0 2024-08-28T20:26:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5646af23b500 con 0x5646aef124d0 2024-08-28T20:26:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.550+0000 7fbc4d208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5646af23f4b0 con 0x5646aef331b0 2024-08-28T20:26:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 0x5646af2d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 0x5646af2d8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36482/0 (socket says 172.21.15.1:36482) 2024-08-28T20:26:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 -- 172.21.15.1:0/2337357874 learned_addr learned my addr 172.21.15.1:0/2337357874 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 -- 172.21.15.1:0/2337357874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef124d0 msgr2=0x5646af2d9f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:26:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef124d0 0x5646af2d9f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 -- 172.21.15.1:0/2337357874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 msgr2=0x5646af2d93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.551+0000 7fbc3fe00640 1 -- 172.21.15.1:0/2337357874 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af1f5c10 con 0x5646aef331b0 2024-08-28T20:26:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.552+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 0x5646af2d8d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009fd0 tx=0x7fbc380118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf74eab22be800ad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.552+0000 7fbc2fe00640 1 -- 172.21.15.1:0/2337357874 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38004d20 con 0x5646aef331b0 2024-08-28T20:26:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.553+0000 7fbc2fe00640 1 -- 172.21.15.1:0/2337357874 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc38004050 con 0x5646aef331b0 2024-08-28T20:26:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.553+0000 7fbc2fe00640 1 -- 172.21.15.1:0/2337357874 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38005280 con 0x5646aef331b0 2024-08-28T20:26:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.556+0000 7fbc4d208740 1 -- 172.21.15.1:0/2337357874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 msgr2=0x5646af2d8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.556+0000 7fbc4d208740 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 0x5646af2d8d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009fd0 tx=0x7fbc380118d0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.556+0000 7fbc4d208740 1 -- 172.21.15.1:0/2337357874 shutdown_connections 2024-08-28T20:26:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.557+0000 7fbc4d208740 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.557+0000 7fbc4d208740 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef124d0 0x5646af2d9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.557+0000 7fbc4d208740 1 --2- 172.21.15.1:0/2337357874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef331b0 0x5646af2d8d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.557+0000 7fbc4d208740 1 -- 172.21.15.1:0/2337357874 >> 172.21.15.1:0/2337357874 conn(0x5646aef27300 msgr2=0x5646af2d47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.559+0000 7fbc37e00640 1 -- 172.21.15.1:0/2854568009 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbc28042070 con 0x7fbc40078a40 2024-08-28T20:26:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.561+0000 7fbc4d208740 1 -- 172.21.15.1:0/2337357874 shutdown_connections 2024-08-28T20:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.561+0000 7fbc4d208740 1 -- 172.21.15.1:0/2337357874 wait complete. 2024-08-28T20:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.561+0000 7fbc37e00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc240b4ab0 0x7fbc240b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.562+0000 7fbc37e00640 1 -- 172.21.15.1:0/2854568009 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbc281059b0 con 0x7fbc40078a40 2024-08-28T20:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.562+0000 7fbc4d208740 1 -- start start 2024-08-28T20:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.564+0000 7fbc4d208740 1 Processor -- start 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2e2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2e2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5646af174ab0 con 0x5646aef0a2f0 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5646af1e2320 con 0x5646aef331b0 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5646af2daa20 con 0x5646aeef1d80 2024-08-28T20:26:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.565+0000 7fbc4d208740 10 client.0 _ll_register_callbacks cb 0x5646af21be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.566+0000 7fbc3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2e2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.566+0000 7fbc3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2e2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:46098/0 (socket says 172.21.15.1:46098) 2024-08-28T20:26:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.566+0000 7fbc3ea00640 1 -- 172.21.15.1:0/337604474 learned_addr learned my addr 172.21.15.1:0/337604474 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.566+0000 7fbc3f400640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.567+0000 7fbc3ea00640 1 -- 172.21.15.1:0/337604474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 msgr2=0x5646af2e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.566+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3ea00640 1 -- 172.21.15.1:0/337604474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 msgr2=0x5646af2e2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2e2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3ea00640 1 -- 172.21.15.1:0/337604474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646aef9e790 con 0x5646aef331b0 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3f400640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:26:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.568+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc240b4ab0 0x7fbc240b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.569+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2e2bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc28103810 tx=0x7fbc280cbb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d232b020b2d262d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.569+0000 7fbc2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:26:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.569+0000 7fbc2cc00640 1 -- 172.21.15.1:0/337604474 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28049040 con 0x5646aef331b0 2024-08-28T20:26:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.569+0000 7fbc2cc00640 1 -- 172.21.15.1:0/337604474 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbc2803b460 con 0x5646aef331b0 2024-08-28T20:26:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.569+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc38004050 con 0x5646aef331b0 2024-08-28T20:26:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.570+0000 7fbc2cc00640 1 -- 172.21.15.1:0/337604474 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbc280ccad0 con 0x5646aef331b0 2024-08-28T20:26:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.570+0000 7fbc4d208740 10 client.25838 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.570+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5646af017620 con 0x5646aef331b0 2024-08-28T20:26:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.570+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc240b4ab0 0x7fbc240b6fc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009de0 tx=0x7fbc38009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.570+0000 7fbc2cc00640 1 -- 172.21.15.1:0/337604474 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc38004050 con 0x5646aef331b0 2024-08-28T20:26:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc2cc00640 1 -- 172.21.15.1:0/337604474 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fbc280c8660 con 0x5646aef331b0 2024-08-28T20:26:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc4d208740 10 client.25838 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc4d208740 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc4d208740 20 client.25838 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc4d208740 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646aeec71c0 0x5646af300c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc4d208740 4 client.25838 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:26:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.571+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646af24dec0 con 0x5646aeec71c0 2024-08-28T20:26:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.572+0000 7fbc3f400640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646aeec71c0 0x5646af300c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.575+0000 7fbc3f400640 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646aeec71c0 0x5646af300c50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce10fe35c3023fd3 server_cookie=f9ef1d181b05c517 in_seq=0 out_seq=0 2024-08-28T20:26:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.575+0000 7fbc2cc00640 10 client.25838 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.575+0000 7fbc2cc00640 1 -- 172.21.15.1:0/337604474 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646af24dec0 con 0x5646aeec71c0 2024-08-28T20:26:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.575+0000 7fbc2cc00640 10 client.25838 handle_command_reply: tid=0 2024-08-28T20:26:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.576+0000 7fbc4d208740 1 client.25838 shutdown 2024-08-28T20:26:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.576+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 msgr2=0x5646af2e2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.576+0000 7fbc4d208740 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2e2bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc28103810 tx=0x7fbc280cbb40 comp rx=0 tx=0).stop 2024-08-28T20:26:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 shutdown_connections 2024-08-28T20:26:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646aeec71c0 0x5646af300c50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2e2bc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 --2- 172.21.15.1:0/337604474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef0a2f0 0x5646af2e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc2cc00640 0 client.25838 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 >> 172.21.15.1:0/337604474 conn(0x5646aef27300 msgr2=0x5646af2d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.577+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 shutdown_connections 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.578+0000 7fbc4d208740 1 -- 172.21.15.1:0/337604474 wait complete. 2024-08-28T20:26:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.578+0000 7fbc4d208740 20 client.25838 trim_cache size 0 max 16384 2024-08-28T20:26:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.609+0000 7fbc4d208740 1 Processor -- start 2024-08-28T20:26:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 -- start start 2024-08-28T20:26:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 0x5646af2e1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef0a2f0 0x5646af2d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4006fa60 con 0x5646aeef1d80 2024-08-28T20:26:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4006d2d0 con 0x5646aef331b0 2024-08-28T20:26:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc4d208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4010be40 con 0x5646aef0a2f0 2024-08-28T20:26:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.610+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 0x5646af2e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.611+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.611+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 0x5646af2e1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60682/0 (socket says 172.21.15.1:60682) 2024-08-28T20:26:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.611+0000 7fbc3ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef0a2f0 0x5646af2d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.611+0000 7fbc3f400640 1 -- 172.21.15.1:0/1803980914 learned_addr learned my addr 172.21.15.1:0/1803980914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3ea00640 1 -- 172.21.15.1:0/1803980914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 msgr2=0x5646af2d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2d5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3ea00640 1 -- 172.21.15.1:0/1803980914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 msgr2=0x5646af2e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 0x5646af2e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3ea00640 1 -- 172.21.15.1:0/1803980914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af300fc0 con 0x5646aef0a2f0 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3f400640 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 0x5646af2e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.612+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:26:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.613+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef0a2f0 0x5646af2d4f00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc280cc360 tx=0x7fbc28000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60e44862d340e70 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.613+0000 7fbc2f400640 1 -- 172.21.15.1:0/1803980914 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28049070 con 0x5646aef0a2f0 2024-08-28T20:26:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.613+0000 7fbc2f400640 1 -- 172.21.15.1:0/1803980914 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc28031e00 con 0x5646aef0a2f0 2024-08-28T20:26:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.613+0000 7fbc2f400640 1 -- 172.21.15.1:0/1803980914 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc280c8660 con 0x5646aef0a2f0 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 -- 172.21.15.1:0/1803980914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef0a2f0 msgr2=0x5646af2d4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef0a2f0 0x5646af2d4f00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc280cc360 tx=0x7fbc28000bc0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 -- 172.21.15.1:0/1803980914 shutdown_connections 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef331b0 0x5646af2d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aef0a2f0 0x5646af2d4f00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 --2- 172.21.15.1:0/1803980914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aeef1d80 0x5646af2e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.614+0000 7fbc4d208740 1 -- 172.21.15.1:0/1803980914 >> 172.21.15.1:0/1803980914 conn(0x5646aef27300 msgr2=0x5646af2e0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.615+0000 7fbc4d208740 1 -- 172.21.15.1:0/1803980914 shutdown_connections 2024-08-28T20:26:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.615+0000 7fbc4d208740 1 -- 172.21.15.1:0/1803980914 wait complete. 2024-08-28T20:26:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.615+0000 7fbc4d208740 1 -- start start 2024-08-28T20:26:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.615+0000 7fbc4d208740 1 Processor -- start 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef0a2f0 0x5646af2e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef331b0 0x5646af2e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4010c4b0 con 0x5646aef331b0 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4006cc00 con 0x5646aef0a2f0 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4010cb80 con 0x5646aeef1d80 2024-08-28T20:26:36.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.616+0000 7fbc4d208740 10 client.0 _ll_register_callbacks cb 0x7fbc28005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.617+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.617+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36518/0 (socket says 172.21.15.1:36518) 2024-08-28T20:26:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.617+0000 7fbc3f400640 1 -- 172.21.15.1:0/3199416846 learned_addr learned my addr 172.21.15.1:0/3199416846 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.617+0000 7fbc3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef0a2f0 0x5646af2e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef331b0 0x5646af2e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3f400640 1 -- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef0a2f0 msgr2=0x5646af2e95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3f400640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef0a2f0 0x5646af2e95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3f400640 1 -- 172.21.15.1:0/3199416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef331b0 msgr2=0x5646af2e7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3f400640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef331b0 0x5646af2e7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3f400640 1 -- 172.21.15.1:0/3199416846 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646af2e9de0 con 0x5646aeef1d80 2024-08-28T20:26:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef0a2f0 0x5646af2e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:26:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.618+0000 7fbc3fe00640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef331b0 0x5646af2e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:26:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.619+0000 7fbc3f400640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e9090 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009b70 tx=0x7fbc30017720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a1b1f1d6cfad79 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.619+0000 7fbc2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:26:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.619+0000 7fbc2cc00640 1 -- 172.21.15.1:0/3199416846 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30021020 con 0x5646aeef1d80 2024-08-28T20:26:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.619+0000 7fbc2cc00640 1 -- 172.21.15.1:0/3199416846 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbc3001d470 con 0x5646aeef1d80 2024-08-28T20:26:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.619+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5646af249960 con 0x5646aeef1d80 2024-08-28T20:26:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.620+0000 7fbc2cc00640 1 -- 172.21.15.1:0/3199416846 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbc30005a30 con 0x5646aeef1d80 2024-08-28T20:26:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.620+0000 7fbc4d208740 10 client.25816 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.620+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5646af36bc80 con 0x5646aeef1d80 2024-08-28T20:26:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc2cc00640 1 -- 172.21.15.1:0/3199416846 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5646af249960 con 0x5646aeef1d80 2024-08-28T20:26:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc2cc00640 1 -- 172.21.15.1:0/3199416846 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fbc3001b040 con 0x5646aeef1d80 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc4d208740 10 client.25816 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc4d208740 10 client.25816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc4d208740 20 client.25816 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc4d208740 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646af36c5e0 0x5646af36ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc4d208740 4 client.25816 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.621+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5646af2470a0 con 0x5646af36c5e0 2024-08-28T20:26:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.622+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646af36c5e0 0x5646af36ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.622+0000 7fbc3ea00640 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646af36c5e0 0x5646af36ea30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b99c311814484484 server_cookie=508bd19fd4b0d178 in_seq=0 out_seq=0 2024-08-28T20:26:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.623+0000 7fbc2cc00640 10 client.25816 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.638+0000 7fbc2cc00640 1 -- 172.21.15.1:0/3199416846 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5646af2470a0 con 0x5646af36c5e0 2024-08-28T20:26:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.639+0000 7fbc2cc00640 10 client.25816 handle_command_reply: tid=0 2024-08-28T20:26:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.639+0000 7fbc4d208740 1 client.25816 shutdown 2024-08-28T20:26:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.639+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 msgr2=0x5646af2e9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.639+0000 7fbc4d208740 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e9090 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009b70 tx=0x7fbc30017720 comp rx=0 tx=0).stop 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.639+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 shutdown_connections 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.639+0000 7fbc4d208740 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5646af36c5e0 0x5646af36ea30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc4d208740 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5646aef331b0 0x5646af2e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc4d208740 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646aef0a2f0 0x5646af2e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc4d208740 1 --2- 172.21.15.1:0/3199416846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646aeef1d80 0x5646af2e9090 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc2cc00640 0 client.25816 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 >> 172.21.15.1:0/3199416846 conn(0x5646aef27300 msgr2=0x5646af2dce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 shutdown_connections 2024-08-28T20:26:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.640+0000 7fbc4d208740 1 -- 172.21.15.1:0/3199416846 wait complete. 2024-08-28T20:26:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.641+0000 7fbc4d208740 20 client.25816 trim_cache size 0 max 16384 2024-08-28T20:26:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:26:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:26:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:26:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:26:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc240b4ab0 msgr2=0x7fbc240b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc240b4ab0 0x7fbc240b6fc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009de0 tx=0x7fbc38009500 comp rx=0 tx=0).stop 2024-08-28T20:26:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 msgr2=0x7fbc401a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 0x7fbc401a07f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc28031440 tx=0x7fbc28003c10 comp rx=0 tx=0).stop 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 shutdown_connections 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbc240b4ab0 0x7fbc240b6fc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc400793e0 0x7fbc401a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc40078a40 0x7fbc401a07f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 --2- 172.21.15.1:0/2854568009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc400779c0 0x7fbc401a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 >> 172.21.15.1:0/2854568009 conn(0x7fbc40100df0 msgr2=0x7fbc40103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.642+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 shutdown_connections 2024-08-28T20:26:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:36.643+0000 7fbc44c00640 1 -- 172.21.15.1:0/2854568009 wait complete. 2024-08-28T20:26:37.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:37 smithi007 ceph-mon[25357]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 613 op/s 2024-08-28T20:26:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:37 smithi001 ceph-mon[20984]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 613 op/s 2024-08-28T20:26:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:37 smithi121 ceph-mon[25248]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 613 op/s 2024-08-28T20:26:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 490.0 s, 2680.8 tps, lat 37.417 ms stddev 47.948 2024-08-28T20:26:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:39 smithi007 ceph-mon[25357]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 645 op/s 2024-08-28T20:26:39.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:39 smithi001 ceph-mon[20984]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 645 op/s 2024-08-28T20:26:39.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:39 smithi121 ceph-mon[25248]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 645 op/s 2024-08-28T20:26:41.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:41 smithi007 ceph-mon[25357]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 772 op/s 2024-08-28T20:26:41.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:41 smithi001 ceph-mon[20984]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 772 op/s 2024-08-28T20:26:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:41 smithi121 ceph-mon[25248]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 772 op/s 2024-08-28T20:26:43.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 495.0 s, 2229.0 tps, lat 44.941 ms stddev 53.698 2024-08-28T20:26:43.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:43 smithi007 ceph-mon[25357]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 654 op/s 2024-08-28T20:26:43.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:43 smithi001 ceph-mon[20984]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 654 op/s 2024-08-28T20:26:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:43 smithi121 ceph-mon[25248]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 654 op/s 2024-08-28T20:26:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:45 smithi121 ceph-mon[25248]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 776 op/s 2024-08-28T20:26:45.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:45 smithi001 ceph-mon[20984]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 776 op/s 2024-08-28T20:26:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:45 smithi007 ceph-mon[25357]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 776 op/s 2024-08-28T20:26:47.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:47 smithi001 ceph-mon[20984]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 680 op/s 2024-08-28T20:26:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:47 smithi121 ceph-mon[25248]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 680 op/s 2024-08-28T20:26:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:47 smithi007 ceph-mon[25357]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 680 op/s 2024-08-28T20:26:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 500.0 s, 2308.2 tps, lat 42.848 ms stddev 51.906 2024-08-28T20:26:49.795 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:49 smithi001 ceph-mon[20984]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.7 MiB/s wr, 708 op/s 2024-08-28T20:26:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.942+0000 7ff3cb800640 1 -- 172.21.15.1:0/1206811024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c410b3a0 msgr2=0x7ff3c410d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.942+0000 7ff3cb800640 1 --2- 172.21.15.1:0/1206811024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c410b3a0 0x7ff3c410d8b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009ca0 tx=0x7ff3bc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 -- 172.21.15.1:0/1206811024 shutdown_connections 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 --2- 172.21.15.1:0/1206811024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c410b3a0 0x7ff3c410d8b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 --2- 172.21.15.1:0/1206811024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 --2- 172.21.15.1:0/1206811024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3c406b3f0 0x7ff3c4108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 -- 172.21.15.1:0/1206811024 >> 172.21.15.1:0/1206811024 conn(0x7ff3c40fdca0 msgr2=0x7ff3c4100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 -- 172.21.15.1:0/1206811024 shutdown_connections 2024-08-28T20:26:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.943+0000 7ff3cb800640 1 -- 172.21.15.1:0/1206811024 wait complete. 2024-08-28T20:26:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.944+0000 7ff3cb800640 1 Processor -- start 2024-08-28T20:26:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.944+0000 7ff3cb800640 1 -- start start 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3cb800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c406b3f0 0x7ff3c41a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3cb800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c41a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3cb800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3c410b3a0 0x7ff3c41a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3cb800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4105450 con 0x7ff3c410b3a0 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3cb800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41052d0 con 0x7ff3c406b3f0 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3cb800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41055d0 con 0x7ff3c4108a40 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c406b3f0 0x7ff3c41a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c41a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c41a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54760/0 (socket says 172.21.15.1:54760) 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3c3e00640 1 -- 172.21.15.1:0/801874211 learned_addr learned my addr 172.21.15.1:0/801874211 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:49.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.945+0000 7ff3c9800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3c410b3a0 0x7ff3c41a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.946+0000 7ff3c3e00640 1 -- 172.21.15.1:0/801874211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c406b3f0 msgr2=0x7ff3c41a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.946+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c406b3f0 0x7ff3c41a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.946+0000 7ff3c3e00640 1 -- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3c410b3a0 msgr2=0x7ff3c41a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.946+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3c410b3a0 0x7ff3c41a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.946+0000 7ff3c3e00640 1 -- 172.21.15.1:0/801874211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c41a1cd0 con 0x7ff3c4108a40 2024-08-28T20:26:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.947+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c41a0900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800e9f0 tx=0x7ff3b800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.948+0000 7ff3c1600640 1 -- 172.21.15.1:0/801874211 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b800cd80 con 0x7ff3c4108a40 2024-08-28T20:26:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.948+0000 7ff3c1600640 1 -- 172.21.15.1:0/801874211 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b80054d0 con 0x7ff3c4108a40 2024-08-28T20:26:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.948+0000 7ff3c1600640 1 -- 172.21.15.1:0/801874211 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8010690 con 0x7ff3c4108a40 2024-08-28T20:26:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.948+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c41a1fc0 con 0x7ff3c4108a40 2024-08-28T20:26:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.948+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41a86b0 con 0x7ff3c4108a40 2024-08-28T20:26:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.954+0000 7ff3c1600640 1 -- 172.21.15.1:0/801874211 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ff3b8010830 con 0x7ff3c4108a40 2024-08-28T20:26:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.954+0000 7ff3d2855740 1 Processor -- start 2024-08-28T20:26:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.955+0000 7ff3d2855740 1 -- start start 2024-08-28T20:26:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c02b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3c1600640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3ac0b4c30 0x7ff3ac0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf583c4d0 0x555bf5c03cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3d2855740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555bf5b75f70 con 0x555bf583c4d0 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3d2855740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555bf5b65500 con 0x555bf58342f0 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3d2855740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555bf5b694b0 con 0x555bf585d1b0 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3c1600640 1 -- 172.21.15.1:0/801874211 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff3b80e55d0 con 0x7ff3c4108a40 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3c9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c02b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3c9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c02b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54770/0 (socket says 172.21.15.1:54770) 2024-08-28T20:26:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.956+0000 7ff3c9800640 1 -- 172.21.15.1:0/1300233401 learned_addr learned my addr 172.21.15.1:0/1300233401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3ac0b4c30 0x7ff3ac0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c9800640 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf583c4d0 0x555bf5c03cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c3e00640 1 -- 172.21.15.1:0/1300233401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 msgr2=0x555bf5c02b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c02b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c3e00640 1 -- 172.21.15.1:0/1300233401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf583c4d0 msgr2=0x555bf5c03cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf583c4d0 0x555bf5c03cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c3e00640 1 -- 172.21.15.1:0/1300233401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bf5b1fc10 con 0x555bf58342f0 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c9800640 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf583c4d0 0x555bf5c03cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.957+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3ac0b4c30 0x7ff3ac0b7140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009bd0 tx=0x7ff3b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.958+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c031a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800e9c0 tx=0x7ff3b80ab7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=234324040cd71ca0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.958+0000 7ff3b6000640 1 -- 172.21.15.1:0/1300233401 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80b0800 con 0x555bf58342f0 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.958+0000 7ff3b6000640 1 -- 172.21.15.1:0/1300233401 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b80b52b0 con 0x555bf58342f0 2024-08-28T20:26:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.958+0000 7ff3b6000640 1 -- 172.21.15.1:0/1300233401 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8094370 con 0x555bf58342f0 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.959+0000 7ff3d2855740 1 -- 172.21.15.1:0/1300233401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 msgr2=0x555bf5c031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.959+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c031a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800e9c0 tx=0x7ff3b80ab7c0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.960+0000 7ff3d2855740 1 -- 172.21.15.1:0/1300233401 shutdown_connections 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.960+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf583c4d0 0x555bf5c03cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.960+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c031a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.960+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1300233401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c02b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.960+0000 7ff3d2855740 1 -- 172.21.15.1:0/1300233401 >> 172.21.15.1:0/1300233401 conn(0x555bf5851300 msgr2=0x555bf5bfe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.961+0000 7ff3d2855740 1 -- 172.21.15.1:0/1300233401 shutdown_connections 2024-08-28T20:26:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.961+0000 7ff3d2855740 1 -- 172.21.15.1:0/1300233401 wait complete. 2024-08-28T20:26:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.962+0000 7ff3d2855740 1 -- start start 2024-08-28T20:26:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.962+0000 7ff3d2855740 1 Processor -- start 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.963+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5c0c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.963+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 0x555bf5c0c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.963+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c0d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3d2855740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555bf5a9eab0 con 0x555bf58342f0 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3d2855740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555bf5b0c320 con 0x555bf583c4d0 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3d2855740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555bf5c04810 con 0x555bf585d1b0 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3d2855740 10 client.0 _ll_register_callbacks cb 0x555bf5b45e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c0d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 0x555bf5c0c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 0x555bf5c0c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59200/0 (socket says 172.21.15.1:59200) 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c3e00640 1 -- 172.21.15.1:0/3392359089 learned_addr learned my addr 172.21.15.1:0/3392359089 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c8e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5c0c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c3e00640 1 -- 172.21.15.1:0/3392359089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 msgr2=0x555bf5c0d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c0d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.964+0000 7ff3c3e00640 1 -- 172.21.15.1:0/3392359089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 msgr2=0x555bf5c0c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.965+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5c0c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.965+0000 7ff3c3e00640 1 -- 172.21.15.1:0/3392359089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bf58c8790 con 0x555bf583c4d0 2024-08-28T20:26:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.965+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 0x555bf5c0c8a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c6a0 tx=0x7ff3b80ac7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f6f92d10e9cb01 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.965+0000 7ff3aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:26:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.966+0000 7ff3aaa00640 1 -- 172.21.15.1:0/3392359089 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80c6060 con 0x555bf583c4d0 2024-08-28T20:26:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.966+0000 7ff3aaa00640 1 -- 172.21.15.1:0/3392359089 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff3b8098210 con 0x555bf583c4d0 2024-08-28T20:26:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.966+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3b80b52b0 con 0x555bf583c4d0 2024-08-28T20:26:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.967+0000 7ff3aaa00640 1 -- 172.21.15.1:0/3392359089 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff3b8098070 con 0x555bf583c4d0 2024-08-28T20:26:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.967+0000 7ff3d2855740 10 client.25856 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.967+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x555bf5941620 con 0x555bf583c4d0 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.967+0000 7ff3aaa00640 1 -- 172.21.15.1:0/3392359089 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b80b52b0 con 0x555bf583c4d0 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3aaa00640 1 -- 172.21.15.1:0/3392359089 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7ff3b80cd200 con 0x555bf583c4d0 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3d2855740 10 client.25856 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3d2855740 10 client.25856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3d2855740 20 client.25856 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3d2855740 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf581bd80 0x555bf5c194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3d2855740 4 client.25856 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:26:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.968+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bf5b77ec0 con 0x555bf581bd80 2024-08-28T20:26:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.969+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf581bd80 0x555bf5c194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.969+0000 7ff3aaa00640 10 client.25856 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.969+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf581bd80 0x555bf5c194f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d2980d22aec5a82 server_cookie=cf07fc2f6e5e9915 in_seq=0 out_seq=0 2024-08-28T20:26:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3aaa00640 1 -- 172.21.15.1:0/3392359089 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555bf5b77ec0 con 0x555bf581bd80 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3aaa00640 10 client.25856 handle_command_reply: tid=0 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3d2855740 1 client.25856 shutdown 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 msgr2=0x555bf5c0c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3d2855740 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 0x555bf5c0c8a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c6a0 tx=0x7ff3b80ac7d0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 shutdown_connections 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.970+0000 7ff3d2855740 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf581bd80 0x555bf5c194f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf585d1b0 0x555bf5c0d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf583c4d0 0x555bf5c0c8a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 1 --2- 172.21.15.1:0/3392359089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5c0c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 >> 172.21.15.1:0/3392359089 conn(0x555bf5851300 msgr2=0x555bf5bfcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3aaa00640 0 client.25856 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 shutdown_connections 2024-08-28T20:26:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 1 -- 172.21.15.1:0/3392359089 wait complete. 2024-08-28T20:26:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:49.971+0000 7ff3d2855740 20 client.25856 trim_cache size 0 max 16384 2024-08-28T20:26:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:49 smithi121 ceph-mon[25248]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.7 MiB/s wr, 708 op/s 2024-08-28T20:26:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.000+0000 7ff3d2855740 1 Processor -- start 2024-08-28T20:26:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.000+0000 7ff3d2855740 1 -- start start 2024-08-28T20:26:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.000+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5bfdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.000+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c0a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 0x555bf5c0ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3d2855740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41b3d90 con 0x555bf58342f0 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3d2855740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41b1600 con 0x555bf585d1b0 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3d2855740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41af450 con 0x555bf583c4d0 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3c9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 0x555bf5c0ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3c9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 0x555bf5c0ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59204/0 (socket says 172.21.15.1:59204) 2024-08-28T20:26:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3c9800640 1 -- 172.21.15.1:0/2385885619 learned_addr learned my addr 172.21.15.1:0/2385885619 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.001+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5bfdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.002+0000 7ff3c9800640 1 -- 172.21.15.1:0/2385885619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 msgr2=0x555bf5c0a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.002+0000 7ff3c9800640 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c0a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.002+0000 7ff3c9800640 1 -- 172.21.15.1:0/2385885619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 msgr2=0x555bf5bfdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.002+0000 7ff3c9800640 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5bfdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.002+0000 7ff3c9800640 1 -- 172.21.15.1:0/2385885619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bf5c0b1b0 con 0x555bf585d1b0 2024-08-28T20:26:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.003+0000 7ff3c9800640 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 0x555bf5c0ac70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc031a00 tx=0x7ff3bc0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1164455956a440d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.003+0000 7ff3b5600640 1 -- 172.21.15.1:0/2385885619 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc045070 con 0x555bf585d1b0 2024-08-28T20:26:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.004+0000 7ff3b5600640 1 -- 172.21.15.1:0/2385885619 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3bc036040 con 0x555bf585d1b0 2024-08-28T20:26:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.004+0000 7ff3b5600640 1 -- 172.21.15.1:0/2385885619 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc004730 con 0x555bf585d1b0 2024-08-28T20:26:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.005+0000 7ff3d2855740 1 -- 172.21.15.1:0/2385885619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 msgr2=0x555bf5c0ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.005+0000 7ff3d2855740 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 0x555bf5c0ac70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc031a00 tx=0x7ff3bc0095c0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 -- 172.21.15.1:0/2385885619 shutdown_connections 2024-08-28T20:26:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf585d1b0 0x555bf5c0ac70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c0a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 --2- 172.21.15.1:0/2385885619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf58342f0 0x555bf5bfdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 -- 172.21.15.1:0/2385885619 >> 172.21.15.1:0/2385885619 conn(0x555bf5851300 msgr2=0x555bf5bf9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 -- 172.21.15.1:0/2385885619 shutdown_connections 2024-08-28T20:26:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.006+0000 7ff3d2855740 1 -- 172.21.15.1:0/2385885619 wait complete. 2024-08-28T20:26:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.007+0000 7ff3d2855740 1 -- start start 2024-08-28T20:26:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.007+0000 7ff3d2855740 1 Processor -- start 2024-08-28T20:26:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.008+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c13d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.008+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c12590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.008+0000 7ff3d2855740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf585d1b0 0x555bf5c12ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c13d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c13d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59216/0 (socket says 172.21.15.1:59216) 2024-08-28T20:26:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c12590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c12590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54802/0 (socket says 172.21.15.1:54802) 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3d2855740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41afac0 con 0x555bf585d1b0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3d2855740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41b0f30 con 0x555bf58342f0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3d2855740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41b0190 con 0x555bf583c4d0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3d2855740 10 client.0 _ll_register_callbacks cb 0x7ff3b0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 -- 172.21.15.1:0/1236422383 learned_addr learned my addr 172.21.15.1:0/1236422383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c9800640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf585d1b0 0x555bf5c12ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 -- 172.21.15.1:0/1236422383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 msgr2=0x555bf5c12590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c12590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 -- 172.21.15.1:0/1236422383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf585d1b0 msgr2=0x555bf5c12ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.009+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf585d1b0 0x555bf5c12ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.010+0000 7ff3c8e00640 1 -- 172.21.15.1:0/1236422383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bf5c13010 con 0x555bf58342f0 2024-08-28T20:26:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.010+0000 7ff3c9800640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf585d1b0 0x555bf5c12ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:26:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.010+0000 7ff3c8e00640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c13d00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x555bf5c19b60 tx=0x7ff3b0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3782ac5f69fb6e58 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:26:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.010+0000 7ff3aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:26:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.012+0000 7ff3aaa00640 1 -- 172.21.15.1:0/1236422383 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00293f0 con 0x555bf58342f0 2024-08-28T20:26:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.012+0000 7ff3aaa00640 1 -- 172.21.15.1:0/1236422383 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff3b0029590 con 0x555bf58342f0 2024-08-28T20:26:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.012+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3bc036040 con 0x555bf58342f0 2024-08-28T20:26:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.013+0000 7ff3aaa00640 1 -- 172.21.15.1:0/1236422383 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff3b00297d0 con 0x555bf58342f0 2024-08-28T20:26:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.013+0000 7ff3d2855740 10 client.25862 fetch_fsmap learned FSMap version 44 2024-08-28T20:26:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.013+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x555bf5c84b20 con 0x555bf58342f0 2024-08-28T20:26:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.013+0000 7ff3aaa00640 1 -- 172.21.15.1:0/1236422383 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3bc036040 con 0x555bf58342f0 2024-08-28T20:26:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3aaa00640 1 -- 172.21.15.1:0/1236422383 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7ff3b002eb20 con 0x555bf58342f0 2024-08-28T20:26:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3d2855740 10 client.25862 fetch_fsmap finished waiting for FSMap version 44 2024-08-28T20:26:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3d2855740 10 client.25862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:26:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3d2855740 20 client.25862 populate_metadata read hostname 'smithi001' 2024-08-28T20:26:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf57f11c0 0x555bf5c875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:26:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3d2855740 4 client.25862 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:26:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.014+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555bf5b73960 con 0x555bf57f11c0 2024-08-28T20:26:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.015+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf57f11c0 0x555bf5c875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:26:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.015+0000 7ff3c3e00640 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf57f11c0 0x555bf5c875c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c078f9df0ad8ad61 server_cookie=f12ea09e13af1133 in_seq=0 out_seq=0 2024-08-28T20:26:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.015+0000 7ff3aaa00640 10 client.25862 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:49 smithi007 ceph-mon[25357]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.7 MiB/s wr, 708 op/s 2024-08-28T20:26:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.092+0000 7ff3aaa00640 1 -- 172.21.15.1:0/1236422383 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555bf5b73960 con 0x555bf57f11c0 2024-08-28T20:26:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.092+0000 7ff3aaa00640 10 client.25862 handle_command_reply: tid=0 2024-08-28T20:26:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.092+0000 7ff3d2855740 1 client.25862 shutdown 2024-08-28T20:26:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.093+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 msgr2=0x555bf5c13d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.093+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c13d00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x555bf5c19b60 tx=0x7ff3b0004730 comp rx=0 tx=0).stop 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 shutdown_connections 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x555bf57f11c0 0x555bf5c875c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555bf585d1b0 0x555bf5c12ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555bf583c4d0 0x555bf5c12590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 --2- 172.21.15.1:0/1236422383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bf58342f0 0x555bf5c13d00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 >> 172.21.15.1:0/1236422383 conn(0x555bf5851300 msgr2=0x555bf5c06bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3aaa00640 0 client.25862 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:26:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 shutdown_connections 2024-08-28T20:26:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.094+0000 7ff3d2855740 1 -- 172.21.15.1:0/1236422383 wait complete. 2024-08-28T20:26:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.096+0000 7ff3d2855740 20 client.25862 trim_cache size 0 max 16384 2024-08-28T20:26:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:26:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:26:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:26:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:26:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3ac0b4c30 msgr2=0x7ff3ac0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3ac0b4c30 0x7ff3ac0b7140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009bd0 tx=0x7ff3b0005f90 comp rx=0 tx=0).stop 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 msgr2=0x7ff3c41a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c41a0900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800e9f0 tx=0x7ff3b800edf0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 shutdown_connections 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff3ac0b4c30 0x7ff3ac0b7140 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3c410b3a0 0x7ff3c41a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3c4108a40 0x7ff3c41a0900 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 --2- 172.21.15.1:0/801874211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c406b3f0 0x7ff3c41a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:26:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 >> 172.21.15.1:0/801874211 conn(0x7ff3c40fdca0 msgr2=0x7ff3c4102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:26:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.097+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 shutdown_connections 2024-08-28T20:26:50.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:26:50.098+0000 7ff3cb800640 1 -- 172.21.15.1:0/801874211 wait complete. 2024-08-28T20:26:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:51 smithi001 ceph-mon[20984]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.1 MiB/s wr, 723 op/s 2024-08-28T20:26:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:51 smithi121 ceph-mon[25248]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.1 MiB/s wr, 723 op/s 2024-08-28T20:26:52.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:51 smithi007 ceph-mon[25357]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.1 MiB/s wr, 723 op/s 2024-08-28T20:26:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 505.0 s, 1535.2 tps, lat 65.351 ms stddev 81.561 2024-08-28T20:26:53.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:53 smithi121 ceph-mon[25248]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.7 MiB/s wr, 597 op/s 2024-08-28T20:26:53.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:53 smithi001 ceph-mon[20984]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.7 MiB/s wr, 597 op/s 2024-08-28T20:26:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:53 smithi007 ceph-mon[25357]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.7 MiB/s wr, 597 op/s 2024-08-28T20:26:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:55 smithi001 ceph-mon[20984]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 731 op/s 2024-08-28T20:26:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:55 smithi121 ceph-mon[25248]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 731 op/s 2024-08-28T20:26:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:55 smithi007 ceph-mon[25357]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 731 op/s 2024-08-28T20:26:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:57 smithi001 ceph-mon[20984]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.6 MiB/s wr, 654 op/s 2024-08-28T20:26:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:57 smithi121 ceph-mon[25248]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.6 MiB/s wr, 654 op/s 2024-08-28T20:26:58.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:57 smithi007 ceph-mon[25357]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.6 MiB/s wr, 654 op/s 2024-08-28T20:26:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 510.0 s, 1531.8 tps, lat 64.787 ms stddev 74.025 2024-08-28T20:27:00.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:26:59 smithi001 ceph-mon[20984]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-08-28T20:27:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:26:59 smithi121 ceph-mon[25248]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-08-28T20:27:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:26:59 smithi007 ceph-mon[25357]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-08-28T20:27:02.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:01 smithi001 ceph-mon[20984]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-08-28T20:27:02.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:01 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:01 smithi121 ceph-mon[25248]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-08-28T20:27:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:01 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:01 smithi007 ceph-mon[25357]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-08-28T20:27:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:01 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.407+0000 7f56c8200640 1 -- 172.21.15.1:0/2221843499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 msgr2=0x7f56b809c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.407+0000 7f56c8200640 1 --2- 172.21.15.1:0/2221843499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b809c7a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56ac01a870 tx=0x7f56ac03b390 comp rx=0 tx=0).stop 2024-08-28T20:27:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.408+0000 7f56c8200640 1 -- 172.21.15.1:0/2221843499 shutdown_connections 2024-08-28T20:27:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.408+0000 7f56c8200640 1 --2- 172.21.15.1:0/2221843499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b809d3b0 0x7f56b809d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.408+0000 7f56c8200640 1 --2- 172.21.15.1:0/2221843499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 0x7f56b80a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.408+0000 7f56c8200640 1 --2- 172.21.15.1:0/2221843499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b809c7a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.408+0000 7f56c8200640 1 -- 172.21.15.1:0/2221843499 >> 172.21.15.1:0/2221843499 conn(0x7f56b800b6a0 msgr2=0x7f56b809a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.409+0000 7f56c8200640 1 -- 172.21.15.1:0/2221843499 shutdown_connections 2024-08-28T20:27:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.409+0000 7f56c8200640 1 -- 172.21.15.1:0/2221843499 wait complete. 2024-08-28T20:27:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.411+0000 7f56c8200640 1 Processor -- start 2024-08-28T20:27:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.411+0000 7f56c8200640 1 -- start start 2024-08-28T20:27:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.412+0000 7f56c8200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b8132bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.412+0000 7f56c8200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b809d3b0 0x7f56b8133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.412+0000 7f56c8200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 0x7f56b8133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c8200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f56b80a8000 con 0x7f56b809d3b0 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c8200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56b80a7e80 con 0x7f56b809dd50 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c8200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56b80a8180 con 0x7f56b809c330 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 0x7f56b8133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b8132bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b8132bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35202/0 (socket says 172.21.15.1:35202) 2024-08-28T20:27:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.413+0000 7f56c5800640 1 -- 172.21.15.1:0/3472859965 learned_addr learned my addr 172.21.15.1:0/3472859965 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c6200640 1 -- 172.21.15.1:0/3472859965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 msgr2=0x7f56b8132bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c6200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b8132bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c4e00640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b809d3b0 0x7f56b8133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c6200640 1 -- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b809d3b0 msgr2=0x7f56b8133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c6200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b809d3b0 0x7f56b8133230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c6200640 1 -- 172.21.15.1:0/3472859965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b8134570 con 0x7f56b809dd50 2024-08-28T20:27:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.414+0000 7f56c6200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 0x7f56b8133de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f56c0066220 tx=0x7f56c0073510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.415+0000 7f56be000640 1 -- 172.21.15.1:0/3472859965 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c007e400 con 0x7f56b809dd50 2024-08-28T20:27:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.415+0000 7f56be000640 1 -- 172.21.15.1:0/3472859965 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c00768b0 con 0x7f56b809dd50 2024-08-28T20:27:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.415+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b8134860 con 0x7f56b809dd50 2024-08-28T20:27:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.415+0000 7f56be000640 1 -- 172.21.15.1:0/3472859965 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c007d6a0 con 0x7f56b809dd50 2024-08-28T20:27:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.415+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b813ae00 con 0x7f56b809dd50 2024-08-28T20:27:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.420+0000 7f56cf3e4740 1 Processor -- start 2024-08-28T20:27:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.423+0000 7f56be000640 1 -- 172.21.15.1:0/3472859965 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f56c0076cb0 con 0x7f56b809dd50 2024-08-28T20:27:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.423+0000 7f56cf3e4740 1 -- start start 2024-08-28T20:27:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.424+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372ef0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.424+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.424+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ef2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.424+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562372e63f70 con 0x562372b222f0 2024-08-28T20:27:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.424+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562372e53500 con 0x562372b2a4d0 2024-08-28T20:27:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.424+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562372e574b0 con 0x562372b4b1b0 2024-08-28T20:27:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372ef0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372ef0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35212/0 (socket says 172.21.15.1:35212) 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 -- 172.21.15.1:0/1639024187 learned_addr learned my addr 172.21.15.1:0/1639024187 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ef2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 -- 172.21.15.1:0/1639024187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 msgr2=0x562372ef0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372ef0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 -- 172.21.15.1:0/1639024187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 msgr2=0x562372ef1610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef1610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 -- 172.21.15.1:0/1639024187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562372e0dc10 con 0x562372b2a4d0 2024-08-28T20:27:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.425+0000 7f56c4e00640 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ef2160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56b4012820 tx=0x7f56b4005b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6158dc3a9ff6c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.426+0000 7f56b2a00640 1 -- 172.21.15.1:0/1639024187 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4012e60 con 0x562372b2a4d0 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.426+0000 7f56b2a00640 1 -- 172.21.15.1:0/1639024187 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b400fe20 con 0x562372b2a4d0 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.426+0000 7f56b2a00640 1 -- 172.21.15.1:0/1639024187 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b40047a0 con 0x562372b2a4d0 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1639024187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 msgr2=0x562372ef2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ef2160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56b4012820 tx=0x7f56b4005b60 comp rx=0 tx=0).stop 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56be000640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56a80b4be0 0x7f56a80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1639024187 shutdown_connections 2024-08-28T20:27:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ef2160 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1639024187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372ef0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1639024187 >> 172.21.15.1:0/1639024187 conn(0x562372b3f300 msgr2=0x562372eeca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.427+0000 7f56be000640 1 -- 172.21.15.1:0/3472859965 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f56c0149d50 con 0x7f56b809dd50 2024-08-28T20:27:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.428+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1639024187 shutdown_connections 2024-08-28T20:27:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.428+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1639024187 wait complete. 2024-08-28T20:27:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.429+0000 7f56cf3e4740 1 -- start start 2024-08-28T20:27:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.429+0000 7f56c5800640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56a80b4be0 0x7f56a80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.429+0000 7f56cf3e4740 1 Processor -- start 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372efa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372efad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372efb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562372d8cab0 con 0x562372b222f0 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562372dfa320 con 0x562372b2a4d0 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562372ef2c80 con 0x562372b4b1b0 2024-08-28T20:27:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.430+0000 7f56cf3e4740 10 client.0 _ll_register_callbacks cb 0x562372e006a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372efb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372efb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35224/0 (socket says 172.21.15.1:35224) 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 -- 172.21.15.1:0/2893807593 learned_addr learned my addr 172.21.15.1:0/2893807593 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c4e00640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372efad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c5800640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372efa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c5800640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56a80b4be0 0x7f56a80b70f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56ac01a600 tx=0x7f56ac041420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 -- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 msgr2=0x562372efad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372efad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 -- 172.21.15.1:0/2893807593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 msgr2=0x562372efa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372efa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.431+0000 7f56c6200640 1 -- 172.21.15.1:0/2893807593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562372bb6790 con 0x562372b4b1b0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.432+0000 7f56c4e00640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372efad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.432+0000 7f56c6200640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372efb890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f56c0068b70 tx=0x7f56c0119430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=401990f49c924c86 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.432+0000 7f56a7400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.432+0000 7f56a7400640 1 -- 172.21.15.1:0/2893807593 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0083040 con 0x562372b4b1b0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.432+0000 7f56a7400640 1 -- 172.21.15.1:0/2893807593 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f56c01197b0 con 0x562372b4b1b0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56b400fe20 con 0x562372b4b1b0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56a7400640 1 -- 172.21.15.1:0/2893807593 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f56c0114f80 con 0x562372b4b1b0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56cf3e4740 10 client.25843 fetch_fsmap learned FSMap version 45 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562372c2f620 con 0x562372b4b1b0 2024-08-28T20:27:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56a7400640 1 -- 172.21.15.1:0/2893807593 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b400fe20 con 0x562372b4b1b0 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56a7400640 1 -- 172.21.15.1:0/2893807593 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7f56c010c110 con 0x562372b4b1b0 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56cf3e4740 10 client.25843 fetch_fsmap finished waiting for FSMap version 45 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56cf3e4740 10 client.25843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.433+0000 7f56cf3e4740 20 client.25843 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.434+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372b09d80 0x562372f07df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.434+0000 7f56cf3e4740 4 client.25843 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.434+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562372e65ec0 con 0x562372b09d80 2024-08-28T20:27:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.434+0000 7f56c5800640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372b09d80 0x562372f07df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.436+0000 7f56c5800640 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372b09d80 0x562372f07df0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a582cfb8481dea26 server_cookie=7c4c667a868816a7 in_seq=0 out_seq=0 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.436+0000 7f56a7400640 10 client.25843 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.437+0000 7f56a7400640 1 -- 172.21.15.1:0/2893807593 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562372e65ec0 con 0x562372b09d80 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.437+0000 7f56a7400640 10 client.25843 handle_command_reply: tid=0 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.437+0000 7f56cf3e4740 1 client.25843 shutdown 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 msgr2=0x562372efb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372efb890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f56c0068b70 tx=0x7f56c0119430 comp rx=0 tx=0).stop 2024-08-28T20:27:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 shutdown_connections 2024-08-28T20:27:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372b09d80 0x562372f07df0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372efb890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372efad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2893807593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372efa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 >> 172.21.15.1:0/2893807593 conn(0x562372b3f300 msgr2=0x562372eeca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56a7400640 0 client.25843 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.438+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 shutdown_connections 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.439+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2893807593 wait complete. 2024-08-28T20:27:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.439+0000 7f56cf3e4740 20 client.25843 trim_cache size 0 max 16384 2024-08-28T20:27:03.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.475+0000 7f56cf3e4740 1 Processor -- start 2024-08-28T20:27:03.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 -- start start 2024-08-28T20:27:03.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ee7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372eebf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8146360 con 0x562372b222f0 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8143bd0 con 0x562372b2a4d0 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.476+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8141a20 con 0x562372b4b1b0 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372eebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372eebf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35240/0 (socket says 172.21.15.1:35240) 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c6200640 1 -- 172.21.15.1:0/1845621508 learned_addr learned my addr 172.21.15.1:0/1845621508 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:03.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c4e00640 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ee7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c5800640 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c6200640 1 -- 172.21.15.1:0/1845621508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 msgr2=0x562372ee7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c6200640 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ee7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.477+0000 7f56c6200640 1 -- 172.21.15.1:0/1845621508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 msgr2=0x562372ef12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.478+0000 7f56c6200640 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.478+0000 7f56c6200640 1 -- 172.21.15.1:0/1845621508 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562372efa430 con 0x562372b4b1b0 2024-08-28T20:27:03.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.478+0000 7f56c5800640 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:03.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.479+0000 7f56c6200640 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372eebf50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f56c01106a0 tx=0x7f56c010c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33b300638b24c7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:03.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.479+0000 7f56b2000640 1 -- 172.21.15.1:0/1845621508 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0083070 con 0x562372b4b1b0 2024-08-28T20:27:03.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.479+0000 7f56b2000640 1 -- 172.21.15.1:0/1845621508 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c01197b0 con 0x562372b4b1b0 2024-08-28T20:27:03.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.479+0000 7f56b2000640 1 -- 172.21.15.1:0/1845621508 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c010f970 con 0x562372b4b1b0 2024-08-28T20:27:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1845621508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 msgr2=0x562372eebf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372eebf50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f56c01106a0 tx=0x7f56c010c700 comp rx=0 tx=0).stop 2024-08-28T20:27:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1845621508 shutdown_connections 2024-08-28T20:27:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372eebf50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372ee7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/1845621508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372ef12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1845621508 >> 172.21.15.1:0/1845621508 conn(0x562372b3f300 msgr2=0x562372ef98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1845621508 shutdown_connections 2024-08-28T20:27:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.481+0000 7f56cf3e4740 1 -- 172.21.15.1:0/1845621508 wait complete. 2024-08-28T20:27:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.482+0000 7f56cf3e4740 1 -- start start 2024-08-28T20:27:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.482+0000 7f56cf3e4740 1 Processor -- start 2024-08-28T20:27:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372f022a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372f00f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372f014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8142090 con 0x562372b222f0 2024-08-28T20:27:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8143500 con 0x562372b2a4d0 2024-08-28T20:27:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8142760 con 0x562372b4b1b0 2024-08-28T20:27:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.484+0000 7f56cf3e4740 10 client.0 _ll_register_callbacks cb 0x7f56c010ff50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.485+0000 7f56c4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372f00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.485+0000 7f56c5800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372f022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.485+0000 7f56c4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372f00f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43402/0 (socket says 172.21.15.1:43402) 2024-08-28T20:27:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.485+0000 7f56c4e00640 1 -- 172.21.15.1:0/2009201011 learned_addr learned my addr 172.21.15.1:0/2009201011 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c6200640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372f014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c4e00640 1 -- 172.21.15.1:0/2009201011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 msgr2=0x562372f014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c4e00640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372f014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c4e00640 1 -- 172.21.15.1:0/2009201011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 msgr2=0x562372f022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c4e00640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372f022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c4e00640 1 -- 172.21.15.1:0/2009201011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562372f01a60 con 0x562372b2a4d0 2024-08-28T20:27:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c5800640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372f022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:27:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c6200640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372f014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56c4e00640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372f00f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56b40127c0 tx=0x7f56b4012510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdde5d04abe448fd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.486+0000 7f56a7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:27:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.487+0000 7f56a7400640 1 -- 172.21.15.1:0/2009201011 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b402c060 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.487+0000 7f56a7400640 1 -- 172.21.15.1:0/2009201011 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f56b4005040 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.487+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c01197b0 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.488+0000 7f56a7400640 1 -- 172.21.15.1:0/2009201011 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f56b4012e60 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.488+0000 7f56cf3e4740 10 client.25880 fetch_fsmap learned FSMap version 45 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.488+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562372f007d0 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56a7400640 1 -- 172.21.15.1:0/2009201011 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c01197b0 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56a7400640 1 -- 172.21.15.1:0/2009201011 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7f56b401d470 con 0x562372b2a4d0 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56cf3e4740 10 client.25880 fetch_fsmap finished waiting for FSMap version 45 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56cf3e4740 10 client.25880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56cf3e4740 20 client.25880 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372adf1c0 0x562372f74b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56cf3e4740 4 client.25880 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:27:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.489+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562372e61960 con 0x562372adf1c0 2024-08-28T20:27:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.490+0000 7f56c5800640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372adf1c0 0x562372f74b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.490+0000 7f56c5800640 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372adf1c0 0x562372f74b90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe802a7ea7080ae server_cookie=b2e585e229de1e05 in_seq=0 out_seq=0 2024-08-28T20:27:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.490+0000 7f56a7400640 10 client.25880 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.504+0000 7f56a7400640 1 -- 172.21.15.1:0/2009201011 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562372e61960 con 0x562372adf1c0 2024-08-28T20:27:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.504+0000 7f56a7400640 10 client.25880 handle_command_reply: tid=0 2024-08-28T20:27:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 client.25880 shutdown 2024-08-28T20:27:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 msgr2=0x562372f00f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372f00f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56b40127c0 tx=0x7f56b4012510 comp rx=0 tx=0).stop 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 shutdown_connections 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562372adf1c0 0x562372f74b90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562372b4b1b0 0x562372f014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562372b2a4d0 0x562372f00f60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 --2- 172.21.15.1:0/2009201011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562372b222f0 0x562372f022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.505+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 >> 172.21.15.1:0/2009201011 conn(0x562372b3f300 msgr2=0x562372ef98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.506+0000 7f56a7400640 0 client.25880 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.506+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 shutdown_connections 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.506+0000 7f56cf3e4740 1 -- 172.21.15.1:0/2009201011 wait complete. 2024-08-28T20:27:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.507+0000 7f56cf3e4740 20 client.25880 trim_cache size 0 max 16384 2024-08-28T20:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.507+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56a80b4be0 msgr2=0x7f56a80b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.507+0000 7f56c8200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56a80b4be0 0x7f56a80b70f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56ac01a600 tx=0x7f56ac041420 comp rx=0 tx=0).stop 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 msgr2=0x7f56b8133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 0x7f56b8133de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f56c0066220 tx=0x7f56c0073510 comp rx=0 tx=0).stop 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 shutdown_connections 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56a80b4be0 0x7f56a80b70f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f56b809d3b0 0x7f56b8133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56b809dd50 0x7f56b8133de0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 --2- 172.21.15.1:0/3472859965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b809c330 0x7f56b8132bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 >> 172.21.15.1:0/3472859965 conn(0x7f56b800b6a0 msgr2=0x7f56b80a06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 shutdown_connections 2024-08-28T20:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:03.508+0000 7f56c8200640 1 -- 172.21.15.1:0/3472859965 wait complete. 2024-08-28T20:27:03.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 515.0 s, 2709.4 tps, lat 37.258 ms stddev 46.204 2024-08-28T20:27:04.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:03 smithi001 ceph-mon[20984]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.6 MiB/s wr, 635 op/s 2024-08-28T20:27:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:03 smithi121 ceph-mon[25248]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.6 MiB/s wr, 635 op/s 2024-08-28T20:27:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:03 smithi007 ceph-mon[25357]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.6 MiB/s wr, 635 op/s 2024-08-28T20:27:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:05 smithi001 ceph-mon[20984]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 715 op/s 2024-08-28T20:27:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:05 smithi121 ceph-mon[25248]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 715 op/s 2024-08-28T20:27:06.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:05 smithi007 ceph-mon[25357]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 715 op/s 2024-08-28T20:27:07.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:06 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:07.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:06 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:07.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:06 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:07 smithi001 ceph-mon[20984]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-08-28T20:27:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:07 smithi121 ceph-mon[25248]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-08-28T20:27:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:07 smithi007 ceph-mon[25357]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-08-28T20:27:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 520.0 s, 2716.7 tps, lat 36.741 ms stddev 45.882 2024-08-28T20:27:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:09 smithi001 ceph-mon[20984]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 688 op/s 2024-08-28T20:27:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:09 smithi121 ceph-mon[25248]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 688 op/s 2024-08-28T20:27:10.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:09 smithi007 ceph-mon[25357]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 688 op/s 2024-08-28T20:27:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:11 smithi001 ceph-mon[20984]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 727 op/s 2024-08-28T20:27:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:11 smithi121 ceph-mon[25248]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 727 op/s 2024-08-28T20:27:12.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:11 smithi007 ceph-mon[25357]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 727 op/s 2024-08-28T20:27:13.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 525.0 s, 3060.5 tps, lat 32.759 ms stddev 44.282 2024-08-28T20:27:14.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:13 smithi001 ceph-mon[20984]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 713 op/s 2024-08-28T20:27:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:13 smithi121 ceph-mon[25248]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 713 op/s 2024-08-28T20:27:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:13 smithi007 ceph-mon[25357]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 713 op/s 2024-08-28T20:27:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:15 smithi001 ceph-mon[20984]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 809 op/s 2024-08-28T20:27:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:15 smithi121 ceph-mon[25248]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 809 op/s 2024-08-28T20:27:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:15 smithi007 ceph-mon[25357]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 809 op/s 2024-08-28T20:27:16.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 -- 172.21.15.1:0/1627826078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb4105670 msgr2=0x7fdeb4105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 --2- 172.21.15.1:0/1627826078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb4105670 0x7fdeb4105ae0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009900 tx=0x7fdea402a400 comp rx=0 tx=0).stop 2024-08-28T20:27:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 -- 172.21.15.1:0/1627826078 shutdown_connections 2024-08-28T20:27:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 --2- 172.21.15.1:0/1627826078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeb4107090 0x7fdeb410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 --2- 172.21.15.1:0/1627826078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb41066f0 0x7fdeb4106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 --2- 172.21.15.1:0/1627826078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb4105670 0x7fdeb4105ae0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.807+0000 7fdebae00640 1 -- 172.21.15.1:0/1627826078 >> 172.21.15.1:0/1627826078 conn(0x7fdeb4100fd0 msgr2=0x7fdeb4103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.808+0000 7fdebae00640 1 -- 172.21.15.1:0/1627826078 shutdown_connections 2024-08-28T20:27:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.808+0000 7fdebae00640 1 -- 172.21.15.1:0/1627826078 wait complete. 2024-08-28T20:27:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 Processor -- start 2024-08-28T20:27:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 -- start start 2024-08-28T20:27:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeb4105670 0x7fdeb4077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb41066f0 0x7fdeb4077fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 0x7fdeb4078b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4111300 con 0x7fdeb4105670 2024-08-28T20:27:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4111180 con 0x7fdeb4107090 2024-08-28T20:27:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.809+0000 7fdebae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4111480 con 0x7fdeb41066f0 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.810+0000 7fdeb8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 0x7fdeb4078b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.810+0000 7fdeb8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 0x7fdeb4078b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48116/0 (socket says 172.21.15.1:48116) 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.810+0000 7fdeb8e00640 1 -- 172.21.15.1:0/3888206957 learned_addr learned my addr 172.21.15.1:0/3888206957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.810+0000 7fdeb3400640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb41066f0 0x7fdeb4077fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.810+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeb4105670 0x7fdeb4077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.811+0000 7fdeb8e00640 1 -- 172.21.15.1:0/3888206957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb41066f0 msgr2=0x7fdeb4077fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.811+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb41066f0 0x7fdeb4077fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.811+0000 7fdeb8e00640 1 -- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeb4105670 msgr2=0x7fdeb4077960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.811+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeb4105670 0x7fdeb4077960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.811+0000 7fdeb8e00640 1 -- 172.21.15.1:0/3888206957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb40793a0 con 0x7fdeb4107090 2024-08-28T20:27:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.811+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 0x7fdeb4078b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00eb10 tx=0x7fdeac00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.812+0000 7fdeb0c00640 1 -- 172.21.15.1:0/3888206957 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac004b20 con 0x7fdeb4107090 2024-08-28T20:27:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.812+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb4079690 con 0x7fdeb4107090 2024-08-28T20:27:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.812+0000 7fdeb0c00640 1 -- 172.21.15.1:0/3888206957 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeac004cc0 con 0x7fdeb4107090 2024-08-28T20:27:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.812+0000 7fdeb0c00640 1 -- 172.21.15.1:0/3888206957 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac010690 con 0x7fdeb4107090 2024-08-28T20:27:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.812+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb4079d50 con 0x7fdeb4107090 2024-08-28T20:27:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.817+0000 7fdeb0c00640 1 -- 172.21.15.1:0/3888206957 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fdeac005020 con 0x7fdeb4107090 2024-08-28T20:27:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.817+0000 7fdec2023740 1 Processor -- start 2024-08-28T20:27:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.818+0000 7fdec2023740 1 -- start start 2024-08-28T20:27:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.819+0000 7fdec2023740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf631b0 0x55f29c308b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.819+0000 7fdeb0c00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde980b4bf0 0x7fde980b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdeb0c00640 1 -- 172.21.15.1:0/3888206957 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fdeac0e5860 con 0x7fdeb4107090 2024-08-28T20:27:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde980b4bf0 0x7fde980b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdec2023740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf3a2f0 0x55f29c3091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf631b0 0x55f29c308b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdec2023740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf424d0 0x55f29c309cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdec2023740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f29c27bf70 con 0x55f29bf424d0 2024-08-28T20:27:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdec2023740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f29c26b500 con 0x55f29bf631b0 2024-08-28T20:27:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.820+0000 7fdec2023740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f29c26f4b0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.821+0000 7fdeb8e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf424d0 0x55f29c309cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.821+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf3a2f0 0x55f29c3091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.821+0000 7fdeb8e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf424d0 0x55f29c309cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34728/0 (socket says 172.21.15.1:34728) 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.821+0000 7fdeb8e00640 1 -- 172.21.15.1:0/1688923674 learned_addr learned my addr 172.21.15.1:0/1688923674 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.821+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde980b4bf0 0x7fde980b7100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000c00 tx=0x7fdea4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdeb3400640 1 -- 172.21.15.1:0/1688923674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf631b0 msgr2=0x55f29c308b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdeb3400640 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf631b0 0x55f29c308b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdeb3400640 1 -- 172.21.15.1:0/1688923674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf424d0 msgr2=0x55f29c309cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdeb3400640 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf424d0 0x55f29c309cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdeb3400640 1 -- 172.21.15.1:0/1688923674 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29c225c10 con 0x55f29bf3a2f0 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdeb3400640 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf3a2f0 0x55f29c3091a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdea0013480 tx=0x7fdea0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e24952d0eeadf3b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdea9600640 1 -- 172.21.15.1:0/1688923674 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea000f680 con 0x55f29bf3a2f0 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.822+0000 7fdea9600640 1 -- 172.21.15.1:0/1688923674 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdea000fcd0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.823+0000 7fdea9600640 1 -- 172.21.15.1:0/1688923674 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea000ec70 con 0x55f29bf3a2f0 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.823+0000 7fdec2023740 1 -- 172.21.15.1:0/1688923674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf3a2f0 msgr2=0x55f29c3091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.823+0000 7fdec2023740 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf3a2f0 0x55f29c3091a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdea0013480 tx=0x7fdea0004730 comp rx=0 tx=0).stop 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 -- 172.21.15.1:0/1688923674 shutdown_connections 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf424d0 0x55f29c309cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf3a2f0 0x55f29c3091a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 --2- 172.21.15.1:0/1688923674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf631b0 0x55f29c308b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 -- 172.21.15.1:0/1688923674 >> 172.21.15.1:0/1688923674 conn(0x55f29bf57300 msgr2=0x55f29c3045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 -- 172.21.15.1:0/1688923674 shutdown_connections 2024-08-28T20:27:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.824+0000 7fdec2023740 1 -- 172.21.15.1:0/1688923674 wait complete. 2024-08-28T20:27:16.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.825+0000 7fdec2023740 1 -- start start 2024-08-28T20:27:16.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.825+0000 7fdec2023740 1 Processor -- start 2024-08-28T20:27:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdec2023740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c323290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdec2023740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c323950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdec2023740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c323290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c323950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdec2023740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f29c1a4ab0 con 0x55f29bf631b0 2024-08-28T20:27:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c323290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48132/0 (socket says 172.21.15.1:48132) 2024-08-28T20:27:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdec2023740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f29c212320 con 0x55f29bf3a2f0 2024-08-28T20:27:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f29c30a860 con 0x55f29bf424d0 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdeb3e00640 1 -- 172.21.15.1:0/643248763 learned_addr learned my addr 172.21.15.1:0/643248763 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.827+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdec2023740 10 client.0 _ll_register_callbacks cb 0x55f29c24be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3e00640 1 -- 172.21.15.1:0/643248763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 msgr2=0x55f29c323950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c323950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3e00640 1 -- 172.21.15.1:0/643248763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 msgr2=0x55f29c3244c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3244c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3e00640 1 -- 172.21.15.1:0/643248763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f29bfce790 con 0x55f29bf3a2f0 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3400640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c323950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c323290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdea4031500 tx=0x7fdea4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9894a0fba959e4e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fde9e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fde9e000640 1 -- 172.21.15.1:0/643248763 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea404c020 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.828+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea000fcd0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fde9e000640 1 -- 172.21.15.1:0/643248763 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fdea4004b90 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fde9e000640 1 -- 172.21.15.1:0/643248763 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fdea4057050 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 10 client.25892 fetch_fsmap learned FSMap version 46 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55f29c047620 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fde9e000640 1 -- 172.21.15.1:0/643248763 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdea000fcd0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fde9e000640 1 -- 172.21.15.1:0/643248763 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 46) ==== 8362+0+0 (secure 0 0 0) 0x7fdea40325b0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 10 client.25892 fetch_fsmap finished waiting for FSMap version 46 2024-08-28T20:27:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 10 client.25892 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 20 client.25892 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bf21d80 0x55f29c330a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 4 client.25892 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.829+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f29c27dec0 con 0x55f29bf21d80 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.830+0000 7fdeb3400640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bf21d80 0x55f29c330a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.830+0000 7fdeb3400640 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bf21d80 0x55f29c330a50 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0546f060d3be1fa server_cookie=591be21a06c40b84 in_seq=0 out_seq=0 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.830+0000 7fde9e000640 10 client.25892 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.831+0000 7fde9e000640 1 -- 172.21.15.1:0/643248763 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f29c27dec0 con 0x55f29bf21d80 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.831+0000 7fde9e000640 10 client.25892 handle_command_reply: tid=0 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.831+0000 7fdec2023740 1 client.25892 shutdown 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.831+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 msgr2=0x55f29c323290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.831+0000 7fdec2023740 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c323290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdea4031500 tx=0x7fdea4009260 comp rx=0 tx=0).stop 2024-08-28T20:27:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 shutdown_connections 2024-08-28T20:27:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bf21d80 0x55f29c330a50 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c323950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 --2- 172.21.15.1:0/643248763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c323290 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 >> 172.21.15.1:0/643248763 conn(0x55f29bf57300 msgr2=0x55f29c302b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fde9e000640 0 client.25892 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:16.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.832+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 shutdown_connections 2024-08-28T20:27:16.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.833+0000 7fdec2023740 1 -- 172.21.15.1:0/643248763 wait complete. 2024-08-28T20:27:16.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.833+0000 7fdec2023740 20 client.25892 trim_cache size 0 max 16384 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 Processor -- start 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 -- start start 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c305a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c303f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41ab4f0 con 0x55f29bf631b0 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41a2d20 con 0x55f29bf3a2f0 2024-08-28T20:27:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.857+0000 7fdec2023740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41a0b70 con 0x55f29bf424d0 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.858+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c303f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.858+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c305a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.858+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c303f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57990/0 (socket says 172.21.15.1:57990) 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.858+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c305a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48142/0 (socket says 172.21.15.1:48142) 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.858+0000 7fdeb3400640 1 -- 172.21.15.1:0/2662229172 learned_addr learned my addr 172.21.15.1:0/2662229172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.858+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdeb3400640 1 -- 172.21.15.1:0/2662229172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 msgr2=0x55f29c305a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdeb3400640 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c305a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdeb3400640 1 -- 172.21.15.1:0/2662229172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 msgr2=0x55f29c3224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdeb3400640 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdeb3400640 1 -- 172.21.15.1:0/2662229172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29c30e3b0 con 0x55f29bf424d0 2024-08-28T20:27:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdeb3400640 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c303f00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdea0011010 tx=0x7fdea000e7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56413814ce8e5425 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdea8c00640 1 -- 172.21.15.1:0/2662229172 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea000ec10 con 0x55f29bf424d0 2024-08-28T20:27:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdea8c00640 1 -- 172.21.15.1:0/2662229172 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdea000edb0 con 0x55f29bf424d0 2024-08-28T20:27:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.859+0000 7fdea8c00640 1 -- 172.21.15.1:0/2662229172 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea00047a0 con 0x55f29bf424d0 2024-08-28T20:27:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 -- 172.21.15.1:0/2662229172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 msgr2=0x55f29c303f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c303f00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdea0011010 tx=0x7fdea000e7b0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 -- 172.21.15.1:0/2662229172 shutdown_connections 2024-08-28T20:27:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c3224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c303f00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 --2- 172.21.15.1:0/2662229172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c305a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.860+0000 7fdec2023740 1 -- 172.21.15.1:0/2662229172 >> 172.21.15.1:0/2662229172 conn(0x55f29bf57300 msgr2=0x55f29c3309c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.861+0000 7fdec2023740 1 -- 172.21.15.1:0/2662229172 shutdown_connections 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.861+0000 7fdec2023740 1 -- 172.21.15.1:0/2662229172 wait complete. 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.861+0000 7fdec2023740 1 -- start start 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.861+0000 7fdec2023740 1 Processor -- start 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c32ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c329800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c329d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41a11e0 con 0x55f29bf631b0 2024-08-28T20:27:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41a2650 con 0x55f29bf3a2f0 2024-08-28T20:27:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41a18b0 con 0x55f29bf424d0 2024-08-28T20:27:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdec2023740 10 client.0 _ll_register_callbacks cb 0x7fdea403f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c32ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c32ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48152/0 (socket says 172.21.15.1:48152) 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb3e00640 1 -- 172.21.15.1:0/4006743567 learned_addr learned my addr 172.21.15.1:0/4006743567 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb3400640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c329800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c329d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb3e00640 1 -- 172.21.15.1:0/4006743567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 msgr2=0x55f29c329800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.862+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c329800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.863+0000 7fdeb3e00640 1 -- 172.21.15.1:0/4006743567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 msgr2=0x55f29c329d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.863+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c329d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.863+0000 7fdeb3e00640 1 -- 172.21.15.1:0/4006743567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f29c32a480 con 0x55f29bf3a2f0 2024-08-28T20:27:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.863+0000 7fdeb3400640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c329800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:27:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.863+0000 7fdeb8e00640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c329d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.864+0000 7fdeb3e00640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c32ab40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdea4032b90 tx=0x7fdea4032860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd020c112efa071 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.864+0000 7fde9e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.865+0000 7fde9e000640 1 -- 172.21.15.1:0/4006743567 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea404c070 con 0x55f29bf3a2f0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.865+0000 7fde9e000640 1 -- 172.21.15.1:0/4006743567 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fdea4004b90 con 0x55f29bf3a2f0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.865+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea000edb0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fde9e000640 1 -- 172.21.15.1:0/4006743567 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fdea4069050 con 0x55f29bf3a2f0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fdec2023740 10 client.25898 fetch_fsmap learned FSMap version 46 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55f29c39b450 con 0x55f29bf3a2f0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fde9e000640 1 -- 172.21.15.1:0/4006743567 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdea000edb0 con 0x55f29bf3a2f0 2024-08-28T20:27:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fde9e000640 1 -- 172.21.15.1:0/4006743567 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 46) ==== 8362+0+0 (secure 0 0 0) 0x7fdea4048480 con 0x55f29bf3a2f0 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fdec2023740 10 client.25898 fetch_fsmap finished waiting for FSMap version 46 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fdec2023740 10 client.25898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fdec2023740 20 client.25898 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.866+0000 7fdec2023740 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bef71c0 0x55f29c39ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.867+0000 7fdec2023740 4 client.25898 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.867+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f29c279960 con 0x55f29bef71c0 2024-08-28T20:27:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.867+0000 7fdeb3400640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bef71c0 0x55f29c39ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.868+0000 7fdeb3400640 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bef71c0 0x55f29c39ddd0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6895af45d3f6ee1c server_cookie=29e64181f01523db in_seq=0 out_seq=0 2024-08-28T20:27:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.868+0000 7fde9e000640 10 client.25898 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.913+0000 7fde9e000640 1 -- 172.21.15.1:0/4006743567 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f29c279960 con 0x55f29bef71c0 2024-08-28T20:27:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.913+0000 7fde9e000640 10 client.25898 handle_command_reply: tid=0 2024-08-28T20:27:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.913+0000 7fdec2023740 1 client.25898 shutdown 2024-08-28T20:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.913+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 msgr2=0x55f29c32ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.913+0000 7fdec2023740 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c32ab40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdea4032b90 tx=0x7fdea4032860 comp rx=0 tx=0).stop 2024-08-28T20:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 shutdown_connections 2024-08-28T20:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f29bef71c0 0x55f29c39ddd0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f29bf631b0 0x55f29c329d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f29bf424d0 0x55f29c329800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 --2- 172.21.15.1:0/4006743567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f29bf3a2f0 0x55f29c32ab40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fde9e000640 0 client.25898 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 >> 172.21.15.1:0/4006743567 conn(0x55f29bf57300 msgr2=0x55f29c3309c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 shutdown_connections 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.914+0000 7fdec2023740 1 -- 172.21.15.1:0/4006743567 wait complete. 2024-08-28T20:27:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.915+0000 7fdec2023740 20 client.25898 trim_cache size 0 max 16384 2024-08-28T20:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde980b4bf0 msgr2=0x7fde980b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde980b4bf0 0x7fde980b7100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000c00 tx=0x7fdea4031400 comp rx=0 tx=0).stop 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 msgr2=0x7fdeb4078b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 0x7fdeb4078b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00eb10 tx=0x7fdeac00c2d0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 shutdown_connections 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fde980b4bf0 0x7fde980b7100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdeb4107090 0x7fdeb4078b80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb41066f0 0x7fdeb4077fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 --2- 172.21.15.1:0/3888206957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdeb4105670 0x7fdeb4077960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 >> 172.21.15.1:0/3888206957 conn(0x7fdeb4100fd0 msgr2=0x7fdeb4109a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.916+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 shutdown_connections 2024-08-28T20:27:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:16.917+0000 7fdebae00640 1 -- 172.21.15.1:0/3888206957 wait complete. 2024-08-28T20:27:18.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:17 smithi001 ceph-mon[20984]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-08-28T20:27:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:17 smithi121 ceph-mon[25248]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-08-28T20:27:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:17 smithi007 ceph-mon[25357]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.1 MiB/s wr, 717 op/s 2024-08-28T20:27:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 530.0 s, 2020.9 tps, lat 48.854 ms stddev 58.300 2024-08-28T20:27:20.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:19 smithi007 ceph-mon[25357]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.6 MiB/s wr, 765 op/s 2024-08-28T20:27:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:19 smithi001 ceph-mon[20984]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.6 MiB/s wr, 765 op/s 2024-08-28T20:27:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:19 smithi121 ceph-mon[25248]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.6 MiB/s wr, 765 op/s 2024-08-28T20:27:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:22 smithi007 ceph-mon[25357]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 754 op/s 2024-08-28T20:27:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:22 smithi001 ceph-mon[20984]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 754 op/s 2024-08-28T20:27:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:22 smithi121 ceph-mon[25248]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 754 op/s 2024-08-28T20:27:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 535.0 s, 1635.0 tps, lat 61.208 ms stddev 67.092 2024-08-28T20:27:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:24 smithi007 ceph-mon[25357]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:27:24.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:24 smithi121 ceph-mon[25248]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:27:24.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:24 smithi001 ceph-mon[20984]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:27:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:26 smithi007 ceph-mon[25357]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 728 op/s 2024-08-28T20:27:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:26 smithi001 ceph-mon[20984]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 728 op/s 2024-08-28T20:27:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:26 smithi121 ceph-mon[25248]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 728 op/s 2024-08-28T20:27:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:28 smithi007 ceph-mon[25357]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-08-28T20:27:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:28 smithi001 ceph-mon[20984]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-08-28T20:27:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:28 smithi121 ceph-mon[25248]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-08-28T20:27:28.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 540.0 s, 1909.2 tps, lat 52.822 ms stddev 62.939 2024-08-28T20:27:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 -- 172.21.15.1:0/988472267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 msgr2=0x7f3ef8111c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 --2- 172.21.15.1:0/988472267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef8111c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009ca0 tx=0x7f3ef002a8e0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 -- 172.21.15.1:0/988472267 shutdown_connections 2024-08-28T20:27:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 --2- 172.21.15.1:0/988472267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef8111c70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 --2- 172.21.15.1:0/988472267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 0x7f3ef810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 --2- 172.21.15.1:0/988472267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 0x7f3ef8109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 -- 172.21.15.1:0/988472267 >> 172.21.15.1:0/988472267 conn(0x7f3ef8078c20 msgr2=0x7f3ef807b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.217+0000 7f3ef7200640 1 -- 172.21.15.1:0/988472267 shutdown_connections 2024-08-28T20:27:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.218+0000 7f3ef7200640 1 -- 172.21.15.1:0/988472267 wait complete. 2024-08-28T20:27:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.219+0000 7f3ef7200640 1 Processor -- start 2024-08-28T20:27:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 -- start start 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 0x7f3ef81a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 0x7f3ef81a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef81a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8115640 con 0x7f3ef81098b0 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef81154c0 con 0x7f3ef810a930 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.221+0000 7f3ef7200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef81157c0 con 0x7f3ef810b2d0 2024-08-28T20:27:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef81a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 0x7f3ef81a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef81a12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33836/0 (socket says 172.21.15.1:33836) 2024-08-28T20:27:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef6800640 1 -- 172.21.15.1:0/2215740536 learned_addr learned my addr 172.21.15.1:0/2215740536 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef5400640 1 -- 172.21.15.1:0/2215740536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 msgr2=0x7f3ef81a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef5400640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef81a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.222+0000 7f3ef5400640 1 -- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 msgr2=0x7f3ef81a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.225+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 0x7f3ef81a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.225+0000 7f3ef5400640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 0x7f3ef81a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.225+0000 7f3ef5400640 1 -- 172.21.15.1:0/2215740536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef81a1b10 con 0x7f3ef810a930 2024-08-28T20:27:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.225+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 0x7f3ef81a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.226+0000 7f3ef5400640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 0x7f3ef81a0740 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009fd0 tx=0x7f3ee400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.227+0000 7f3eeea00640 1 -- 172.21.15.1:0/2215740536 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4015020 con 0x7f3ef810a930 2024-08-28T20:27:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.227+0000 7f3eeea00640 1 -- 172.21.15.1:0/2215740536 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ee4011ce0 con 0x7f3ef810a930 2024-08-28T20:27:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.227+0000 7f3eeea00640 1 -- 172.21.15.1:0/2215740536 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4010de0 con 0x7f3ef810a930 2024-08-28T20:27:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.227+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef81a1e00 con 0x7f3ef810a930 2024-08-28T20:27:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.227+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef81a84f0 con 0x7f3ef810a930 2024-08-28T20:27:30.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.233+0000 7f3f042d0740 1 Processor -- start 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 -- start start 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7f9f4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eb7f966f70 con 0x55eb7f64e1b0 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eb7f956500 con 0x55eb7f62d4d0 2024-08-28T20:27:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.234+0000 7f3f042d0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55eb7f95a4b0 con 0x55eb7f6252f0 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7f9f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7f9f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33840/0 (socket says 172.21.15.1:33840) 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef5e00640 1 -- 172.21.15.1:0/2129214507 learned_addr learned my addr 172.21.15.1:0/2129214507 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef6800640 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef5e00640 1 -- 172.21.15.1:0/2129214507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f62d4d0 msgr2=0x55eb7f9f5160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f5160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.235+0000 7f3ef5e00640 1 -- 172.21.15.1:0/2129214507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 msgr2=0x55eb7f9f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.236+0000 7f3eeea00640 1 -- 172.21.15.1:0/2215740536 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f3ee4018020 con 0x7f3ef810a930 2024-08-28T20:27:30.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.237+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.237+0000 7f3ef5e00640 1 -- 172.21.15.1:0/2129214507 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb7f910c10 con 0x55eb7f6252f0 2024-08-28T20:27:30.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.237+0000 7f3ef6800640 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.238+0000 7f3eeea00640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3edc0b4b60 0x7f3edc0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.238+0000 7f3eeea00640 1 -- 172.21.15.1:0/2215740536 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3ee40e4950 con 0x7f3ef810a930 2024-08-28T20:27:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.240+0000 7f3ef6800640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3edc0b4b60 0x7f3edc0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.241+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7f9f4610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800aa10 tx=0x7f3ee800aed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6047c7608ffb7b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.244+0000 7f3ef6800640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3edc0b4b60 0x7f3edc0b7070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00094e0 tx=0x7f3ef0031830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.248+0000 7f3ee3400640 1 -- 172.21.15.1:0/2129214507 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8015070 con 0x55eb7f6252f0 2024-08-28T20:27:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.249+0000 7f3ee3400640 1 -- 172.21.15.1:0/2129214507 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ee800cc60 con 0x55eb7f6252f0 2024-08-28T20:27:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.249+0000 7f3ee3400640 1 -- 172.21.15.1:0/2129214507 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8018580 con 0x55eb7f6252f0 2024-08-28T20:27:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 -- 172.21.15.1:0/2129214507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 msgr2=0x55eb7f9f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7f9f4610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800aa10 tx=0x7f3ee800aed0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 -- 172.21.15.1:0/2129214507 shutdown_connections 2024-08-28T20:27:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7f9f4610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 --2- 172.21.15.1:0/2129214507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.251+0000 7f3f042d0740 1 -- 172.21.15.1:0/2129214507 >> 172.21.15.1:0/2129214507 conn(0x55eb7f642300 msgr2=0x55eb7f9efa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.252+0000 7f3f042d0740 1 -- 172.21.15.1:0/2129214507 shutdown_connections 2024-08-28T20:27:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.252+0000 7f3f042d0740 1 -- 172.21.15.1:0/2129214507 wait complete. 2024-08-28T20:27:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.254+0000 7f3f042d0740 1 -- start start 2024-08-28T20:27:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.255+0000 7f3f042d0740 1 Processor -- start 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 0x55eb7f9fd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9fdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eb7f88fab0 con 0x55eb7f64e1b0 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eb7f8fd320 con 0x55eb7f6252f0 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55eb7f9f5c80 con 0x55eb7f62d4d0 2024-08-28T20:27:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.259+0000 7f3f042d0740 10 client.0 _ll_register_callbacks cb 0x55eb7f9036a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.260+0000 7f3ef6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.260+0000 7f3ef5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 0x55eb7f9fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.260+0000 7f3ef5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 0x55eb7f9fd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47160/0 (socket says 172.21.15.1:47160) 2024-08-28T20:27:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.260+0000 7f3ef5e00640 1 -- 172.21.15.1:0/536858024 learned_addr learned my addr 172.21.15.1:0/536858024 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.261+0000 7f3ef5e00640 1 -- 172.21.15.1:0/536858024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 msgr2=0x55eb7f9fdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.261+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9fdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.261+0000 7f3ef5e00640 1 -- 172.21.15.1:0/536858024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 msgr2=0x55eb7f9fe8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.261+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9fe8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.261+0000 7f3ef5e00640 1 -- 172.21.15.1:0/536858024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb7f6b9790 con 0x55eb7f6252f0 2024-08-28T20:27:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.261+0000 7f3ef6800640 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:30.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.262+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 0x55eb7f9fd670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800a9e0 tx=0x7f3ee8011b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfbf93f7961bd1a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.262+0000 7f3ed7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:27:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.263+0000 7f3ed7e00640 1 -- 172.21.15.1:0/536858024 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8020070 con 0x55eb7f6252f0 2024-08-28T20:27:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.263+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ee800cc60 con 0x55eb7f6252f0 2024-08-28T20:27:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.266+0000 7f3ed7e00640 1 -- 172.21.15.1:0/536858024 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3ee801a660 con 0x55eb7f6252f0 2024-08-28T20:27:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.266+0000 7f3ed7e00640 1 -- 172.21.15.1:0/536858024 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f3ee8015040 con 0x55eb7f6252f0 2024-08-28T20:27:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.266+0000 7f3f042d0740 10 client.25904 fetch_fsmap learned FSMap version 47 2024-08-28T20:27:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.266+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55eb7f732620 con 0x55eb7f6252f0 2024-08-28T20:27:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.267+0000 7f3ed7e00640 1 -- 172.21.15.1:0/536858024 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ee800cc60 con 0x55eb7f6252f0 2024-08-28T20:27:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.267+0000 7f3ed7e00640 1 -- 172.21.15.1:0/536858024 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 47) ==== 8358+0+0 (secure 0 0 0) 0x7f3ee802d050 con 0x55eb7f6252f0 2024-08-28T20:27:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.268+0000 7f3f042d0740 10 client.25904 fetch_fsmap finished waiting for FSMap version 47 2024-08-28T20:27:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.268+0000 7f3f042d0740 10 client.25904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.268+0000 7f3f042d0740 20 client.25904 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.268+0000 7f3f042d0740 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f60cd80 0x55eb7fa1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.268+0000 7f3f042d0740 4 client.25904 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:27:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.268+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb7f968ec0 con 0x55eb7f60cd80 2024-08-28T20:27:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.270+0000 7f3ef5400640 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f60cd80 0x55eb7fa1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.271+0000 7f3ef5400640 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f60cd80 0x55eb7fa1ba10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5151af424e4d0abc server_cookie=4c7f5cf1496185ba in_seq=0 out_seq=0 2024-08-28T20:27:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.271+0000 7f3ed7e00640 10 client.25904 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.272+0000 7f3ed7e00640 1 -- 172.21.15.1:0/536858024 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb7f968ec0 con 0x55eb7f60cd80 2024-08-28T20:27:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.272+0000 7f3ed7e00640 10 client.25904 handle_command_reply: tid=0 2024-08-28T20:27:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.273+0000 7f3f042d0740 1 client.25904 shutdown 2024-08-28T20:27:30.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 msgr2=0x55eb7f9fd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 0x55eb7f9fd670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800a9e0 tx=0x7f3ee8011b80 comp rx=0 tx=0).stop 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 shutdown_connections 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f60cd80 0x55eb7fa1ba10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9fdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 --2- 172.21.15.1:0/536858024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f6252f0 0x55eb7f9fd670 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 >> 172.21.15.1:0/536858024 conn(0x55eb7f642300 msgr2=0x55eb7f9edf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.274+0000 7f3ed7e00640 0 client.25904 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.275+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 shutdown_connections 2024-08-28T20:27:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.275+0000 7f3f042d0740 1 -- 172.21.15.1:0/536858024 wait complete. 2024-08-28T20:27:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.276+0000 7f3f042d0740 20 client.25904 trim_cache size 0 max 16384 2024-08-28T20:27:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.311+0000 7f3f042d0740 1 Processor -- start 2024-08-28T20:27:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.312+0000 7f3f042d0740 1 -- start start 2024-08-28T20:27:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f6252f0 0x55eb7f9ef370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3f042d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef81ab2e0 con 0x55eb7f6252f0 2024-08-28T20:27:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3f042d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef81a8b80 con 0x55eb7f64e1b0 2024-08-28T20:27:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3f042d0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8073630 con 0x55eb7f62d4d0 2024-08-28T20:27:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:30 smithi007 ceph-mon[25357]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 584 op/s 2024-08-28T20:27:30.316 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:30 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.313+0000 7f3ef5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33870/0 (socket says 172.21.15.1:33870) 2024-08-28T20:27:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef5400640 1 -- 172.21.15.1:0/3621297898 learned_addr learned my addr 172.21.15.1:0/3621297898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f6252f0 0x55eb7f9ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef6800640 1 -- 172.21.15.1:0/3621297898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 msgr2=0x55eb7f9f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef6800640 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef6800640 1 -- 172.21.15.1:0/3621297898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f6252f0 msgr2=0x55eb7f9ef370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.314+0000 7f3ef6800640 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f6252f0 0x55eb7f9ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.315+0000 7f3ef6800640 1 -- 172.21.15.1:0/3621297898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb7f9ead70 con 0x55eb7f64e1b0 2024-08-28T20:27:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.315+0000 7f3ef6800640 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f4480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0031e40 tx=0x7f3ef003e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2322bbe4ee6369b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.316+0000 7f3ee2a00640 1 -- 172.21.15.1:0/3621297898 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0004240 con 0x55eb7f64e1b0 2024-08-28T20:27:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.316+0000 7f3ee2a00640 1 -- 172.21.15.1:0/3621297898 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef0036040 con 0x55eb7f64e1b0 2024-08-28T20:27:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.316+0000 7f3ee2a00640 1 -- 172.21.15.1:0/3621297898 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0030e00 con 0x55eb7f64e1b0 2024-08-28T20:27:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 -- 172.21.15.1:0/3621297898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 msgr2=0x55eb7f9f4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f4480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0031e40 tx=0x7f3ef003e000 comp rx=0 tx=0).stop 2024-08-28T20:27:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 -- 172.21.15.1:0/3621297898 shutdown_connections 2024-08-28T20:27:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7f9f4480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f62d4d0 0x55eb7f9f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 --2- 172.21.15.1:0/3621297898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f6252f0 0x55eb7f9ef370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.318+0000 7f3f042d0740 1 -- 172.21.15.1:0/3621297898 >> 172.21.15.1:0/3621297898 conn(0x55eb7f642300 msgr2=0x55eb7f9ea660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.319+0000 7f3f042d0740 1 -- 172.21.15.1:0/3621297898 shutdown_connections 2024-08-28T20:27:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.320+0000 7f3f042d0740 1 -- 172.21.15.1:0/3621297898 wait complete. 2024-08-28T20:27:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.320+0000 7f3f042d0740 1 -- start start 2024-08-28T20:27:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.320+0000 7f3f042d0740 1 Processor -- start 2024-08-28T20:27:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.321+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7fa04c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.321+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f62d4d0 0x55eb7fa00a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.321+0000 7f3f042d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7fa00f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.321+0000 7f3f042d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8073ca0 con 0x55eb7f62d4d0 2024-08-28T20:27:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.321+0000 7f3f042d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8075110 con 0x55eb7f64e1b0 2024-08-28T20:27:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.321+0000 7f3f042d0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8074370 con 0x55eb7f6252f0 2024-08-28T20:27:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.322+0000 7f3f042d0740 10 client.0 _ll_register_callbacks cb 0x7f3ee8011820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.322+0000 7f3ef6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7fa00f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.322+0000 7f3ef6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7fa00f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47178/0 (socket says 172.21.15.1:47178) 2024-08-28T20:27:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.322+0000 7f3ef6800640 1 -- 172.21.15.1:0/1440592226 learned_addr learned my addr 172.21.15.1:0/1440592226 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.322+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7fa04c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.322+0000 7f3ef5400640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f62d4d0 0x55eb7fa00a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef5e00640 1 -- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 msgr2=0x55eb7fa00f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7fa00f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef5e00640 1 -- 172.21.15.1:0/1440592226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f62d4d0 msgr2=0x55eb7fa00a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f62d4d0 0x55eb7fa00a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef5e00640 1 -- 172.21.15.1:0/1440592226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb7fa014b0 con 0x55eb7f6252f0 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef6800640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7fa00f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ef5e00640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7fa04c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ee802eab0 tx=0x7f3ee80117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3518aab3f87c2dcb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ed7e00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:27:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ed7e00640 1 -- 172.21.15.1:0/1440592226 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8020040 con 0x55eb7f6252f0 2024-08-28T20:27:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3ed7e00640 1 -- 172.21.15.1:0/1440592226 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3ee802e410 con 0x55eb7f6252f0 2024-08-28T20:27:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.323+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef0036040 con 0x55eb7f6252f0 2024-08-28T20:27:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.324+0000 7f3ed7e00640 1 -- 172.21.15.1:0/1440592226 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f3ee803e050 con 0x55eb7f6252f0 2024-08-28T20:27:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.324+0000 7f3f042d0740 10 client.25879 fetch_fsmap learned FSMap version 47 2024-08-28T20:27:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.324+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55eb7fa86420 con 0x55eb7f6252f0 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3ed7e00640 1 -- 172.21.15.1:0/1440592226 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef0036040 con 0x55eb7f6252f0 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3ed7e00640 1 -- 172.21.15.1:0/1440592226 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 47) ==== 8358+0+0 (secure 0 0 0) 0x7f3ee802d070 con 0x55eb7f6252f0 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3f042d0740 10 client.25879 fetch_fsmap finished waiting for FSMap version 47 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3f042d0740 10 client.25879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3f042d0740 20 client.25879 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3f042d0740 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f5e21c0 0x55eb7fa88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3f042d0740 4 client.25879 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:27:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.325+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb7f964960 con 0x55eb7f5e21c0 2024-08-28T20:27:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.326+0000 7f3ef5400640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f5e21c0 0x55eb7fa88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.327+0000 7f3ef5400640 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f5e21c0 0x55eb7fa88e70 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427a7bab64b18b37 server_cookie=35eb5914049db663 in_seq=0 out_seq=0 2024-08-28T20:27:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.327+0000 7f3ed7e00640 10 client.25879 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3ed7e00640 1 -- 172.21.15.1:0/1440592226 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb7f964960 con 0x55eb7f5e21c0 2024-08-28T20:27:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3ed7e00640 10 client.25879 handle_command_reply: tid=0 2024-08-28T20:27:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3f042d0740 1 client.25879 shutdown 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 msgr2=0x55eb7fa04c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3f042d0740 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7fa04c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ee802eab0 tx=0x7f3ee80117b0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 shutdown_connections 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.342+0000 7f3f042d0740 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55eb7f5e21c0 0x55eb7fa88e70 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eb7f62d4d0 0x55eb7fa00a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb7f64e1b0 0x55eb7fa00f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 1 --2- 172.21.15.1:0/1440592226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eb7f6252f0 0x55eb7fa04c20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 >> 172.21.15.1:0/1440592226 conn(0x55eb7f642300 msgr2=0x55eb7f9ea660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3ed7e00640 0 client.25879 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 shutdown_connections 2024-08-28T20:27:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 1 -- 172.21.15.1:0/1440592226 wait complete. 2024-08-28T20:27:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.343+0000 7f3f042d0740 20 client.25879 trim_cache size 0 max 16384 2024-08-28T20:27:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:27:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:27:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:27:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:27:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.345+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3edc0b4b60 msgr2=0x7f3edc0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.345+0000 7f3ef7200640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3edc0b4b60 0x7f3edc0b7070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00094e0 tx=0x7f3ef0031830 comp rx=0 tx=0).stop 2024-08-28T20:27:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.345+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 msgr2=0x7f3ef81a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.345+0000 7f3ef7200640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 0x7f3ef81a0740 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009fd0 tx=0x7f3ee400b870 comp rx=0 tx=0).stop 2024-08-28T20:27:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 shutdown_connections 2024-08-28T20:27:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3edc0b4b60 0x7f3edc0b7070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ef810b2d0 0x7f3ef81a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ef810a930 0x7f3ef81a0740 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 --2- 172.21.15.1:0/2215740536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ef81098b0 0x7f3ef81a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 >> 172.21.15.1:0/2215740536 conn(0x7f3ef8078c20 msgr2=0x7f3ef810dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 shutdown_connections 2024-08-28T20:27:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:30.346+0000 7f3ef7200640 1 -- 172.21.15.1:0/2215740536 wait complete. 2024-08-28T20:27:30.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:30 smithi001 ceph-mon[20984]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 584 op/s 2024-08-28T20:27:30.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:30 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:30 smithi121 ceph-mon[25248]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 584 op/s 2024-08-28T20:27:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:30 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:27:31.317 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:31 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:27:31.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:31 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:27:31.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:31 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:27:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:32 smithi007 ceph-mon[25357]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 647 op/s 2024-08-28T20:27:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:27:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:27:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:27:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:32 smithi001 ceph-mon[20984]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 647 op/s 2024-08-28T20:27:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:27:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:27:32.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:27:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:32 smithi121 ceph-mon[25248]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 647 op/s 2024-08-28T20:27:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:27:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:27:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:27:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 545.0 s, 2032.2 tps, lat 48.877 ms stddev 56.866 2024-08-28T20:27:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:34 smithi007 ceph-mon[25357]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.1 MiB/s wr, 561 op/s 2024-08-28T20:27:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:34 smithi001 ceph-mon[20984]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.1 MiB/s wr, 561 op/s 2024-08-28T20:27:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:34 smithi121 ceph-mon[25248]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.1 MiB/s wr, 561 op/s 2024-08-28T20:27:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:36 smithi007 ceph-mon[25357]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 682 op/s 2024-08-28T20:27:36.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:36 smithi001 ceph-mon[20984]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 682 op/s 2024-08-28T20:27:36.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:36 smithi121 ceph-mon[25248]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 682 op/s 2024-08-28T20:27:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:38 smithi001 ceph-mon[20984]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.5 MiB/s wr, 648 op/s 2024-08-28T20:27:38.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:38 smithi121 ceph-mon[25248]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.5 MiB/s wr, 648 op/s 2024-08-28T20:27:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:38 smithi007 ceph-mon[25357]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.5 MiB/s wr, 648 op/s 2024-08-28T20:27:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 550.0 s, 1894.4 tps, lat 52.544 ms stddev 59.923 2024-08-28T20:27:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:40 smithi001 ceph-mon[20984]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 612 op/s 2024-08-28T20:27:40.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:40 smithi121 ceph-mon[25248]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 612 op/s 2024-08-28T20:27:40.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:40 smithi007 ceph-mon[25357]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 612 op/s 2024-08-28T20:27:42.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:42 smithi001 ceph-mon[20984]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 756 op/s 2024-08-28T20:27:42.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:42 smithi121 ceph-mon[25248]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 756 op/s 2024-08-28T20:27:42.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:42 smithi007 ceph-mon[25357]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 756 op/s 2024-08-28T20:27:43.488 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:43 smithi121 ceph-mon[25248]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.8 MiB/s wr, 581 op/s 2024-08-28T20:27:43.488 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:43 smithi001 ceph-mon[20984]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.8 MiB/s wr, 581 op/s 2024-08-28T20:27:43.576 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:43 smithi007 ceph-mon[25357]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.8 MiB/s wr, 581 op/s 2024-08-28T20:27:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.674+0000 7fd927e00640 1 -- 172.21.15.1:0/3677631563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd92010ab20 msgr2=0x7fd92010af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.674+0000 7fd927e00640 1 --2- 172.21.15.1:0/3677631563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd92010ab20 0x7fd92010af30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd910009900 tx=0x7fd91002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.677+0000 7fd927e00640 1 -- 172.21.15.1:0/3677631563 shutdown_connections 2024-08-28T20:27:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.677+0000 7fd927e00640 1 --2- 172.21.15.1:0/3677631563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd92010b4c0 0x7fd920111e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.677+0000 7fd927e00640 1 --2- 172.21.15.1:0/3677631563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd92010ab20 0x7fd92010af30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.677+0000 7fd927e00640 1 --2- 172.21.15.1:0/3677631563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd920109aa0 0x7fd920109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.677+0000 7fd927e00640 1 -- 172.21.15.1:0/3677631563 >> 172.21.15.1:0/3677631563 conn(0x7fd920078e00 msgr2=0x7fd920107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.679+0000 7fd927e00640 1 -- 172.21.15.1:0/3677631563 shutdown_connections 2024-08-28T20:27:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.679+0000 7fd927e00640 1 -- 172.21.15.1:0/3677631563 wait complete. 2024-08-28T20:27:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.681+0000 7fd927e00640 1 Processor -- start 2024-08-28T20:27:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.681+0000 7fd927e00640 1 -- start start 2024-08-28T20:27:43.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.682+0000 7fd927e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd920109aa0 0x7fd920080f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd927e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd92010ab20 0x7fd920081580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd927e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd92010b4c0 0x7fd920082130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd927e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201156d0 con 0x7fd92010b4c0 2024-08-28T20:27:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd927e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd920115550 con 0x7fd92010ab20 2024-08-28T20:27:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd927e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd920115850 con 0x7fd920109aa0 2024-08-28T20:27:43.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd925400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd920109aa0 0x7fd920080f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd925400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd920109aa0 0x7fd920080f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33872/0 (socket says 172.21.15.1:33872) 2024-08-28T20:27:43.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd925400640 1 -- 172.21.15.1:0/3253506812 learned_addr learned my addr 172.21.15.1:0/3253506812 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:43.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.683+0000 7fd924a00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd92010ab20 0x7fd920081580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.684+0000 7fd924a00640 1 -- 172.21.15.1:0/3253506812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd920109aa0 msgr2=0x7fd920080f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.684+0000 7fd924a00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd920109aa0 0x7fd920080f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.684+0000 7fd924a00640 1 -- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd92010b4c0 msgr2=0x7fd920082130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.684+0000 7fd924a00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd92010b4c0 0x7fd920082130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.684+0000 7fd924a00640 1 -- 172.21.15.1:0/3253506812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd920082950 con 0x7fd92010ab20 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.684+0000 7fd924a00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd92010ab20 0x7fd920081580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd910006010 tx=0x7fd910032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.685+0000 7fd91e000640 1 -- 172.21.15.1:0/3253506812 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91003f070 con 0x7fd92010ab20 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.685+0000 7fd91e000640 1 -- 172.21.15.1:0/3253506812 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd910003ca0 con 0x7fd92010ab20 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.685+0000 7fd91e000640 1 -- 172.21.15.1:0/3253506812 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910035070 con 0x7fd92010ab20 2024-08-28T20:27:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.685+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd920082be0 con 0x7fd92010ab20 2024-08-28T20:27:43.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.685+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd920083120 con 0x7fd92010ab20 2024-08-28T20:27:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.694+0000 7fd92eea7740 1 Processor -- start 2024-08-28T20:27:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.695+0000 7fd91e000640 1 -- 172.21.15.1:0/3253506812 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fd91003b4f0 con 0x7fd92010ab20 2024-08-28T20:27:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.696+0000 7fd92eea7740 1 -- start start 2024-08-28T20:27:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.696+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647d8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd925e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647d8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd925e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647d8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33888/0 (socket says 172.21.15.1:33888) 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd925e00640 1 -- 172.21.15.1:0/534867750 learned_addr learned my addr 172.21.15.1:0/534867750 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd92eea7740 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55726440a2f0 0x5572647d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd92eea7740 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647d9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55726474bf70 con 0x55726440a2f0 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55726473b500 con 0x5572644124d0 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.697+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55726473f4b0 con 0x5572644331b0 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.698+0000 7fd924a00640 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647d9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.698+0000 7fd91e000640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd9080b4bb0 0x7fd9080b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.698+0000 7fd925400640 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55726440a2f0 0x5572647d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.698+0000 7fd91e000640 1 -- 172.21.15.1:0/3253506812 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fd910105930 con 0x7fd92010ab20 2024-08-28T20:27:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.699+0000 7fd925400640 1 -- 172.21.15.1:0/534867750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 msgr2=0x5572647d8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.699+0000 7fd925e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd9080b4bb0 0x7fd9080b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.699+0000 7fd925400640 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647d8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.699+0000 7fd925400640 1 -- 172.21.15.1:0/534867750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 msgr2=0x5572647d9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.699+0000 7fd925400640 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647d9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.699+0000 7fd925400640 1 -- 172.21.15.1:0/534867750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572646f5c10 con 0x55726440a2f0 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.700+0000 7fd925400640 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55726440a2f0 0x5572647d91a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd918007e40 tx=0x7fd91800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2243a2278387bc5d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.701+0000 7fd925e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd9080b4bb0 0x7fd9080b70c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd914005fd0 tx=0x7fd914005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.701+0000 7fd90e600640 1 -- 172.21.15.1:0/534867750 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918014070 con 0x55726440a2f0 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.701+0000 7fd90e600640 1 -- 172.21.15.1:0/534867750 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd918003b70 con 0x55726440a2f0 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.701+0000 7fd90e600640 1 -- 172.21.15.1:0/534867750 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918010880 con 0x55726440a2f0 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.702+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55726440a2f0 msgr2=0x5572647d91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.702+0000 7fd92eea7740 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55726440a2f0 0x5572647d91a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd918007e40 tx=0x7fd91800e720 comp rx=0 tx=0).stop 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.703+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 shutdown_connections 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.703+0000 7fd92eea7740 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55726440a2f0 0x5572647d91a0 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd918007e40 tx=0x7fd91800e720 comp rx=0 tx=0).stop 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.703+0000 7fd92eea7740 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647d9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.703+0000 7fd92eea7740 1 --2- 172.21.15.1:0/534867750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647d8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.703+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 >> 172.21.15.1:0/534867750 conn(0x557264427300 msgr2=0x5572647d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.703+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 shutdown_connections 2024-08-28T20:27:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.705+0000 7fd92eea7740 1 -- 172.21.15.1:0/534867750 wait complete. 2024-08-28T20:27:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.706+0000 7fd92eea7740 1 -- start start 2024-08-28T20:27:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.706+0000 7fd92eea7740 1 Processor -- start 2024-08-28T20:27:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.708+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.708+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644331b0 0x5572647e2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.708+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd925400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd925400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647e22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39404/0 (socket says 172.21.15.1:39404) 2024-08-28T20:27:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd925400640 1 -- 172.21.15.1:0/2751453182 learned_addr learned my addr 172.21.15.1:0/2751453182 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd92eea7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557264674ab0 con 0x5572644331b0 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572646e2320 con 0x5572644124d0 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5572647da810 con 0x5572643f1d80 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd925e00640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd924a00640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644331b0 0x5572647e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.709+0000 7fd92eea7740 10 client.0 _ll_register_callbacks cb 0x55726471be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd925400640 1 -- 172.21.15.1:0/2751453182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 msgr2=0x5572647e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd925400640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd925400640 1 -- 172.21.15.1:0/2751453182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644331b0 msgr2=0x5572647e2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd925400640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644331b0 0x5572647e2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd925400640 1 -- 172.21.15.1:0/2751453182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726449e790 con 0x5572644124d0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd925e00640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.710+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd918003b70 con 0x5572644124d0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.711+0000 7fd925400640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647e22d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd918017000 tx=0x7fd918004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f60cdd41b51abf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.711+0000 7fd902a00640 10 client.25919 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.712+0000 7fd902a00640 1 -- 172.21.15.1:0/2751453182 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918027060 con 0x5572644124d0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.712+0000 7fd902a00640 1 -- 172.21.15.1:0/2751453182 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fd918010850 con 0x5572644124d0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.712+0000 7fd902a00640 1 -- 172.21.15.1:0/2751453182 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd918014070 con 0x5572644124d0 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.712+0000 7fd92eea7740 10 client.25919 fetch_fsmap learned FSMap version 47 2024-08-28T20:27:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.712+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=47}) -- 0x557264517620 con 0x5572644124d0 2024-08-28T20:27:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd902a00640 1 -- 172.21.15.1:0/2751453182 <== mon.2 v2:172.21.15.7:3300/0 4 ==== fsmap(e 47) ==== 8358+0+0 (secure 0 0 0) 0x7fd918010a50 con 0x5572644124d0 2024-08-28T20:27:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd92eea7740 10 client.25919 fetch_fsmap finished waiting for FSMap version 47 2024-08-28T20:27:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd92eea7740 10 client.25919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd92eea7740 20 client.25919 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd92eea7740 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5572643c71c0 0x5572647ef500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd92eea7740 4 client.25919 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:27:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55726474dec0 con 0x5572643c71c0 2024-08-28T20:27:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.715+0000 7fd924a00640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5572643c71c0 0x5572647ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.717+0000 7fd924a00640 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5572643c71c0 0x5572647ef500 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=413cf1c68b57c065 server_cookie=8b1980e1c254ffe8 in_seq=0 out_seq=0 2024-08-28T20:27:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.717+0000 7fd902a00640 10 client.25919 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.718+0000 7fd902a00640 1 -- 172.21.15.1:0/2751453182 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55726474dec0 con 0x5572643c71c0 2024-08-28T20:27:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.718+0000 7fd902a00640 10 client.25919 handle_command_reply: tid=0 2024-08-28T20:27:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.718+0000 7fd92eea7740 1 client.25919 shutdown 2024-08-28T20:27:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.718+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 msgr2=0x5572647e22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.718+0000 7fd92eea7740 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647e22d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd918017000 tx=0x7fd918004430 comp rx=0 tx=0).stop 2024-08-28T20:27:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.718+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 shutdown_connections 2024-08-28T20:27:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5572643c71c0 0x5572647ef500 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644331b0 0x5572647e2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 --2- 172.21.15.1:0/2751453182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644124d0 0x5572647e22d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd902a00640 0 client.25919 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 >> 172.21.15.1:0/2751453182 conn(0x557264427300 msgr2=0x5572647d2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 shutdown_connections 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 1 -- 172.21.15.1:0/2751453182 wait complete. 2024-08-28T20:27:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.719+0000 7fd92eea7740 20 client.25919 trim_cache size 0 max 16384 2024-08-28T20:27:43.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 555.0 s, 1654.0 tps, lat 60.634 ms stddev 63.834 2024-08-28T20:27:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.777+0000 7fd92eea7740 1 Processor -- start 2024-08-28T20:27:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.778+0000 7fd92eea7740 1 -- start start 2024-08-28T20:27:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.779+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.779+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.779+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644331b0 0x5572647cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.779+0000 7fd92eea7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201a5470 con 0x5572644124d0 2024-08-28T20:27:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.779+0000 7fd92eea7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201a2d10 con 0x5572644331b0 2024-08-28T20:27:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.779+0000 7fd92eea7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201a0b60 con 0x5572643f1d80 2024-08-28T20:27:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd924a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd925e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644331b0 0x5572647cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd925e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644331b0 0x5572647cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:39420/0 (socket says 172.21.15.1:39420) 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd925e00640 1 -- 172.21.15.1:0/3866377123 learned_addr learned my addr 172.21.15.1:0/3866377123 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd925400640 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd925400640 1 -- 172.21.15.1:0/3866377123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644331b0 msgr2=0x5572647cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.780+0000 7fd925400640 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644331b0 0x5572647cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.781+0000 7fd925400640 1 -- 172.21.15.1:0/3866377123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 msgr2=0x5572647ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.781+0000 7fd925400640 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.781+0000 7fd925400640 1 -- 172.21.15.1:0/3866377123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572647d4d00 con 0x5572643f1d80 2024-08-28T20:27:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.781+0000 7fd925400640 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e2000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd918005c40 tx=0x7fd918014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b30e3e1a0c83f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.781+0000 7fd90dc00640 1 -- 172.21.15.1:0/3866377123 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918039070 con 0x5572643f1d80 2024-08-28T20:27:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.782+0000 7fd90dc00640 1 -- 172.21.15.1:0/3866377123 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd918003b70 con 0x5572643f1d80 2024-08-28T20:27:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.782+0000 7fd90dc00640 1 -- 172.21.15.1:0/3866377123 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918004e40 con 0x5572643f1d80 2024-08-28T20:27:43.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 -- 172.21.15.1:0/3866377123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 msgr2=0x5572647e2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e2000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd918005c40 tx=0x7fd918014000 comp rx=0 tx=0).stop 2024-08-28T20:27:43.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 -- 172.21.15.1:0/3866377123 shutdown_connections 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572644331b0 0x5572647cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 --2- 172.21.15.1:0/3866377123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572643f1d80 0x5572647e2000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.784+0000 7fd92eea7740 1 -- 172.21.15.1:0/3866377123 >> 172.21.15.1:0/3866377123 conn(0x557264427300 msgr2=0x5572647e16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.785+0000 7fd92eea7740 1 -- 172.21.15.1:0/3866377123 shutdown_connections 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.785+0000 7fd92eea7740 1 -- 172.21.15.1:0/3866377123 wait complete. 2024-08-28T20:27:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.786+0000 7fd92eea7740 1 -- start start 2024-08-28T20:27:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.786+0000 7fd92eea7740 1 Processor -- start 2024-08-28T20:27:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.788+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572643f1d80 0x5572647e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.788+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd92eea7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd92eea7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201a11d0 con 0x5572644124d0 2024-08-28T20:27:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd92eea7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201a2640 con 0x5572643f1d80 2024-08-28T20:27:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd92eea7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201a18a0 con 0x5572644331b0 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd92eea7740 10 client.0 _ll_register_callbacks cb 0x7fd91400b360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd925e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd925e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33918/0 (socket says 172.21.15.1:33918) 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.789+0000 7fd925e00640 1 -- 172.21.15.1:0/1337479092 learned_addr learned my addr 172.21.15.1:0/1337479092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd925e00640 1 -- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572643f1d80 msgr2=0x5572647e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd925e00640 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572643f1d80 0x5572647e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd925e00640 1 -- 172.21.15.1:0/1337479092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 msgr2=0x5572647e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd925e00640 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd925e00640 1 -- 172.21.15.1:0/1337479092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572647e80d0 con 0x5572644331b0 2024-08-28T20:27:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd925e00640 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647e9d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd91400bd70 tx=0x7fd9140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404ba171497d56c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.790+0000 7fd902a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:27:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.791+0000 7fd902a00640 1 -- 172.21.15.1:0/1337479092 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914042920 con 0x5572644331b0 2024-08-28T20:27:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.791+0000 7fd902a00640 1 -- 172.21.15.1:0/1337479092 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fd914042ac0 con 0x5572644331b0 2024-08-28T20:27:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.791+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd918003b70 con 0x5572644331b0 2024-08-28T20:27:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.791+0000 7fd902a00640 1 -- 172.21.15.1:0/1337479092 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd914042cc0 con 0x5572644331b0 2024-08-28T20:27:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.792+0000 7fd92eea7740 10 client.25897 fetch_fsmap learned FSMap version 47 2024-08-28T20:27:43.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.792+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55726485a3b0 con 0x5572644331b0 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.792+0000 7fd902a00640 1 -- 172.21.15.1:0/1337479092 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd918003b70 con 0x5572644331b0 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.792+0000 7fd902a00640 1 -- 172.21.15.1:0/1337479092 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 47) ==== 8358+0+0 (secure 0 0 0) 0x7fd914041410 con 0x5572644331b0 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.792+0000 7fd92eea7740 10 client.25897 fetch_fsmap finished waiting for FSMap version 47 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.792+0000 7fd92eea7740 10 client.25897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.793+0000 7fd92eea7740 20 client.25897 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.793+0000 7fd92eea7740 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55726485ad30 0x55726485d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:43.799 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.793+0000 7fd92eea7740 4 client.25897 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:27:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.793+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572647da170 con 0x55726485ad30 2024-08-28T20:27:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.794+0000 7fd925400640 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55726485ad30 0x55726485d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.795+0000 7fd925400640 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55726485ad30 0x55726485d1e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6161a9ada01080c9 server_cookie=b805d9102fc6fa39 in_seq=0 out_seq=0 2024-08-28T20:27:43.800 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.795+0000 7fd902a00640 10 client.25897 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd902a00640 1 -- 172.21.15.1:0/1337479092 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572647da170 con 0x55726485ad30 2024-08-28T20:27:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd902a00640 10 client.25897 handle_command_reply: tid=0 2024-08-28T20:27:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 client.25897 shutdown 2024-08-28T20:27:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 msgr2=0x5572647e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647e9d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd91400bd70 tx=0x7fd9140046c0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 shutdown_connections 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55726485ad30 0x55726485d1e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5572644124d0 0x5572647e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5572644331b0 0x5572647e9d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd902a00640 0 client.25897 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 --2- 172.21.15.1:0/1337479092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572643f1d80 0x5572647e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 >> 172.21.15.1:0/1337479092 conn(0x557264427300 msgr2=0x5572647e16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 shutdown_connections 2024-08-28T20:27:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.816+0000 7fd92eea7740 1 -- 172.21.15.1:0/1337479092 wait complete. 2024-08-28T20:27:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.817+0000 7fd92eea7740 20 client.25897 trim_cache size 0 max 16384 2024-08-28T20:27:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:27:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:27:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:27:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:27:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.818+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd9080b4bb0 msgr2=0x7fd9080b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.818+0000 7fd927e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd9080b4bb0 0x7fd9080b70c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd914005fd0 tx=0x7fd914005c90 comp rx=0 tx=0).stop 2024-08-28T20:27:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.818+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd92010ab20 msgr2=0x7fd920081580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.818+0000 7fd927e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd92010ab20 0x7fd920081580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd910006010 tx=0x7fd910032f90 comp rx=0 tx=0).stop 2024-08-28T20:27:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 shutdown_connections 2024-08-28T20:27:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd9080b4bb0 0x7fd9080b70c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd92010b4c0 0x7fd920082130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd92010ab20 0x7fd920081580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 --2- 172.21.15.1:0/3253506812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd920109aa0 0x7fd920080f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 >> 172.21.15.1:0/3253506812 conn(0x7fd920078e00 msgr2=0x7fd92010de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.819+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 shutdown_connections 2024-08-28T20:27:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:43.820+0000 7fd927e00640 1 -- 172.21.15.1:0/3253506812 wait complete. 2024-08-28T20:27:45.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:45 smithi007 ceph-mon[25357]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.9 MiB/s wr, 707 op/s 2024-08-28T20:27:45.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:45 smithi001 ceph-mon[20984]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.9 MiB/s wr, 707 op/s 2024-08-28T20:27:45.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:45 smithi121 ceph-mon[25248]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.9 MiB/s wr, 707 op/s 2024-08-28T20:27:47.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:47 smithi007 ceph-mon[25357]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7.9 MiB/s wr, 708 op/s 2024-08-28T20:27:47.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:47 smithi001 ceph-mon[20984]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7.9 MiB/s wr, 708 op/s 2024-08-28T20:27:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:47 smithi121 ceph-mon[25248]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7.9 MiB/s wr, 708 op/s 2024-08-28T20:27:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 560.0 s, 2287.3 tps, lat 43.736 ms stddev 55.161 2024-08-28T20:27:49.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:49 smithi007 ceph-mon[25357]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6.0 MiB/s wr, 632 op/s 2024-08-28T20:27:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:49 smithi001 ceph-mon[20984]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6.0 MiB/s wr, 632 op/s 2024-08-28T20:27:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:49 smithi121 ceph-mon[25248]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6.0 MiB/s wr, 632 op/s 2024-08-28T20:27:51.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:51 smithi007 ceph-mon[25357]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 MiB/s wr, 711 op/s 2024-08-28T20:27:51.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:51 smithi001 ceph-mon[20984]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 MiB/s wr, 711 op/s 2024-08-28T20:27:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:51 smithi121 ceph-mon[25248]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 MiB/s wr, 711 op/s 2024-08-28T20:27:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 565.0 s, 1841.8 tps, lat 54.458 ms stddev 68.429 2024-08-28T20:27:53.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:53 smithi001 ceph-mon[20984]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-08-28T20:27:53.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:53 smithi121 ceph-mon[25248]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-08-28T20:27:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:53 smithi007 ceph-mon[25357]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-08-28T20:27:55.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:55 smithi001 ceph-mon[20984]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.4 MiB/s wr, 700 op/s 2024-08-28T20:27:55.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:55 smithi121 ceph-mon[25248]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.4 MiB/s wr, 700 op/s 2024-08-28T20:27:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:55 smithi007 ceph-mon[25357]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.4 MiB/s wr, 700 op/s 2024-08-28T20:27:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 -- 172.21.15.1:0/1390860312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810b980 msgr2=0x7f4bc81123c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 --2- 172.21.15.1:0/1390860312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810b980 0x7f4bc81123c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0005fd0 tx=0x7f4bc002b3e0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 -- 172.21.15.1:0/1390860312 shutdown_connections 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 --2- 172.21.15.1:0/1390860312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810ad70 0x7f4bc810b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 --2- 172.21.15.1:0/1390860312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810b980 0x7f4bc81123c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 --2- 172.21.15.1:0/1390860312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 0x7f4bc810a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 -- 172.21.15.1:0/1390860312 >> 172.21.15.1:0/1390860312 conn(0x7f4bc8070a10 msgr2=0x7f4bc8072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 -- 172.21.15.1:0/1390860312 shutdown_connections 2024-08-28T20:27:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.136+0000 7f4bce400640 1 -- 172.21.15.1:0/1390860312 wait complete. 2024-08-28T20:27:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.138+0000 7f4bce400640 1 Processor -- start 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.138+0000 7f4bce400640 1 -- start start 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bce400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 0x7f4bc81a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bce400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 0x7f4bc81a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bce400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810b980 0x7f4bc81a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bce400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8119ac0 con 0x7f4bc810b980 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bce400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8119940 con 0x7f4bc810a340 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bce400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8119c40 con 0x7f4bc810ad70 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 0x7f4bc81a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 0x7f4bc81a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 0x7f4bc81a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43806/0 (socket says 172.21.15.1:43806) 2024-08-28T20:27:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc6a00640 1 -- 172.21.15.1:0/1270722844 learned_addr learned my addr 172.21.15.1:0/1270722844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 0x7f4bc81a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57058/0 (socket says 172.21.15.1:57058) 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810b980 0x7f4bc81a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc6a00640 1 -- 172.21.15.1:0/1270722844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 msgr2=0x7f4bc81a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 0x7f4bc81a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.139+0000 7f4bc6a00640 1 -- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810b980 msgr2=0x7f4bc81a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.140+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810b980 0x7f4bc81a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.140+0000 7f4bc6a00640 1 -- 172.21.15.1:0/1270722844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc81a60f0 con 0x7f4bc810ad70 2024-08-28T20:27:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.140+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810b980 0x7f4bc81a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:27:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.141+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 0x7f4bc81a4d20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400d950 tx=0x7f4bb400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.141+0000 7f4bbfe00640 1 -- 172.21.15.1:0/1270722844 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4017030 con 0x7f4bc810ad70 2024-08-28T20:27:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.141+0000 7f4bbfe00640 1 -- 172.21.15.1:0/1270722844 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb4004020 con 0x7f4bc810ad70 2024-08-28T20:27:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.141+0000 7f4bbfe00640 1 -- 172.21.15.1:0/1270722844 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40047a0 con 0x7f4bc810ad70 2024-08-28T20:27:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.142+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc81a63e0 con 0x7f4bc810ad70 2024-08-28T20:27:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.142+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc81acad0 con 0x7f4bc810ad70 2024-08-28T20:27:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.149+0000 7f4bd543f740 1 Processor -- start 2024-08-28T20:27:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.149+0000 7f4bd543f740 1 -- start start 2024-08-28T20:27:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 0x56513da63b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6952f0 0x56513da641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da64cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bbfe00640 1 -- 172.21.15.1:0/1270722844 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f4bb4009a30 con 0x7f4bc810ad70 2024-08-28T20:27:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bd543f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56513d9d6f70 con 0x56513d69d4d0 2024-08-28T20:27:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bd543f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56513d9c6500 con 0x56513d6952f0 2024-08-28T20:27:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bd543f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56513d9ca4b0 con 0x56513d6be1b0 2024-08-28T20:27:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bc7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 0x56513da63b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bc7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 0x56513da63b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43822/0 (socket says 172.21.15.1:43822) 2024-08-28T20:27:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.151+0000 7f4bc7e00640 1 -- 172.21.15.1:0/271725224 learned_addr learned my addr 172.21.15.1:0/271725224 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc7e00640 1 -- 172.21.15.1:0/271725224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6952f0 msgr2=0x56513da641a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:27:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6952f0 0x56513da641a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc7e00640 1 -- 172.21.15.1:0/271725224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 msgr2=0x56513da64cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:27:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da64cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da64cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc7e00640 1 -- 172.21.15.1:0/271725224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513d980c10 con 0x56513d6be1b0 2024-08-28T20:27:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.152+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da64cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.154+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 0x56513da63b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000afd0 tx=0x7f4bc000ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20d4c6a85f5fe3c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.155+0000 7f4bbcc00640 1 -- 172.21.15.1:0/271725224 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0037040 con 0x56513d6be1b0 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.155+0000 7f4bbcc00640 1 -- 172.21.15.1:0/271725224 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bc0042070 con 0x56513d6be1b0 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.155+0000 7f4bbcc00640 1 -- 172.21.15.1:0/271725224 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0003d60 con 0x56513d6be1b0 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.156+0000 7f4bbfe00640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4bac0b4cc0 0x7f4bac0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.156+0000 7f4bbfe00640 1 -- 172.21.15.1:0/1270722844 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4bb40e45d0 con 0x7f4bc810ad70 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.156+0000 7f4bd543f740 1 -- 172.21.15.1:0/271725224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 msgr2=0x56513da63b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.156+0000 7f4bd543f740 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 0x56513da63b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000afd0 tx=0x7f4bc000ad70 comp rx=0 tx=0).stop 2024-08-28T20:27:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.156+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4bac0b4cc0 0x7f4bac0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.157+0000 7f4bd543f740 1 -- 172.21.15.1:0/271725224 shutdown_connections 2024-08-28T20:27:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.157+0000 7f4bd543f740 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da64cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.157+0000 7f4bd543f740 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6952f0 0x56513da641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.157+0000 7f4bd543f740 1 --2- 172.21.15.1:0/271725224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6be1b0 0x56513da63b30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.157+0000 7f4bd543f740 1 -- 172.21.15.1:0/271725224 >> 172.21.15.1:0/271725224 conn(0x56513d6b2300 msgr2=0x56513da5f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.159+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4bac0b4cc0 0x7f4bac0b71d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009bb0 tx=0x7f4bb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.159+0000 7f4bd543f740 1 -- 172.21.15.1:0/271725224 shutdown_connections 2024-08-28T20:27:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.159+0000 7f4bd543f740 1 -- 172.21.15.1:0/271725224 wait complete. 2024-08-28T20:27:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.161+0000 7f4bd543f740 1 -- start start 2024-08-28T20:27:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.161+0000 7f4bd543f740 1 Processor -- start 2024-08-28T20:27:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da76090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da76c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56513d8ffab0 con 0x56513d6be1b0 2024-08-28T20:27:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56513d96d320 con 0x56513d69d4d0 2024-08-28T20:27:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56513da657b0 con 0x56513d6952f0 2024-08-28T20:27:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.162+0000 7f4bd543f740 10 client.0 _ll_register_callbacks cb 0x56513d9a6e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.163+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.163+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da759d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43838/0 (socket says 172.21.15.1:43838) 2024-08-28T20:27:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.163+0000 7f4bc7400640 1 -- 172.21.15.1:0/1874719629 learned_addr learned my addr 172.21.15.1:0/1874719629 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.163+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da76c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.163+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da76090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc7400640 1 -- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 msgr2=0x56513da76090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da76090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc7400640 1 -- 172.21.15.1:0/1874719629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 msgr2=0x56513da76c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da76c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc7400640 1 -- 172.21.15.1:0/1874719629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513d729790 con 0x56513d6952f0 2024-08-28T20:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da76090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.164+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da76c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:27:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.165+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da759d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8004580 tx=0x7f4bb8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4558c73ef9a022f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.165+0000 7f4bb1600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.165+0000 7f4bb1600640 1 -- 172.21.15.1:0/1874719629 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8005220 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bb1600640 1 -- 172.21.15.1:0/1874719629 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4bb80053c0 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bc0042070 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bb1600640 1 -- 172.21.15.1:0/1874719629 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4bb80055c0 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 10 client.25909 fetch_fsmap learned FSMap version 47 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x56513d7a2620 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bb1600640 1 -- 172.21.15.1:0/1874719629 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bc0042070 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bb1600640 1 -- 172.21.15.1:0/1874719629 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 47) ==== 8358+0+0 (secure 0 0 0) 0x7f4bb801ebe0 con 0x56513d6952f0 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 10 client.25909 fetch_fsmap finished waiting for FSMap version 47 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 10 client.25909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 20 client.25909 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513d67cd80 0x56513da83320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 4 client.25909 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:27:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.166+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56513d9d8ec0 con 0x56513d67cd80 2024-08-28T20:27:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.167+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513d67cd80 0x56513da83320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.168+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513d67cd80 0x56513da83320 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149ab1991d98f803 server_cookie=d382bc068a0516d3 in_seq=0 out_seq=0 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.168+0000 7f4bb1600640 10 client.25909 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.169+0000 7f4bb1600640 1 -- 172.21.15.1:0/1874719629 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56513d9d8ec0 con 0x56513d67cd80 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.169+0000 7f4bb1600640 10 client.25909 handle_command_reply: tid=0 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.169+0000 7f4bd543f740 1 client.25909 shutdown 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 msgr2=0x56513da759d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da759d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8004580 tx=0x7f4bb8004730 comp rx=0 tx=0).stop 2024-08-28T20:27:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 shutdown_connections 2024-08-28T20:27:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513d67cd80 0x56513da83320 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da76c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da76090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1874719629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da759d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 >> 172.21.15.1:0/1874719629 conn(0x56513d6b2300 msgr2=0x56513da5db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.170+0000 7f4bb1600640 0 client.25909 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.171+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 shutdown_connections 2024-08-28T20:27:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.171+0000 7f4bd543f740 1 -- 172.21.15.1:0/1874719629 wait complete. 2024-08-28T20:27:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.172+0000 7f4bd543f740 20 client.25909 trim_cache size 0 max 16384 2024-08-28T20:27:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.199+0000 7f4bd543f740 1 Processor -- start 2024-08-28T20:27:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.200+0000 7f4bd543f740 1 -- start start 2024-08-28T20:27:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.200+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da5ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.200+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da755f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.200+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6be1b0 0x56513da67c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.200+0000 7f4bd543f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81b3a90 con 0x56513d69d4d0 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.200+0000 7f4bd543f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81b1330 con 0x56513d6be1b0 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bd543f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81af180 con 0x56513d6952f0 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da5ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da5ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:43852/0 (socket says 172.21.15.1:43852) 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 -- 172.21.15.1:0/1636954261 learned_addr learned my addr 172.21.15.1:0/1636954261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6be1b0 0x56513da67c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 -- 172.21.15.1:0/1636954261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6be1b0 msgr2=0x56513da67c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6be1b0 0x56513da67c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 -- 172.21.15.1:0/1636954261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 msgr2=0x56513da755f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da755f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc7400640 1 -- 172.21.15.1:0/1636954261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513da6b390 con 0x56513d6952f0 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.201+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:27:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.202+0000 7f4bc7400640 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da5ef00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8003e50 tx=0x7f4bb8005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4fb794f80017ae server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.203+0000 7f4bb3e00640 1 -- 172.21.15.1:0/1636954261 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb801e6f0 con 0x56513d6952f0 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.203+0000 7f4bb3e00640 1 -- 172.21.15.1:0/1636954261 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb801ed40 con 0x56513d6952f0 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.203+0000 7f4bb3e00640 1 -- 172.21.15.1:0/1636954261 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8031d10 con 0x56513d6952f0 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 -- 172.21.15.1:0/1636954261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 msgr2=0x56513da5ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da5ef00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8003e50 tx=0x7f4bb8005780 comp rx=0 tx=0).stop 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 -- 172.21.15.1:0/1636954261 shutdown_connections 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d69d4d0 0x56513da755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d6be1b0 0x56513da67c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 --2- 172.21.15.1:0/1636954261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6952f0 0x56513da5ef00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 -- 172.21.15.1:0/1636954261 >> 172.21.15.1:0/1636954261 conn(0x56513d6b2300 msgr2=0x56513da6c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 -- 172.21.15.1:0/1636954261 shutdown_connections 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.204+0000 7f4bd543f740 1 -- 172.21.15.1:0/1636954261 wait complete. 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.205+0000 7f4bd543f740 1 -- start start 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.205+0000 7f4bd543f740 1 Processor -- start 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.205+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da7c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da7ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bd543f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6521c0 0x56513da7d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bd543f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81af7f0 con 0x56513d6be1b0 2024-08-28T20:27:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bd543f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81b0c60 con 0x56513d69d4d0 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bd543f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81afec0 con 0x56513d6521c0 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bd543f740 10 client.0 _ll_register_callbacks cb 0x7f4bb80044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da7c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da7c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57078/0 (socket says 172.21.15.1:57078) 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6521c0 0x56513da7d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 -- 172.21.15.1:0/161870113 learned_addr learned my addr 172.21.15.1:0/161870113 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da7ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 -- 172.21.15.1:0/161870113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6521c0 msgr2=0x56513da7d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6521c0 0x56513da7d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 -- 172.21.15.1:0/161870113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 msgr2=0x56513da7ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da7ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7400640 1 -- 172.21.15.1:0/161870113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513da7b560 con 0x56513d69d4d0 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.206+0000 7f4bc7e00640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6521c0 0x56513da7d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.207+0000 7f4bc7400640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da7c8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8020040 tx=0x7f4bb8031d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a6429e442971c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.207+0000 7f4bb1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.207+0000 7f4bb1600640 1 -- 172.21.15.1:0/161870113 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8046020 con 0x56513d69d4d0 2024-08-28T20:27:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.207+0000 7f4bb1600640 1 -- 172.21.15.1:0/161870113 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4bb8009040 con 0x56513d69d4d0 2024-08-28T20:27:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.208+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb801ed40 con 0x56513d69d4d0 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.208+0000 7f4bb1600640 1 -- 172.21.15.1:0/161870113 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4bb801e900 con 0x56513d69d4d0 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.208+0000 7f4bd543f740 10 client.25934 fetch_fsmap learned FSMap version 47 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x56513daedfe0 con 0x56513d69d4d0 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bb1600640 1 -- 172.21.15.1:0/161870113 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb801ed40 con 0x56513d69d4d0 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bb1600640 1 -- 172.21.15.1:0/161870113 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 47) ==== 8358+0+0 (secure 0 0 0) 0x7f4bb803a410 con 0x56513d69d4d0 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bd543f740 10 client.25934 fetch_fsmap finished waiting for FSMap version 47 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bd543f740 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bd543f740 20 client.25934 populate_metadata read hostname 'smithi001' 2024-08-28T20:27:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.209+0000 7f4bd543f740 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513daee9d0 0x56513daf0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:27:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.210+0000 7f4bd543f740 4 client.25934 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:27:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.210+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56513d9d4960 con 0x56513daee9d0 2024-08-28T20:27:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.210+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513daee9d0 0x56513daf0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:27:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.210+0000 7f4bc6a00640 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513daee9d0 0x56513daf0df0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c336838d533a6d5 server_cookie=3c332f4e9801dae3 in_seq=0 out_seq=0 2024-08-28T20:27:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.210+0000 7f4bb1600640 10 client.25934 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.224+0000 7f4bb1600640 1 -- 172.21.15.1:0/161870113 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56513d9d4960 con 0x56513daee9d0 2024-08-28T20:27:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.224+0000 7f4bb1600640 10 client.25934 handle_command_reply: tid=0 2024-08-28T20:27:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.224+0000 7f4bd543f740 1 client.25934 shutdown 2024-08-28T20:27:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.225+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 msgr2=0x56513da7c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.225+0000 7f4bd543f740 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da7c8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8020040 tx=0x7f4bb8031d00 comp rx=0 tx=0).stop 2024-08-28T20:27:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.225+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 shutdown_connections 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bd543f740 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56513daee9d0 0x56513daf0df0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bd543f740 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56513d6be1b0 0x56513da7ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bd543f740 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56513d6521c0 0x56513da7d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bd543f740 1 --2- 172.21.15.1:0/161870113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56513d69d4d0 0x56513da7c8d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 >> 172.21.15.1:0/161870113 conn(0x56513d6b2300 msgr2=0x56513da6b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bb1600640 0 client.25934 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:27:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.226+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 shutdown_connections 2024-08-28T20:27:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.227+0000 7f4bd543f740 1 -- 172.21.15.1:0/161870113 wait complete. 2024-08-28T20:27:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.227+0000 7f4bd543f740 20 client.25934 trim_cache size 0 max 16384 2024-08-28T20:27:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:27:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:27:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:27:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:27:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.228+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4bac0b4cc0 msgr2=0x7f4bac0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.228+0000 7f4bce400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4bac0b4cc0 0x7f4bac0b71d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009bb0 tx=0x7f4bb8005f90 comp rx=0 tx=0).stop 2024-08-28T20:27:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.228+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 msgr2=0x7f4bc81a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:27:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.228+0000 7f4bce400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 0x7f4bc81a4d20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400d950 tx=0x7f4bb400de10 comp rx=0 tx=0).stop 2024-08-28T20:27:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 shutdown_connections 2024-08-28T20:27:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4bac0b4cc0 0x7f4bac0b71d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bc810b980 0x7f4bc81a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc810ad70 0x7f4bc81a4d20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 --2- 172.21.15.1:0/1270722844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bc810a340 0x7f4bc81a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:27:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 >> 172.21.15.1:0/1270722844 conn(0x7f4bc8070a10 msgr2=0x7f4bc810e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:27:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 shutdown_connections 2024-08-28T20:27:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:27:57.229+0000 7f4bce400640 1 -- 172.21.15.1:0/1270722844 wait complete. 2024-08-28T20:27:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:57 smithi001 ceph-mon[20984]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-08-28T20:27:57.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:57 smithi121 ceph-mon[25248]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-08-28T20:27:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:57 smithi007 ceph-mon[25357]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-08-28T20:27:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 570.0 s, 2232.4 tps, lat 44.458 ms stddev 53.690 2024-08-28T20:27:59.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:27:59 smithi001 ceph-mon[20984]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.2 MiB/s wr, 588 op/s 2024-08-28T20:27:59.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:27:59 smithi121 ceph-mon[25248]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.2 MiB/s wr, 588 op/s 2024-08-28T20:28:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:27:59 smithi007 ceph-mon[25357]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.2 MiB/s wr, 588 op/s 2024-08-28T20:28:01.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:01 smithi001 ceph-mon[20984]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-08-28T20:28:01.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:01 smithi121 ceph-mon[25248]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-08-28T20:28:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:01 smithi007 ceph-mon[25357]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 706 op/s 2024-08-28T20:28:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 575.0 s, 1756.6 tps, lat 57.546 ms stddev 68.525 2024-08-28T20:28:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:03 smithi001 ceph-mon[20984]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.8 MiB/s wr, 614 op/s 2024-08-28T20:28:03.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:03 smithi121 ceph-mon[25248]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.8 MiB/s wr, 614 op/s 2024-08-28T20:28:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:03 smithi007 ceph-mon[25357]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.8 MiB/s wr, 614 op/s 2024-08-28T20:28:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:05 smithi001 ceph-mon[20984]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 738 op/s 2024-08-28T20:28:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:05 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:28:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:05 smithi121 ceph-mon[25248]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 738 op/s 2024-08-28T20:28:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:05 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:28:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:05 smithi007 ceph-mon[25357]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 738 op/s 2024-08-28T20:28:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:05 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:28:07.866 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:07 smithi007 ceph-mon[25357]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:28:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:07 smithi001 ceph-mon[20984]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:28:07.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:07 smithi121 ceph-mon[25248]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:28:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 580.0 s, 1715.8 tps, lat 57.524 ms stddev 69.136 2024-08-28T20:28:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:09 smithi001 ceph-mon[20984]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-08-28T20:28:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:09 smithi121 ceph-mon[25248]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-08-28T20:28:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:09 smithi007 ceph-mon[25357]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-08-28T20:28:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 -- 172.21.15.1:0/276563555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa430106f80 msgr2=0x7fa430107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 --2- 172.21.15.1:0/276563555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa430106f80 0x7fa430107480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa428009860 tx=0x7fa42802a360 comp rx=0 tx=0).stop 2024-08-28T20:28:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 -- 172.21.15.1:0/276563555 shutdown_connections 2024-08-28T20:28:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 --2- 172.21.15.1:0/276563555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4301043c0 0x7fa430106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 --2- 172.21.15.1:0/276563555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa430106f80 0x7fa430107480 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 --2- 172.21.15.1:0/276563555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa43006c220 0x7fa430103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.558+0000 7fa435000640 1 -- 172.21.15.1:0/276563555 >> 172.21.15.1:0/276563555 conn(0x7fa4300fdcd0 msgr2=0x7fa430100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.559+0000 7fa435000640 1 -- 172.21.15.1:0/276563555 shutdown_connections 2024-08-28T20:28:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.559+0000 7fa435000640 1 -- 172.21.15.1:0/276563555 wait complete. 2024-08-28T20:28:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.561+0000 7fa435000640 1 Processor -- start 2024-08-28T20:28:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.561+0000 7fa435000640 1 -- start start 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.562+0000 7fa435000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43006c220 0x7fa4301a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.562+0000 7fa435000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 0x7fa4301a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.562+0000 7fa435000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa430106f80 0x7fa4301a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.562+0000 7fa435000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301156c0 con 0x7fa430106f80 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.562+0000 7fa435000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa430115540 con 0x7fa43006c220 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.562+0000 7fa435000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa430115840 con 0x7fa4301043c0 2024-08-28T20:28:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 0x7fa4301a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa430106f80 0x7fa4301a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 0x7fa4301a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47854/0 (socket says 172.21.15.1:47854) 2024-08-28T20:28:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42d400640 1 -- 172.21.15.1:0/703458680 learned_addr learned my addr 172.21.15.1:0/703458680 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42de00640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43006c220 0x7fa4301a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42e800640 1 -- 172.21.15.1:0/703458680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 msgr2=0x7fa4301a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42e800640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 0x7fa4301a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42e800640 1 -- 172.21.15.1:0/703458680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43006c220 msgr2=0x7fa4301a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42e800640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43006c220 0x7fa4301a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42e800640 1 -- 172.21.15.1:0/703458680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4301a1cc0 con 0x7fa430106f80 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.563+0000 7fa42d400640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 0x7fa4301a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.564+0000 7fa42e800640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa430106f80 0x7fa4301a14a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa428009830 tx=0x7fa428033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.564+0000 7fa426a00640 1 -- 172.21.15.1:0/703458680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428037040 con 0x7fa430106f80 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.564+0000 7fa426a00640 1 -- 172.21.15.1:0/703458680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa428005050 con 0x7fa430106f80 2024-08-28T20:28:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.564+0000 7fa426a00640 1 -- 172.21.15.1:0/703458680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4280049b0 con 0x7fa430106f80 2024-08-28T20:28:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.564+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4301a1f50 con 0x7fa430106f80 2024-08-28T20:28:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.564+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4301a2260 con 0x7fa430106f80 2024-08-28T20:28:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.571+0000 7fa426a00640 1 -- 172.21.15.1:0/703458680 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fa428042020 con 0x7fa430106f80 2024-08-28T20:28:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.571+0000 7fa43c208740 1 Processor -- start 2024-08-28T20:28:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.571+0000 7fa43c208740 1 -- start start 2024-08-28T20:28:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa43c208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94933dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa43c208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94934430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa43c208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94934f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa43c208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd948a6f70 con 0x55bd945652f0 2024-08-28T20:28:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa43c208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bd94896500 con 0x55bd9456d4d0 2024-08-28T20:28:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa43c208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bd9489a4b0 con 0x55bd9458e1b0 2024-08-28T20:28:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.572+0000 7fa426a00640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa4140b4bb0 0x7fa4140b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.573+0000 7fa426a00640 1 -- 172.21.15.1:0/703458680 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa428104500 con 0x7fa430106f80 2024-08-28T20:28:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.573+0000 7fa42e800640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa4140b4bb0 0x7fa4140b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.574+0000 7fa42d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94933dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.574+0000 7fa42e800640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa4140b4bb0 0x7fa4140b70c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa42802a880 tx=0x7fa4280b2040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.574+0000 7fa42d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94934f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.575+0000 7fa42de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94934430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.575+0000 7fa42de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94934430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35310/0 (socket says 172.21.15.1:35310) 2024-08-28T20:28:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.575+0000 7fa42de00640 1 -- 172.21.15.1:0/3195029851 learned_addr learned my addr 172.21.15.1:0/3195029851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.576+0000 7fa42d400640 1 -- 172.21.15.1:0/3195029851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 msgr2=0x55bd94933dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.576+0000 7fa42d400640 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94933dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.576+0000 7fa42d400640 1 -- 172.21.15.1:0/3195029851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 msgr2=0x55bd94934430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.576+0000 7fa42d400640 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94934430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.576+0000 7fa42d400640 1 -- 172.21.15.1:0/3195029851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd94850c10 con 0x55bd9456d4d0 2024-08-28T20:28:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.576+0000 7fa42d400640 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94934f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa4200058c0 tx=0x7fa420004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54ea1ec859a9136 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.577+0000 7fa41f400640 1 -- 172.21.15.1:0/3195029851 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420013110 con 0x55bd9456d4d0 2024-08-28T20:28:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.577+0000 7fa41f400640 1 -- 172.21.15.1:0/3195029851 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4200132b0 con 0x55bd9456d4d0 2024-08-28T20:28:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.577+0000 7fa41f400640 1 -- 172.21.15.1:0/3195029851 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420005580 con 0x55bd9456d4d0 2024-08-28T20:28:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 -- 172.21.15.1:0/3195029851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 msgr2=0x55bd94934f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94934f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa4200058c0 tx=0x7fa420004730 comp rx=0 tx=0).stop 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 -- 172.21.15.1:0/3195029851 shutdown_connections 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94934430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94934f80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 --2- 172.21.15.1:0/3195029851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94933dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.578+0000 7fa43c208740 1 -- 172.21.15.1:0/3195029851 >> 172.21.15.1:0/3195029851 conn(0x55bd94582300 msgr2=0x55bd9492f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.579+0000 7fa43c208740 1 -- 172.21.15.1:0/3195029851 shutdown_connections 2024-08-28T20:28:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.579+0000 7fa43c208740 1 -- 172.21.15.1:0/3195029851 wait complete. 2024-08-28T20:28:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.580+0000 7fa43c208740 1 -- start start 2024-08-28T20:28:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.580+0000 7fa43c208740 1 Processor -- start 2024-08-28T20:28:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd9493d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd9493db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd9493e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd947cfab0 con 0x55bd945652f0 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bd9483d320 con 0x55bd9456d4d0 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bd94935aa0 con 0x55bd9458e1b0 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa43c208740 10 client.0 _ll_register_callbacks cb 0x55bd948436a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa42de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd9493db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa42de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd9493db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43034/0 (socket says 172.21.15.1:43034) 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa42de00640 1 -- 172.21.15.1:0/1976415411 learned_addr learned my addr 172.21.15.1:0/1976415411 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.581+0000 7fa42d400640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd9493d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42de00640 1 -- 172.21.15.1:0/1976415411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 msgr2=0x55bd9493e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42de00640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd9493e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42de00640 1 -- 172.21.15.1:0/1976415411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 msgr2=0x55bd9493d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42de00640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd9493d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42de00640 1 -- 172.21.15.1:0/1976415411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd945f9790 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42d400640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd9493d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa42de00640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd9493db50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa41800ff10 tx=0x7fa41800d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b8bf4587493817 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa413e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.582+0000 7fa413e00640 1 -- 172.21.15.1:0/1976415411 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4180195f0 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4200132b0 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa413e00640 1 -- 172.21.15.1:0/1976415411 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa418019790 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa413e00640 1 -- 172.21.15.1:0/1976415411 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa418019990 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa43c208740 10 client.25946 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55bd94672620 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa413e00640 1 -- 172.21.15.1:0/1976415411 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4200132b0 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.583+0000 7fa413e00640 1 -- 172.21.15.1:0/1976415411 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fa41800b040 con 0x55bd9456d4d0 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa43c208740 10 client.25946 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa43c208740 10 client.25946 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa43c208740 20 client.25946 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa43c208740 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd9454cd80 0x55bd9494ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa43c208740 4 client.25946 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:28:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd948a8ec0 con 0x55bd9454cd80 2024-08-28T20:28:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.584+0000 7fa42d400640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd9454cd80 0x55bd9494ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.586+0000 7fa42d400640 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd9454cd80 0x55bd9494ad80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65b7e3a780a83580 server_cookie=aad9a0bfc02d324b in_seq=0 out_seq=0 2024-08-28T20:28:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.586+0000 7fa413e00640 10 client.25946 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.587+0000 7fa413e00640 1 -- 172.21.15.1:0/1976415411 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd948a8ec0 con 0x55bd9454cd80 2024-08-28T20:28:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.587+0000 7fa413e00640 10 client.25946 handle_command_reply: tid=0 2024-08-28T20:28:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.587+0000 7fa43c208740 1 client.25946 shutdown 2024-08-28T20:28:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.587+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 msgr2=0x55bd9493db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd9493db50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa41800ff10 tx=0x7fa41800d7b0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 shutdown_connections 2024-08-28T20:28:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd9454cd80 0x55bd9494ad80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd9493e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd9493db50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 --2- 172.21.15.1:0/1976415411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd9493d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa413e00640 0 client.25946 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 >> 172.21.15.1:0/1976415411 conn(0x55bd94582300 msgr2=0x55bd9492dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 shutdown_connections 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 1 -- 172.21.15.1:0/1976415411 wait complete. 2024-08-28T20:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.588+0000 7fa43c208740 20 client.25946 trim_cache size 0 max 16384 2024-08-28T20:28:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.625+0000 7fa43c208740 1 Processor -- start 2024-08-28T20:28:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 -- start start 2024-08-28T20:28:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 0x55bd94934470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9456d4d0 0x55bd9492e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9458e1b0 0x55bd9492e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301b3be0 con 0x55bd9456d4d0 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301b14b0 con 0x55bd9458e1b0 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.627+0000 7fa43c208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301af300 con 0x55bd945652f0 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.628+0000 7fa42d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 0x55bd94934470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.628+0000 7fa42d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9458e1b0 0x55bd9492e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.628+0000 7fa42d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 0x55bd94934470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47882/0 (socket says 172.21.15.1:47882) 2024-08-28T20:28:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.628+0000 7fa42d400640 1 -- 172.21.15.1:0/3954396818 learned_addr learned my addr 172.21.15.1:0/3954396818 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.629+0000 7fa42d400640 1 -- 172.21.15.1:0/3954396818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9458e1b0 msgr2=0x55bd9492e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.630+0000 7fa42d400640 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9458e1b0 0x55bd9492e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.630+0000 7fa42d400640 1 -- 172.21.15.1:0/3954396818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9456d4d0 msgr2=0x55bd9492e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.630+0000 7fa42d400640 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9456d4d0 0x55bd9492e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.631+0000 7fa42d400640 1 -- 172.21.15.1:0/3954396818 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9493d210 con 0x55bd945652f0 2024-08-28T20:28:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.632+0000 7fa42d400640 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 0x55bd94934470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa420013be0 tx=0x7fa420005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ca4d153deda543 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.633+0000 7fa41ea00640 1 -- 172.21.15.1:0/3954396818 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200053d0 con 0x55bd945652f0 2024-08-28T20:28:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.633+0000 7fa41ea00640 1 -- 172.21.15.1:0/3954396818 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa420017040 con 0x55bd945652f0 2024-08-28T20:28:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.633+0000 7fa41ea00640 1 -- 172.21.15.1:0/3954396818 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420011440 con 0x55bd945652f0 2024-08-28T20:28:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 -- 172.21.15.1:0/3954396818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 msgr2=0x55bd94934470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 0x55bd94934470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa420013be0 tx=0x7fa420005fd0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 -- 172.21.15.1:0/3954396818 shutdown_connections 2024-08-28T20:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9456d4d0 0x55bd9492e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9458e1b0 0x55bd9492e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 --2- 172.21.15.1:0/3954396818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd945652f0 0x55bd94934470 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.638+0000 7fa43c208740 1 -- 172.21.15.1:0/3954396818 >> 172.21.15.1:0/3954396818 conn(0x55bd94582300 msgr2=0x55bd94933d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.639+0000 7fa43c208740 1 -- 172.21.15.1:0/3954396818 shutdown_connections 2024-08-28T20:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.639+0000 7fa43c208740 1 -- 172.21.15.1:0/3954396818 wait complete. 2024-08-28T20:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.640+0000 7fa43c208740 1 -- start start 2024-08-28T20:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.640+0000 7fa43c208740 1 Processor -- start 2024-08-28T20:28:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.642+0000 7fa43c208740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94945140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa43c208740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94943e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa43c208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94944340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa43c208740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301af970 con 0x55bd945652f0 2024-08-28T20:28:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa43c208740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301b0de0 con 0x55bd9456d4d0 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa43c208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301b0040 con 0x55bd9458e1b0 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa43c208740 10 client.0 _ll_register_callbacks cb 0x7fa41800fb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa42de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94943e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.644+0000 7fa42de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94943e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43050/0 (socket says 172.21.15.1:43050) 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.645+0000 7fa42d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94945140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.645+0000 7fa42d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94945140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35356/0 (socket says 172.21.15.1:35356) 2024-08-28T20:28:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.645+0000 7fa42de00640 1 -- 172.21.15.1:0/372437366 learned_addr learned my addr 172.21.15.1:0/372437366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.647+0000 7fa42d400640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94944340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.647+0000 7fa42de00640 1 -- 172.21.15.1:0/372437366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 msgr2=0x55bd94944340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.647+0000 7fa42de00640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94944340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.648+0000 7fa42de00640 1 -- 172.21.15.1:0/372437366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 msgr2=0x55bd94945140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.648+0000 7fa42de00640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94945140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.648+0000 7fa42de00640 1 -- 172.21.15.1:0/372437366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd949449b0 con 0x55bd9456d4d0 2024-08-28T20:28:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.648+0000 7fa42d400640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94944340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:28:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.648+0000 7fa42de00640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94943e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa418022c90 tx=0x7fa41800dcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3724626b8f0af79 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.649+0000 7fa413e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.649+0000 7fa413e00640 1 -- 172.21.15.1:0/372437366 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418022e80 con 0x55bd9456d4d0 2024-08-28T20:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.649+0000 7fa413e00640 1 -- 172.21.15.1:0/372437366 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fa418002030 con 0x55bd9456d4d0 2024-08-28T20:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.650+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa420017040 con 0x55bd9456d4d0 2024-08-28T20:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.650+0000 7fa413e00640 1 -- 172.21.15.1:0/372437366 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa418022e80 con 0x55bd9456d4d0 2024-08-28T20:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.650+0000 7fa43c208740 10 client.25952 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.650+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55bd949b5780 con 0x55bd9456d4d0 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa413e00640 1 -- 172.21.15.1:0/372437366 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa420017040 con 0x55bd9456d4d0 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa413e00640 1 -- 172.21.15.1:0/372437366 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fa41800b040 con 0x55bd9456d4d0 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa43c208740 10 client.25952 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa43c208740 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa43c208740 20 client.25952 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa43c208740 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd945221c0 0x55bd949b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa43c208740 4 client.25952 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.651+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bd948a4960 con 0x55bd945221c0 2024-08-28T20:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.652+0000 7fa42d400640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd945221c0 0x55bd949b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.653+0000 7fa42d400640 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd945221c0 0x55bd949b80e0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd639916f624793a server_cookie=47558222e050953d in_seq=0 out_seq=0 2024-08-28T20:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.653+0000 7fa413e00640 10 client.25952 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.677+0000 7fa413e00640 1 -- 172.21.15.1:0/372437366 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bd948a4960 con 0x55bd945221c0 2024-08-28T20:28:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.677+0000 7fa413e00640 10 client.25952 handle_command_reply: tid=0 2024-08-28T20:28:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.677+0000 7fa43c208740 1 client.25952 shutdown 2024-08-28T20:28:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.678+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 msgr2=0x55bd94943e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.678+0000 7fa43c208740 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94943e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa418022c90 tx=0x7fa41800dcb0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 shutdown_connections 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa43c208740 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55bd945221c0 0x55bd949b80e0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa43c208740 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9458e1b0 0x55bd94944340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa43c208740 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd9456d4d0 0x55bd94943e00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa43c208740 1 --2- 172.21.15.1:0/372437366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd945652f0 0x55bd94945140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 >> 172.21.15.1:0/372437366 conn(0x55bd94582300 msgr2=0x55bd9493d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.679+0000 7fa413e00640 0 client.25952 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.680+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 shutdown_connections 2024-08-28T20:28:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.680+0000 7fa43c208740 1 -- 172.21.15.1:0/372437366 wait complete. 2024-08-28T20:28:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.681+0000 7fa43c208740 20 client.25952 trim_cache size 0 max 16384 2024-08-28T20:28:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:28:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:28:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:28:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:28:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa4140b4bb0 msgr2=0x7fa4140b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa4140b4bb0 0x7fa4140b70c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa42802a880 tx=0x7fa4280b2040 comp rx=0 tx=0).stop 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa430106f80 msgr2=0x7fa4301a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa430106f80 0x7fa4301a14a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa428009830 tx=0x7fa428033ce0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 shutdown_connections 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fa4140b4bb0 0x7fa4140b70c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa430106f80 0x7fa4301a14a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4301043c0 0x7fa4301a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 --2- 172.21.15.1:0/703458680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43006c220 0x7fa4301a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.682+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 >> 172.21.15.1:0/703458680 conn(0x7fa4300fdcd0 msgr2=0x7fa430105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.683+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 shutdown_connections 2024-08-28T20:28:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:10.683+0000 7fa435000640 1 -- 172.21.15.1:0/703458680 wait complete. 2024-08-28T20:28:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:11 smithi001 ceph-mon[20984]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 718 op/s 2024-08-28T20:28:11.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:11 smithi121 ceph-mon[25248]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 718 op/s 2024-08-28T20:28:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:11 smithi007 ceph-mon[25357]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 718 op/s 2024-08-28T20:28:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 585.0 s, 1779.4 tps, lat 56.352 ms stddev 67.584 2024-08-28T20:28:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:13 smithi001 ceph-mon[20984]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 585 op/s 2024-08-28T20:28:13.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:13 smithi121 ceph-mon[25248]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 585 op/s 2024-08-28T20:28:14.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:13 smithi007 ceph-mon[25357]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 585 op/s 2024-08-28T20:28:15.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:15 smithi001 ceph-mon[20984]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-08-28T20:28:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:15 smithi121 ceph-mon[25248]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-08-28T20:28:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:15 smithi007 ceph-mon[25357]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-08-28T20:28:17.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:17 smithi001 ceph-mon[20984]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 586 op/s 2024-08-28T20:28:17.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:17 smithi121 ceph-mon[25248]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 586 op/s 2024-08-28T20:28:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:17 smithi007 ceph-mon[25357]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 586 op/s 2024-08-28T20:28:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 590.0 s, 2019.4 tps, lat 49.926 ms stddev 58.034 2024-08-28T20:28:19.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:19 smithi001 ceph-mon[20984]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-08-28T20:28:19.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:19 smithi121 ceph-mon[25248]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-08-28T20:28:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:19 smithi007 ceph-mon[25357]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-08-28T20:28:21.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:21 smithi001 ceph-mon[20984]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 736 op/s 2024-08-28T20:28:21.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:21 smithi121 ceph-mon[25248]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 736 op/s 2024-08-28T20:28:22.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:21 smithi007 ceph-mon[25357]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 736 op/s 2024-08-28T20:28:23.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 595.0 s, 2747.3 tps, lat 36.529 ms stddev 48.550 2024-08-28T20:28:23.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:23 smithi001 ceph-mon[20984]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-08-28T20:28:23.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:23 smithi121 ceph-mon[25248]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 -- 172.21.15.1:0/275251960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010ab20 msgr2=0x7fb19010af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 --2- 172.21.15.1:0/275251960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010ab20 0x7fb19010af30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009900 tx=0x7fb17c02a400 comp rx=0 tx=0).stop 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 -- 172.21.15.1:0/275251960 shutdown_connections 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 --2- 172.21.15.1:0/275251960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010b4c0 0x7fb190111e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 --2- 172.21.15.1:0/275251960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010ab20 0x7fb19010af30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 --2- 172.21.15.1:0/275251960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190109aa0 0x7fb190109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.012+0000 7fb195400640 1 -- 172.21.15.1:0/275251960 >> 172.21.15.1:0/275251960 conn(0x7fb190078e00 msgr2=0x7fb190107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.013+0000 7fb195400640 1 -- 172.21.15.1:0/275251960 shutdown_connections 2024-08-28T20:28:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.013+0000 7fb195400640 1 -- 172.21.15.1:0/275251960 wait complete. 2024-08-28T20:28:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.015+0000 7fb195400640 1 Processor -- start 2024-08-28T20:28:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.015+0000 7fb195400640 1 -- start start 2024-08-28T20:28:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.015+0000 7fb195400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190109aa0 0x7fb190080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.015+0000 7fb195400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 0x7fb190081560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb195400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010b4c0 0x7fb190082110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb195400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb190115720 con 0x7fb190109aa0 2024-08-28T20:28:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb195400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901155a0 con 0x7fb19010ab20 2024-08-28T20:28:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb195400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901158a0 con 0x7fb19010b4c0 2024-08-28T20:28:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb18de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 0x7fb190081560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb18e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190109aa0 0x7fb190080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb18de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 0x7fb190081560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:36250/0 (socket says 172.21.15.1:36250) 2024-08-28T20:28:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb18de00640 1 -- 172.21.15.1:0/1130821453 learned_addr learned my addr 172.21.15.1:0/1130821453 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.016+0000 7fb18f200640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010b4c0 0x7fb190082110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.017+0000 7fb18de00640 1 -- 172.21.15.1:0/1130821453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010b4c0 msgr2=0x7fb190082110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.017+0000 7fb18de00640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010b4c0 0x7fb190082110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.017+0000 7fb18de00640 1 -- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190109aa0 msgr2=0x7fb190080ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.017+0000 7fb18de00640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190109aa0 0x7fb190080ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.017+0000 7fb18de00640 1 -- 172.21.15.1:0/1130821453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb190082930 con 0x7fb19010ab20 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.017+0000 7fb18f200640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010b4c0 0x7fb190082110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:28:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.018+0000 7fb18de00640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 0x7fb190081560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb17c031500 tx=0x7fb17c003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.018+0000 7fb187400640 1 -- 172.21.15.1:0/1130821453 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c03f070 con 0x7fb19010ab20 2024-08-28T20:28:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.019+0000 7fb187400640 1 -- 172.21.15.1:0/1130821453 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb17c031c50 con 0x7fb19010ab20 2024-08-28T20:28:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.019+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb190082bc0 con 0x7fb19010ab20 2024-08-28T20:28:24.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.019+0000 7fb187400640 1 -- 172.21.15.1:0/1130821453 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c035030 con 0x7fb19010ab20 2024-08-28T20:28:24.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.019+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb190082ed0 con 0x7fb19010ab20 2024-08-28T20:28:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.025+0000 7fb19c48b740 1 Processor -- start 2024-08-28T20:28:24.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.028+0000 7fb19c48b740 1 -- start start 2024-08-28T20:28:24.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.028+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523bab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.029+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.029+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.029+0000 7fb19c48b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f75232df70 con 0x55f751ff44d0 2024-08-28T20:28:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.029+0000 7fb19c48b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f75231d500 con 0x55f751fec2f0 2024-08-28T20:28:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.029+0000 7fb19c48b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f7523214b0 con 0x55f7520151b0 2024-08-28T20:28:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.030+0000 7fb18e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.031+0000 7fb18f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.031+0000 7fb18f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523bab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44838/0 (socket says 172.21.15.1:44838) 2024-08-28T20:28:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.031+0000 7fb18f200640 1 -- 172.21.15.1:0/2702682401 learned_addr learned my addr 172.21.15.1:0/2702682401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.034+0000 7fb18f200640 1 -- 172.21.15.1:0/2702682401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 msgr2=0x55f7523bb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.034+0000 7fb18f200640 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.034+0000 7fb18f200640 1 -- 172.21.15.1:0/2702682401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 msgr2=0x55f7523bbcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:28:24.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.035+0000 7fb187400640 1 -- 172.21.15.1:0/1130821453 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fb17c042070 con 0x7fb19010ab20 2024-08-28T20:28:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.040+0000 7fb18de00640 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.040+0000 7fb18f200640 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.040+0000 7fb18f200640 1 -- 172.21.15.1:0/2702682401 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7522d7c10 con 0x55f7520151b0 2024-08-28T20:28:24.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.041+0000 7fb18f200640 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523bab30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb188011790 tx=0x7fb188011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=480684c427d3fd22 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:24.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.041+0000 7fb17b400640 1 -- 172.21.15.1:0/2702682401 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188004d20 con 0x55f7520151b0 2024-08-28T20:28:24.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.041+0000 7fb187400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb1740b4d40 0x7fb1740b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.042+0000 7fb187400640 1 -- 172.21.15.1:0/1130821453 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb17c1059d0 con 0x7fb19010ab20 2024-08-28T20:28:24.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.042+0000 7fb18e800640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb1740b4d40 0x7fb1740b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.043+0000 7fb17b400640 1 -- 172.21.15.1:0/2702682401 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb188003970 con 0x55f7520151b0 2024-08-28T20:28:24.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.043+0000 7fb17b400640 1 -- 172.21.15.1:0/2702682401 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1880044c0 con 0x55f7520151b0 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.044+0000 7fb19c48b740 1 -- 172.21.15.1:0/2702682401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 msgr2=0x55f7523bab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.044+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523bab30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb188011790 tx=0x7fb188011c50 comp rx=0 tx=0).stop 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.045+0000 7fb19c48b740 1 -- 172.21.15.1:0/2702682401 shutdown_connections 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.045+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.045+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.045+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2702682401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523bab30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.047 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.045+0000 7fb19c48b740 1 -- 172.21.15.1:0/2702682401 >> 172.21.15.1:0/2702682401 conn(0x55f752009300 msgr2=0x55f7523b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:24.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.047+0000 7fb19c48b740 1 -- 172.21.15.1:0/2702682401 shutdown_connections 2024-08-28T20:28:24.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.047+0000 7fb19c48b740 1 -- 172.21.15.1:0/2702682401 wait complete. 2024-08-28T20:28:24.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.048+0000 7fb19c48b740 1 -- start start 2024-08-28T20:28:24.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.048+0000 7fb19c48b740 1 Processor -- start 2024-08-28T20:28:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.048+0000 7fb18e800640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb1740b4d40 0x7fb1740b7250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb180005d00 tx=0x7fb18000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:24.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.050+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.050+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.050+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7520151b0 0x55f7523c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.050+0000 7fb18e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.050+0000 7fb18e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:36264/0 (socket says 172.21.15.1:36264) 2024-08-28T20:28:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.051+0000 7fb18f200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7520151b0 0x55f7523c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.051+0000 7fb18f200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7520151b0 0x55f7523c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43578/0 (socket says 172.21.15.1:43578) 2024-08-28T20:28:24.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.051+0000 7fb18f200640 1 -- 172.21.15.1:0/2430167727 learned_addr learned my addr 172.21.15.1:0/2430167727 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.051+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f752256ab0 con 0x55f7520151b0 2024-08-28T20:28:24.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.051+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f7522c4320 con 0x55f751fec2f0 2024-08-28T20:28:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.051+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f7523bc810 con 0x55f751ff44d0 2024-08-28T20:28:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.052+0000 7fb19c48b740 10 client.0 _ll_register_callbacks cb 0x55f7522fde80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.053+0000 7fb18de00640 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.053+0000 7fb18de00640 1 -- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 msgr2=0x55f7523c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.053+0000 7fb18de00640 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.053+0000 7fb18de00640 1 -- 172.21.15.1:0/2430167727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7520151b0 msgr2=0x55f7523c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.053+0000 7fb18de00640 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7520151b0 0x55f7523c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.053+0000 7fb18de00640 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f752080790 con 0x55f751ff44d0 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.054+0000 7fb18de00640 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523c48a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000c00 tx=0x7fb17c0cbce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d19b4bcb8eb072d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.054+0000 7fb16fe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.054+0000 7fb16fe00640 1 -- 172.21.15.1:0/2430167727 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c049070 con 0x55f751ff44d0 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.054+0000 7fb16fe00640 1 -- 172.21.15.1:0/2430167727 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb17c0c88f0 con 0x55f751ff44d0 2024-08-28T20:28:24.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.055+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb188003970 con 0x55f751ff44d0 2024-08-28T20:28:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.060+0000 7fb16fe00640 1 -- 172.21.15.1:0/2430167727 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb17c0cbea0 con 0x55f751ff44d0 2024-08-28T20:28:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.060+0000 7fb19c48b740 10 client.25939 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.060+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f7520f9620 con 0x55f751ff44d0 2024-08-28T20:28:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.060+0000 7fb16fe00640 1 -- 172.21.15.1:0/2430167727 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb188003970 con 0x55f751ff44d0 2024-08-28T20:28:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:23 smithi007 ceph-mon[25357]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-08-28T20:28:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.061+0000 7fb16fe00640 1 -- 172.21.15.1:0/2430167727 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fb17c0c8590 con 0x55f751ff44d0 2024-08-28T20:28:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb19c48b740 10 client.25939 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb19c48b740 10 client.25939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb19c48b740 20 client.25939 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fd3d80 0x55f7523d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb19c48b740 4 client.25939 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:28:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f75232fec0 con 0x55f751fd3d80 2024-08-28T20:28:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.063+0000 7fb18e800640 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fd3d80 0x55f7523d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.066+0000 7fb18e800640 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fd3d80 0x55f7523d1900 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3234899fe59d5f0c server_cookie=98e9d51b5ba714d8 in_seq=0 out_seq=0 2024-08-28T20:28:24.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.066+0000 7fb16fe00640 10 client.25939 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:24.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.067+0000 7fb16fe00640 1 -- 172.21.15.1:0/2430167727 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f75232fec0 con 0x55f751fd3d80 2024-08-28T20:28:24.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.067+0000 7fb16fe00640 10 client.25939 handle_command_reply: tid=0 2024-08-28T20:28:24.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.067+0000 7fb19c48b740 1 client.25939 shutdown 2024-08-28T20:28:24.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 msgr2=0x55f7523c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523c48a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000c00 tx=0x7fb17c0cbce0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 shutdown_connections 2024-08-28T20:28:24.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fd3d80 0x55f7523d1900 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb16fe00640 0 client.25939 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7520151b0 0x55f7523c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523c48a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 --2- 172.21.15.1:0/2430167727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.068+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 >> 172.21.15.1:0/2430167727 conn(0x55f752009300 msgr2=0x55f7523b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:24.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.071+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 shutdown_connections 2024-08-28T20:28:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.073+0000 7fb19c48b740 1 -- 172.21.15.1:0/2430167727 wait complete. 2024-08-28T20:28:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.073+0000 7fb19c48b740 20 client.25939 trim_cache size 0 max 16384 2024-08-28T20:28:24.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.139+0000 7fb19c48b740 1 Processor -- start 2024-08-28T20:28:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.139+0000 7fb19c48b740 1 -- start start 2024-08-28T20:28:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.139+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.139+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.139+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb18e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb18e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:36276/0 (socket says 172.21.15.1:36276) 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb18f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb18e800640 1 -- 172.21.15.1:0/848085244 learned_addr learned my addr 172.21.15.1:0/848085244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb18de00640 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901b3bb0 con 0x55f751ff44d0 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900749c0 con 0x55f751fec2f0 2024-08-28T20:28:24.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.140+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb190072810 con 0x55f7520151b0 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.141+0000 7fb18e800640 1 -- 172.21.15.1:0/848085244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 msgr2=0x55f7523c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.141+0000 7fb18e800640 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.141+0000 7fb18e800640 1 -- 172.21.15.1:0/848085244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 msgr2=0x55f7523bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.141+0000 7fb18e800640 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.141+0000 7fb18e800640 1 -- 172.21.15.1:0/848085244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7523b8070 con 0x55f751fec2f0 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.141+0000 7fb18f200640 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:28:24.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.142+0000 7fb18e800640 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f7523d20a0 tx=0x7fb180016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1702ce29164eec1b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:24.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.143+0000 7fb17aa00640 1 -- 172.21.15.1:0/848085244 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18002e040 con 0x55f751fec2f0 2024-08-28T20:28:24.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.143+0000 7fb17aa00640 1 -- 172.21.15.1:0/848085244 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb180020e20 con 0x55f751fec2f0 2024-08-28T20:28:24.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.143+0000 7fb17aa00640 1 -- 172.21.15.1:0/848085244 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1800047a0 con 0x55f751fec2f0 2024-08-28T20:28:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.144+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 msgr2=0x55f7523bec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.144+0000 7fb19c48b740 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f7523d20a0 tx=0x7fb180016000 comp rx=0 tx=0).stop 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 shutdown_connections 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751ff44d0 0x55f7523bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f7520151b0 0x55f7523c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 --2- 172.21.15.1:0/848085244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f751fec2f0 0x55f7523bec40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 >> 172.21.15.1:0/848085244 conn(0x55f752009300 msgr2=0x55f7523b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 shutdown_connections 2024-08-28T20:28:24.148 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.145+0000 7fb19c48b740 1 -- 172.21.15.1:0/848085244 wait complete. 2024-08-28T20:28:24.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.146+0000 7fb19c48b740 1 -- start start 2024-08-28T20:28:24.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.147+0000 7fb19c48b740 1 Processor -- start 2024-08-28T20:28:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.148+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751fec2f0 0x55f7523cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.148+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.148+0000 7fb19c48b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7520151b0 0x55f7523c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb18e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751fec2f0 0x55f7523cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb18e800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751fec2f0 0x55f7523cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43600/0 (socket says 172.21.15.1:43600) 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb18e800640 1 -- 172.21.15.1:0/613896960 learned_addr learned my addr 172.21.15.1:0/613896960 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb190072e80 con 0x55f751fec2f0 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900742f0 con 0x55f7520151b0 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb190073550 con 0x55f751ff44d0 2024-08-28T20:28:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.149+0000 7fb18f200640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7520151b0 0x55f7523c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18de00640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18f200640 1 -- 172.21.15.1:0/613896960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 msgr2=0x55f7523cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18f200640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18f200640 1 -- 172.21.15.1:0/613896960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751fec2f0 msgr2=0x55f7523cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18f200640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751fec2f0 0x55f7523cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18f200640 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7523cbfe0 con 0x55f7520151b0 2024-08-28T20:28:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb19c48b740 10 client.0 _ll_register_callbacks cb 0x7fb17c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb180020e20 con 0x55f7520151b0 2024-08-28T20:28:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.150+0000 7fb18de00640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:28:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.151+0000 7fb18f200640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7520151b0 0x55f7523c9e80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb188005c40 tx=0x7fb188003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7299c2744ef590f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.151+0000 7fb16fe00640 10 client.25970 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:28:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.151+0000 7fb16fe00640 1 -- 172.21.15.1:0/613896960 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18801d040 con 0x55f7520151b0 2024-08-28T20:28:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.152+0000 7fb16fe00640 1 -- 172.21.15.1:0/613896960 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb188005240 con 0x55f7520151b0 2024-08-28T20:28:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.153+0000 7fb16fe00640 1 -- 172.21.15.1:0/613896960 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb1880054c0 con 0x55f7520151b0 2024-08-28T20:28:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.153+0000 7fb19c48b740 10 client.25970 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.153+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55f75243c690 con 0x55f7520151b0 2024-08-28T20:28:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.154+0000 7fb16fe00640 1 -- 172.21.15.1:0/613896960 <== mon.2 v2:172.21.15.7:3300/0 4 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fb188023040 con 0x55f7520151b0 2024-08-28T20:28:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.154+0000 7fb19c48b740 10 client.25970 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.154+0000 7fb19c48b740 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.154+0000 7fb19c48b740 20 client.25970 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.154+0000 7fb19c48b740 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fa91c0 0x55f75243eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.155+0000 7fb19c48b740 4 client.25970 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:28:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.155+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f75232b960 con 0x55f751fa91c0 2024-08-28T20:28:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.155+0000 7fb18e800640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fa91c0 0x55f75243eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.157+0000 7fb18e800640 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fa91c0 0x55f75243eef0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274df5a4413c9905 server_cookie=a61a47e5f666320e in_seq=0 out_seq=0 2024-08-28T20:28:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.158+0000 7fb16fe00640 10 client.25970 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.191+0000 7fb16fe00640 1 -- 172.21.15.1:0/613896960 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f75232b960 con 0x55f751fa91c0 2024-08-28T20:28:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.192+0000 7fb16fe00640 10 client.25970 handle_command_reply: tid=0 2024-08-28T20:28:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.192+0000 7fb19c48b740 1 client.25970 shutdown 2024-08-28T20:28:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.192+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7520151b0 msgr2=0x55f7523c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.192+0000 7fb19c48b740 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7520151b0 0x55f7523c9e80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb188005c40 tx=0x7fb188003ba0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 shutdown_connections 2024-08-28T20:28:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb19c48b740 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55f751fa91c0 0x55f75243eef0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb19c48b740 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7520151b0 0x55f7523c9e80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb19c48b740 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f751ff44d0 0x55f7523cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb16fe00640 0 client.25970 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb19c48b740 1 --2- 172.21.15.1:0/613896960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f751fec2f0 0x55f7523cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.193+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 >> 172.21.15.1:0/613896960 conn(0x55f752009300 msgr2=0x55f7523bec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.194+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 shutdown_connections 2024-08-28T20:28:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.194+0000 7fb19c48b740 1 -- 172.21.15.1:0/613896960 wait complete. 2024-08-28T20:28:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.194+0000 7fb19c48b740 20 client.25970 trim_cache size 0 max 16384 2024-08-28T20:28:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:28:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:28:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:28:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:28:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb1740b4d40 msgr2=0x7fb1740b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb1740b4d40 0x7fb1740b7250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb180005d00 tx=0x7fb18000b410 comp rx=0 tx=0).stop 2024-08-28T20:28:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 msgr2=0x7fb190081560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 0x7fb190081560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb17c031500 tx=0x7fb17c003bb0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 shutdown_connections 2024-08-28T20:28:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb1740b4d40 0x7fb1740b7250 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb19010b4c0 0x7fb190082110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19010ab20 0x7fb190081560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 --2- 172.21.15.1:0/1130821453 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb190109aa0 0x7fb190080ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.196+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 >> 172.21.15.1:0/1130821453 conn(0x7fb190078e00 msgr2=0x7fb19010de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.197+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 shutdown_connections 2024-08-28T20:28:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:24.197+0000 7fb195400640 1 -- 172.21.15.1:0/1130821453 wait complete. 2024-08-28T20:28:25.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:25 smithi001 ceph-mon[20984]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 715 op/s 2024-08-28T20:28:25.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:25 smithi121 ceph-mon[25248]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 715 op/s 2024-08-28T20:28:26.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:25 smithi007 ceph-mon[25357]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 715 op/s 2024-08-28T20:28:27.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:27 smithi001 ceph-mon[20984]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.0 MiB/s wr, 722 op/s 2024-08-28T20:28:27.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:27 smithi121 ceph-mon[25248]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.0 MiB/s wr, 722 op/s 2024-08-28T20:28:28.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:27 smithi007 ceph-mon[25357]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.0 MiB/s wr, 722 op/s 2024-08-28T20:28:28.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 600.0 s, 2271.4 tps, lat 43.853 ms stddev 56.071 2024-08-28T20:28:29.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:29 smithi001 ceph-mon[20984]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 736 op/s 2024-08-28T20:28:29.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:29 smithi121 ceph-mon[25248]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 736 op/s 2024-08-28T20:28:30.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:29 smithi007 ceph-mon[25357]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 736 op/s 2024-08-28T20:28:31.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:31 smithi001 ceph-mon[20984]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 714 op/s 2024-08-28T20:28:31.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:31 smithi121 ceph-mon[25248]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 714 op/s 2024-08-28T20:28:32.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:31 smithi007 ceph-mon[25357]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 714 op/s 2024-08-28T20:28:32.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:32 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:28:32.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:32 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:28:32.987 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:32 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:28:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 605.0 s, 1777.8 tps, lat 56.068 ms stddev 67.577 2024-08-28T20:28:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-08-28T20:28:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:34 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-08-28T20:28:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:34 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-08-28T20:28:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:34.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:34 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:36.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:36 smithi121 ceph-mon[25248]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.9 MiB/s wr, 742 op/s 2024-08-28T20:28:36.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:36 smithi001 ceph-mon[20984]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.9 MiB/s wr, 742 op/s 2024-08-28T20:28:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:36 smithi007 ceph-mon[25357]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.9 MiB/s wr, 742 op/s 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 -- 172.21.15.1:0/3697791163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 msgr2=0x7f3cd8075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/3697791163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd8075550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009860 tx=0x7f3cc802a360 comp rx=0 tx=0).stop 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 -- 172.21.15.1:0/3697791163 shutdown_connections 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/3697791163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cd810b2c0 0x7f3cd810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/3697791163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cd8075a90 0x7f3cd8075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/3697791163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd8075550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.507+0000 7f3cd7e00640 1 -- 172.21.15.1:0/3697791163 >> 172.21.15.1:0/3697791163 conn(0x7f3cd80fec50 msgr2=0x7f3cd8101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:37.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.508+0000 7f3cd7e00640 1 -- 172.21.15.1:0/3697791163 shutdown_connections 2024-08-28T20:28:37.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.508+0000 7f3cd7e00640 1 -- 172.21.15.1:0/3697791163 wait complete. 2024-08-28T20:28:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.510+0000 7f3cd7e00640 1 Processor -- start 2024-08-28T20:28:37.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.511+0000 7f3cd7e00640 1 -- start start 2024-08-28T20:28:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd7e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cd8075a90 0x7f3cd819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cd810b2c0 0x7f3cd819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd7e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd8111100 con 0x7f3cd8075a90 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd8110f80 con 0x7f3cd810b2c0 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd7e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd8111280 con 0x7f3cd8076e90 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40198/0 (socket says 172.21.15.1:40198) 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.512+0000 7f3cd6000640 1 -- 172.21.15.1:0/2279119594 learned_addr learned my addr 172.21.15.1:0/2279119594 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.513+0000 7f3cd7400640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cd810b2c0 0x7f3cd819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.513+0000 7f3cd6000640 1 -- 172.21.15.1:0/2279119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cd810b2c0 msgr2=0x7f3cd819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.513+0000 7f3cd6000640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cd810b2c0 0x7f3cd819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.513+0000 7f3cd6000640 1 -- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cd8075a90 msgr2=0x7f3cd819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.513+0000 7f3cd6000640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cd8075a90 0x7f3cd819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.513+0000 7f3cd6000640 1 -- 172.21.15.1:0/2279119594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd819d6d0 con 0x7f3cd8076e90 2024-08-28T20:28:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.514+0000 7f3cd6000640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd819c300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c890 tx=0x7f3cc400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.515+0000 7f3ccf400640 1 -- 172.21.15.1:0/2279119594 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004220 con 0x7f3cd8076e90 2024-08-28T20:28:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.515+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd819d9c0 con 0x7f3cd8076e90 2024-08-28T20:28:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.515+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd8103070 con 0x7f3cd8076e90 2024-08-28T20:28:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.515+0000 7f3ccf400640 1 -- 172.21.15.1:0/2279119594 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cc40043c0 con 0x7f3cd8076e90 2024-08-28T20:28:37.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.516+0000 7f3ccf400640 1 -- 172.21.15.1:0/2279119594 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004220 con 0x7f3cd8076e90 2024-08-28T20:28:37.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.526+0000 7f3ce4617740 1 Processor -- start 2024-08-28T20:28:37.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.526+0000 7f3ce4617740 1 -- start start 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.526+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 0x558abaf23fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.526+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab442f0 0x558abaf24620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf25170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3ce4617740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558abae85f70 con 0x558abab4c4d0 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3ce4617740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558abae75500 con 0x558abab6d1b0 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3ce4617740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558abae794b0 con 0x558abab442f0 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3cd7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 0x558abaf23fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3cd7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 0x558abaf23fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:33624/0 (socket says 172.21.15.1:33624) 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.527+0000 7f3cd7400640 1 -- 172.21.15.1:0/165213661 learned_addr learned my addr 172.21.15.1:0/165213661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd7400640 1 -- 172.21.15.1:0/165213661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab442f0 msgr2=0x558abaf24620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab442f0 0x558abaf24620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd7400640 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab442f0 0x558abaf24620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd7400640 1 -- 172.21.15.1:0/165213661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 msgr2=0x558abaf25170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:28:37.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd7400640 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf25170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd7400640 1 -- 172.21.15.1:0/165213661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558abae2fc10 con 0x558abab6d1b0 2024-08-28T20:28:37.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.528+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab442f0 0x558abaf24620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.529+0000 7f3cd7400640 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 0x558abaf23fb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009fd0 tx=0x7f3cd000f890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd452c85bbca9222 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.529+0000 7f3ccf400640 1 -- 172.21.15.1:0/2279119594 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f3cc40047a0 con 0x7f3cd8076e90 2024-08-28T20:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.529+0000 7f3cc3400640 1 -- 172.21.15.1:0/165213661 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd003a620 con 0x558abab6d1b0 2024-08-28T20:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.530+0000 7f3cc3400640 1 -- 172.21.15.1:0/165213661 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd003ac70 con 0x558abab6d1b0 2024-08-28T20:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.530+0000 7f3cc3400640 1 -- 172.21.15.1:0/165213661 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000cde0 con 0x558abab6d1b0 2024-08-28T20:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.531+0000 7f3ce4617740 1 -- 172.21.15.1:0/165213661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 msgr2=0x558abaf23fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.531+0000 7f3ce4617740 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 0x558abaf23fb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009fd0 tx=0x7f3cd000f890 comp rx=0 tx=0).stop 2024-08-28T20:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.532+0000 7f3ccf400640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3cbc0b4df0 0x7f3cbc0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.533+0000 7f3ccf400640 1 -- 172.21.15.1:0/2279119594 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3cc40e4ab0 con 0x7f3cd8076e90 2024-08-28T20:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.533+0000 7f3cd7400640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3cbc0b4df0 0x7f3cbc0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3cd7400640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3cbc0b4df0 0x7f3cbc0b7300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009fd0 tx=0x7f3cd0009db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 -- 172.21.15.1:0/165213661 shutdown_connections 2024-08-28T20:28:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf25170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab442f0 0x558abaf24620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 --2- 172.21.15.1:0/165213661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab6d1b0 0x558abaf23fb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 -- 172.21.15.1:0/165213661 >> 172.21.15.1:0/165213661 conn(0x558abab61300 msgr2=0x558abaf0ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 -- 172.21.15.1:0/165213661 shutdown_connections 2024-08-28T20:28:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.535+0000 7f3ce4617740 1 -- 172.21.15.1:0/165213661 wait complete. 2024-08-28T20:28:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.536+0000 7f3ce4617740 1 -- start start 2024-08-28T20:28:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.537+0000 7f3ce4617740 1 Processor -- start 2024-08-28T20:28:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.538+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf1a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf1a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf1b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3ce4617740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558abadaeab0 con 0x558abab442f0 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3cd6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf1a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3cd6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf1a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:33634/0 (socket says 172.21.15.1:33634) 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3cd6000640 1 -- 172.21.15.1:0/37138726 learned_addr learned my addr 172.21.15.1:0/37138726 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558abae1c320 con 0x558abab4c4d0 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558abaf25c90 con 0x558abab6d1b0 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3ce4617740 10 client.0 _ll_register_callbacks cb 0x558abae226a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.539+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf1a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.540+0000 7f3cd7400640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf1b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.541+0000 7f3cd7400640 1 -- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 msgr2=0x558abaf1a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.541+0000 7f3cd7400640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf1a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.541+0000 7f3cd7400640 1 -- 172.21.15.1:0/37138726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 msgr2=0x558abaf1a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.541+0000 7f3cd7400640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf1a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.541+0000 7f3cd7400640 1 -- 172.21.15.1:0/37138726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ababd8790 con 0x558abab6d1b0 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.541+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf1a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.542+0000 7f3cd7400640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf1b4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3cd003d000 tx=0x7f3cd000f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e429dd046036ab54 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:37.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.542+0000 7f3cb7e00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:28:37.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.543+0000 7f3cb7e00640 1 -- 172.21.15.1:0/37138726 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0057020 con 0x558abab6d1b0 2024-08-28T20:28:37.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.543+0000 7f3cb7e00640 1 -- 172.21.15.1:0/37138726 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3cd0004a40 con 0x558abab6d1b0 2024-08-28T20:28:37.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.544+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd003ac70 con 0x558abab6d1b0 2024-08-28T20:28:37.546 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.544+0000 7f3cb7e00640 1 -- 172.21.15.1:0/37138726 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3cd000d740 con 0x558abab6d1b0 2024-08-28T20:28:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.545+0000 7f3ce4617740 10 client.25951 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.545+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x558abac51620 con 0x558abab6d1b0 2024-08-28T20:28:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.546+0000 7f3cb7e00640 1 -- 172.21.15.1:0/37138726 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd003ac70 con 0x558abab6d1b0 2024-08-28T20:28:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.546+0000 7f3cb7e00640 1 -- 172.21.15.1:0/37138726 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7f3cd000b040 con 0x558abab6d1b0 2024-08-28T20:28:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.547+0000 7f3ce4617740 10 client.25951 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.547+0000 7f3ce4617740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.547+0000 7f3ce4617740 20 client.25951 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.547+0000 7f3ce4617740 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab2bd80 0x558abaf23380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.547+0000 7f3ce4617740 4 client.25951 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:28:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.547+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558abae87ec0 con 0x558abab2bd80 2024-08-28T20:28:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.548+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab2bd80 0x558abaf23380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.548+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab2bd80 0x558abaf23380 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd5fb752f87dea8e server_cookie=da603d235f1e4740 in_seq=0 out_seq=0 2024-08-28T20:28:37.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.548+0000 7f3cb7e00640 10 client.25951 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:37.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.549+0000 7f3cb7e00640 1 -- 172.21.15.1:0/37138726 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558abae87ec0 con 0x558abab2bd80 2024-08-28T20:28:37.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.549+0000 7f3cb7e00640 10 client.25951 handle_command_reply: tid=0 2024-08-28T20:28:37.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.549+0000 7f3ce4617740 1 client.25951 shutdown 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 msgr2=0x558abaf1b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf1b4e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3cd003d000 tx=0x7f3cd000f890 comp rx=0 tx=0).stop 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 shutdown_connections 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab2bd80 0x558abaf23380 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf1b4e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf1a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3cb7e00640 0 client.25951 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 --2- 172.21.15.1:0/37138726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf1a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 >> 172.21.15.1:0/37138726 conn(0x558abab61300 msgr2=0x558abaf0cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 shutdown_connections 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 1 -- 172.21.15.1:0/37138726 wait complete. 2024-08-28T20:28:37.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.550+0000 7f3ce4617740 20 client.25951 trim_cache size 0 max 16384 2024-08-28T20:28:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 Processor -- start 2024-08-28T20:28:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 -- start start 2024-08-28T20:28:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf0f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8010e30 con 0x558abab442f0 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb800e700 con 0x558abab4c4d0 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.575+0000 7f3ce4617740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb800c550 con 0x558abab6d1b0 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf0f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd6a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf0f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40224/0 (socket says 172.21.15.1:40224) 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 -- 172.21.15.1:0/1007362756 learned_addr learned my addr 172.21.15.1:0/1007362756 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd6000640 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 -- 172.21.15.1:0/1007362756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 msgr2=0x558abaf199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 -- 172.21.15.1:0/1007362756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 msgr2=0x558abaf194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd7400640 1 -- 172.21.15.1:0/1007362756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558abaf236f0 con 0x558abab6d1b0 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.576+0000 7f3cd6000640 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.577+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:28:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.577+0000 7f3cd7400640 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf0f160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000d250 tx=0x7f3cd000d280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511d26b5dd3dac69 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.577+0000 7f3cc2a00640 1 -- 172.21.15.1:0/1007362756 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd006a020 con 0x558abab6d1b0 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.577+0000 7f3cc2a00640 1 -- 172.21.15.1:0/1007362756 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd0004c00 con 0x558abab6d1b0 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.577+0000 7f3cc2a00640 1 -- 172.21.15.1:0/1007362756 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0057040 con 0x558abab6d1b0 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 -- 172.21.15.1:0/1007362756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 msgr2=0x558abaf0f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf0f160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000d250 tx=0x7f3cd000d280 comp rx=0 tx=0).stop 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 -- 172.21.15.1:0/1007362756 shutdown_connections 2024-08-28T20:28:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf0f160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab4c4d0 0x558abaf199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 --2- 172.21.15.1:0/1007362756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab442f0 0x558abaf194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.579+0000 7f3ce4617740 1 -- 172.21.15.1:0/1007362756 >> 172.21.15.1:0/1007362756 conn(0x558abab61300 msgr2=0x558abaf18840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:37.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.580+0000 7f3ce4617740 1 -- 172.21.15.1:0/1007362756 shutdown_connections 2024-08-28T20:28:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.580+0000 7f3ce4617740 1 -- 172.21.15.1:0/1007362756 wait complete. 2024-08-28T20:28:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.581+0000 7f3ce4617740 1 -- start start 2024-08-28T20:28:37.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.581+0000 7f3ce4617740 1 Processor -- start 2024-08-28T20:28:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.582+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab442f0 0x558abaf22010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.582+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf20cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3ce4617740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf21210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3ce4617740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb800cbc0 con 0x558abab4c4d0 2024-08-28T20:28:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3ce4617740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb800e030 con 0x558abab442f0 2024-08-28T20:28:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3ce4617740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb800d290 con 0x558abab6d1b0 2024-08-28T20:28:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3ce4617740 10 client.0 _ll_register_callbacks cb 0x7f3cd000cdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab442f0 0x558abaf22010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf21210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf21210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40226/0 (socket says 172.21.15.1:40226) 2024-08-28T20:28:37.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd7400640 1 -- 172.21.15.1:0/78662392 learned_addr learned my addr 172.21.15.1:0/78662392 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd6000640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf20cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd7400640 1 -- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab442f0 msgr2=0x558abaf22010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.583+0000 7f3cd7400640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab442f0 0x558abaf22010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.584+0000 7f3cd7400640 1 -- 172.21.15.1:0/78662392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 msgr2=0x558abaf20cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.584+0000 7f3cd7400640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf20cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.584+0000 7f3cd7400640 1 -- 172.21.15.1:0/78662392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558abaf1ace0 con 0x558abab6d1b0 2024-08-28T20:28:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.584+0000 7f3cd6000640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf20cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:28:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.584+0000 7f3cd7400640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf21210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0005ff0 tx=0x7f3cd00051f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaf19d090d36c2bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.584+0000 7f3cb7e00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:28:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.585+0000 7f3cb7e00640 1 -- 172.21.15.1:0/78662392 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0057040 con 0x558abab6d1b0 2024-08-28T20:28:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.585+0000 7f3cb7e00640 1 -- 172.21.15.1:0/78662392 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f3cd003aac0 con 0x558abab6d1b0 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.585+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd0004c00 con 0x558abab6d1b0 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.585+0000 7f3cb7e00640 1 -- 172.21.15.1:0/78662392 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3cd0046800 con 0x558abab6d1b0 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.585+0000 7f3ce4617740 10 client.25957 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.585+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x558abaf20550 con 0x558abab6d1b0 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.586+0000 7f3cb7e00640 1 -- 172.21.15.1:0/78662392 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd0004c00 con 0x558abab6d1b0 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.586+0000 7f3cb7e00640 1 -- 172.21.15.1:0/78662392 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7f3cd000b070 con 0x558abab6d1b0 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.587+0000 7f3ce4617740 10 client.25957 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.587+0000 7f3ce4617740 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:37.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.587+0000 7f3ce4617740 20 client.25957 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:37.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.587+0000 7f3ce4617740 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab011c0 0x558abaf96ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:37.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.587+0000 7f3ce4617740 4 client.25957 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:28:37.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.587+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558abae83960 con 0x558abab011c0 2024-08-28T20:28:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.588+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab011c0 0x558abaf96ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.589+0000 7f3cd6a00640 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab011c0 0x558abaf96ca0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6a6f0339945544 server_cookie=d1a017a8846577b8 in_seq=0 out_seq=0 2024-08-28T20:28:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.589+0000 7f3cb7e00640 10 client.25957 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:37.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.601+0000 7f3cb7e00640 1 -- 172.21.15.1:0/78662392 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558abae83960 con 0x558abab011c0 2024-08-28T20:28:37.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.601+0000 7f3cb7e00640 10 client.25957 handle_command_reply: tid=0 2024-08-28T20:28:37.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 client.25957 shutdown 2024-08-28T20:28:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 msgr2=0x558abaf21210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf21210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0005ff0 tx=0x7f3cd00051f0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 shutdown_connections 2024-08-28T20:28:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558abab011c0 0x558abaf96ca0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558abab4c4d0 0x558abaf20cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558abab6d1b0 0x558abaf21210 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 --2- 172.21.15.1:0/78662392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558abab442f0 0x558abaf22010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.602+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 >> 172.21.15.1:0/78662392 conn(0x558abab61300 msgr2=0x558abaf194b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.603+0000 7f3cb7e00640 0 client.25957 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.603+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 shutdown_connections 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.603+0000 7f3ce4617740 1 -- 172.21.15.1:0/78662392 wait complete. 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.603+0000 7f3ce4617740 20 client.25957 trim_cache size 0 max 16384 2024-08-28T20:28:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3cbc0b4df0 msgr2=0x7f3cbc0b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3cbc0b4df0 0x7f3cbc0b7300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009fd0 tx=0x7f3cd0009db0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 msgr2=0x7f3cd819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd819c300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c890 tx=0x7f3cc400cd50 comp rx=0 tx=0).stop 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 shutdown_connections 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f3cbc0b4df0 0x7f3cbc0b7300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cd810b2c0 0x7f3cd819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd8076e90 0x7f3cd819c300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 --2- 172.21.15.1:0/2279119594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3cd8075a90 0x7f3cd819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.604+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 >> 172.21.15.1:0/2279119594 conn(0x7f3cd80fec50 msgr2=0x7f3cd8101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.605+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 shutdown_connections 2024-08-28T20:28:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:37.605+0000 7f3cd7e00640 1 -- 172.21.15.1:0/2279119594 wait complete. 2024-08-28T20:28:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:37 smithi001 ceph-mon[20984]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.3 MiB/s wr, 659 op/s 2024-08-28T20:28:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:37.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:37 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:37 smithi121 ceph-mon[25248]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.3 MiB/s wr, 659 op/s 2024-08-28T20:28:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:37.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:37 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:37 smithi007 ceph-mon[25357]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.3 MiB/s wr, 659 op/s 2024-08-28T20:28:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:38.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:37 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 610.0 s, 1329.6 tps, lat 74.426 ms stddev 93.647 2024-08-28T20:28:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:28:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:28:38.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:38.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:28:38.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:28:38.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:28:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:28:39.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:28:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:39 smithi001 ceph-mon[20984]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.6 MiB/s wr, 585 op/s 2024-08-28T20:28:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:39 smithi121 ceph-mon[25248]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.6 MiB/s wr, 585 op/s 2024-08-28T20:28:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:39 smithi007 ceph-mon[25357]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.6 MiB/s wr, 585 op/s 2024-08-28T20:28:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:41 smithi001 ceph-mon[20984]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.3 MiB/s wr, 647 op/s 2024-08-28T20:28:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:41 smithi121 ceph-mon[25248]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.3 MiB/s wr, 647 op/s 2024-08-28T20:28:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:41 smithi007 ceph-mon[25357]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.3 MiB/s wr, 647 op/s 2024-08-28T20:28:43.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 615.0 s, 1179.6 tps, lat 85.020 ms stddev 101.152 2024-08-28T20:28:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:43 smithi001 ceph-mon[20984]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.6 MiB/s wr, 564 op/s 2024-08-28T20:28:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:43 smithi121 ceph-mon[25248]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.6 MiB/s wr, 564 op/s 2024-08-28T20:28:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:43 smithi007 ceph-mon[25357]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.6 MiB/s wr, 564 op/s 2024-08-28T20:28:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:45 smithi001 ceph-mon[20984]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.3 MiB/s wr, 734 op/s 2024-08-28T20:28:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:45 smithi121 ceph-mon[25248]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.3 MiB/s wr, 734 op/s 2024-08-28T20:28:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:45 smithi007 ceph-mon[25357]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.3 MiB/s wr, 734 op/s 2024-08-28T20:28:48.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:47 smithi001 ceph-mon[20984]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 602 op/s 2024-08-28T20:28:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:47 smithi121 ceph-mon[25248]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 602 op/s 2024-08-28T20:28:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:47 smithi007 ceph-mon[25357]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 602 op/s 2024-08-28T20:28:48.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 620.0 s, 1204.8 tps, lat 83.437 ms stddev 99.702 2024-08-28T20:28:50.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:49 smithi001 ceph-mon[20984]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-08-28T20:28:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:49 smithi121 ceph-mon[25248]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-08-28T20:28:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:49 smithi007 ceph-mon[25357]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-08-28T20:28:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 -- 172.21.15.1:0/1710363877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb688111d30 msgr2=0x7fb688114150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 --2- 172.21.15.1:0/1710363877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb688111d30 0x7fb688114150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb680009c90 tx=0x7fb68002a880 comp rx=0 tx=0).stop 2024-08-28T20:28:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 -- 172.21.15.1:0/1710363877 shutdown_connections 2024-08-28T20:28:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 --2- 172.21.15.1:0/1710363877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb688111d30 0x7fb688114150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 --2- 172.21.15.1:0/1710363877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb68810ab40 0x7fb68810b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 --2- 172.21.15.1:0/1710363877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb68810a160 0x7fb68810a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.895+0000 7fb68de00640 1 -- 172.21.15.1:0/1710363877 >> 172.21.15.1:0/1710363877 conn(0x7fb6880705b0 msgr2=0x7fb688072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.896+0000 7fb68de00640 1 -- 172.21.15.1:0/1710363877 shutdown_connections 2024-08-28T20:28:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.896+0000 7fb68de00640 1 -- 172.21.15.1:0/1710363877 wait complete. 2024-08-28T20:28:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.897+0000 7fb68de00640 1 Processor -- start 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.898+0000 7fb68de00640 1 -- start start 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.899+0000 7fb68de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 0x7fb6881a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.899+0000 7fb68de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb68810ab40 0x7fb6881a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.899+0000 7fb68de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb688111d30 0x7fb6881a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.899+0000 7fb686a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 0x7fb6881a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.899+0000 7fb686a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 0x7fb6881a2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35686/0 (socket says 172.21.15.1:35686) 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.900+0000 7fb686a00640 1 -- 172.21.15.1:0/3855330068 learned_addr learned my addr 172.21.15.1:0/3855330068 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.900+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb688117810 con 0x7fb688111d30 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.900+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb688117690 con 0x7fb68810ab40 2024-08-28T20:28:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.900+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb688117990 con 0x7fb68810a160 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.900+0000 7fb686000640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb68810ab40 0x7fb6881a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb687400640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb688111d30 0x7fb6881a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb686a00640 1 -- 172.21.15.1:0/3855330068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb68810ab40 msgr2=0x7fb6881a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb686a00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb68810ab40 0x7fb6881a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb686a00640 1 -- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb688111d30 msgr2=0x7fb6881a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb686a00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb688111d30 0x7fb6881a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb686a00640 1 -- 172.21.15.1:0/3855330068 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6881a3eb0 con 0x7fb68810a160 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.901+0000 7fb686a00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 0x7fb6881a2470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ea60 tx=0x7fb67800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.902+0000 7fb68ca00640 1 -- 172.21.15.1:0/3855330068 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67800cde0 con 0x7fb68810a160 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.902+0000 7fb68ca00640 1 -- 172.21.15.1:0/3855330068 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6780035f0 con 0x7fb68810a160 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.902+0000 7fb68ca00640 1 -- 172.21.15.1:0/3855330068 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678010690 con 0x7fb68810a160 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.902+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6881a41a0 con 0x7fb68810a160 2024-08-28T20:28:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.902+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6881aa890 con 0x7fb68810a160 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.910+0000 7fb695036740 1 Processor -- start 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.912+0000 7fb68ca00640 1 -- 172.21.15.1:0/3855330068 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fb678004020 con 0x7fb68810a160 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.912+0000 7fb695036740 1 -- start start 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb695036740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 0x55a14e8c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb695036740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb695036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb695036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a14e836f70 con 0x55a14e4fd4d0 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb695036740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a14e826500 con 0x55a14e4f52f0 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb695036740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a14e82a4b0 con 0x55a14e51e1b0 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb687400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 0x55a14e8c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb687400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 0x55a14e8c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35694/0 (socket says 172.21.15.1:35694) 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.913+0000 7fb687400640 1 -- 172.21.15.1:0/650654838 learned_addr learned my addr 172.21.15.1:0/650654838 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.914+0000 7fb686a00640 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.914+0000 7fb687400640 1 -- 172.21.15.1:0/650654838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 msgr2=0x55a14e8c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.914+0000 7fb687400640 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.914+0000 7fb68ca00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb66c0b4bf0 0x7fb66c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.915+0000 7fb686000640 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.915+0000 7fb687400640 1 -- 172.21.15.1:0/650654838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4fd4d0 msgr2=0x55a14e8c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.915+0000 7fb687400640 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.915+0000 7fb686a00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb66c0b4bf0 0x7fb66c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.915+0000 7fb687400640 1 -- 172.21.15.1:0/650654838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a14e7e0c10 con 0x55a14e51e1b0 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.917+0000 7fb686000640 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.917+0000 7fb68ca00640 1 -- 172.21.15.1:0/3855330068 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb6780e5400 con 0x7fb68810a160 2024-08-28T20:28:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.917+0000 7fb687400640 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 0x55a14e8c3dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb68002ae10 tx=0x7fb6800093c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470891296ac381f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.918+0000 7fb673e00640 1 -- 172.21.15.1:0/650654838 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680031dc0 con 0x55a14e51e1b0 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.918+0000 7fb673e00640 1 -- 172.21.15.1:0/650654838 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb68003f070 con 0x55a14e51e1b0 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.918+0000 7fb673e00640 1 -- 172.21.15.1:0/650654838 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680004050 con 0x55a14e51e1b0 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 -- 172.21.15.1:0/650654838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 msgr2=0x55a14e8c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 0x55a14e8c3dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb68002ae10 tx=0x7fb6800093c0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb686a00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb66c0b4bf0 0x7fb66c0b7100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb6780abdb0 tx=0x7fb6780e2dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 -- 172.21.15.1:0/650654838 shutdown_connections 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 --2- 172.21.15.1:0/650654838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e51e1b0 0x55a14e8c3dc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 -- 172.21.15.1:0/650654838 >> 172.21.15.1:0/650654838 conn(0x55a14e512300 msgr2=0x55a14e8bf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.919+0000 7fb695036740 1 -- 172.21.15.1:0/650654838 shutdown_connections 2024-08-28T20:28:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.920+0000 7fb695036740 1 -- 172.21.15.1:0/650654838 wait complete. 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.923+0000 7fb695036740 1 -- start start 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.923+0000 7fb695036740 1 Processor -- start 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.924+0000 7fb695036740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 0x55a14e8cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.925+0000 7fb695036740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4fd4d0 0x55a14e8ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.925+0000 7fb695036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e51e1b0 0x55a14e8ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.925+0000 7fb695036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a14e75fab0 con 0x55a14e51e1b0 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.925+0000 7fb695036740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a14e7cd320 con 0x55a14e4fd4d0 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.925+0000 7fb695036740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a14e8c5a40 con 0x55a14e4f52f0 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.925+0000 7fb695036740 10 client.0 _ll_register_callbacks cb 0x55a14e7d36a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.926+0000 7fb687400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 0x55a14e8cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.926+0000 7fb687400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 0x55a14e8cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35702/0 (socket says 172.21.15.1:35702) 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.926+0000 7fb687400640 1 -- 172.21.15.1:0/1608769836 learned_addr learned my addr 172.21.15.1:0/1608769836 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.926+0000 7fb686000640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4fd4d0 0x55a14e8ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.926+0000 7fb687400640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e51e1b0 0x55a14e8ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.927+0000 7fb687400640 1 -- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4fd4d0 msgr2=0x55a14e8ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.927+0000 7fb687400640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4fd4d0 0x55a14e8ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.927+0000 7fb687400640 1 -- 172.21.15.1:0/1608769836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e51e1b0 msgr2=0x55a14e8ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.927+0000 7fb687400640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e51e1b0 0x55a14e8ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.927+0000 7fb687400640 1 -- 172.21.15.1:0/1608769836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a14e589790 con 0x55a14e4f52f0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.928+0000 7fb670c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.928+0000 7fb687400640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 0x55a14e8cf900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb680009bb0 tx=0x7fb6800039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2e322879056aa10 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.929+0000 7fb670c00640 1 -- 172.21.15.1:0/1608769836 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680003e60 con 0x55a14e4f52f0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.929+0000 7fb670c00640 1 -- 172.21.15.1:0/1608769836 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb680031610 con 0x55a14e4f52f0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.930+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb68003f070 con 0x55a14e4f52f0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.930+0000 7fb670c00640 1 -- 172.21.15.1:0/1608769836 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb680057050 con 0x55a14e4f52f0 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.930+0000 7fb695036740 10 client.25969 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.930+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a14e602620 con 0x55a14e4f52f0 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb670c00640 1 -- 172.21.15.1:0/1608769836 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb68003f070 con 0x55a14e4f52f0 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb670c00640 1 -- 172.21.15.1:0/1608769836 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fb6800046f0 con 0x55a14e4f52f0 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb695036740 10 client.25969 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb695036740 10 client.25969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb695036740 20 client.25969 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb695036740 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e4dcd80 0x55a14e8e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.933+0000 7fb695036740 4 client.25969 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.934+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a14e838ec0 con 0x55a14e4dcd80 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.937+0000 7fb686000640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e4dcd80 0x55a14e8e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.937+0000 7fb686000640 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e4dcd80 0x55a14e8e2f40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cce7f68bee3a4b24 server_cookie=9c0803c434410fe5 in_seq=0 out_seq=0 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.937+0000 7fb670c00640 10 client.25969 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.938+0000 7fb670c00640 1 -- 172.21.15.1:0/1608769836 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a14e838ec0 con 0x55a14e4dcd80 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.938+0000 7fb670c00640 10 client.25969 handle_command_reply: tid=0 2024-08-28T20:28:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.938+0000 7fb695036740 1 client.25969 shutdown 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.939+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 msgr2=0x55a14e8cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.939+0000 7fb695036740 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 0x55a14e8cf900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb680009bb0 tx=0x7fb6800039c0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.939+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 shutdown_connections 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.939+0000 7fb695036740 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e4dcd80 0x55a14e8e2f40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.939+0000 7fb695036740 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e51e1b0 0x55a14e8ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.939+0000 7fb670c00640 0 client.25969 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.940+0000 7fb695036740 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4fd4d0 0x55a14e8ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.940+0000 7fb695036740 1 --2- 172.21.15.1:0/1608769836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4f52f0 0x55a14e8cf900 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.940+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 >> 172.21.15.1:0/1608769836 conn(0x55a14e512300 msgr2=0x55a14e8bdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.940+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 shutdown_connections 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.943+0000 7fb695036740 1 -- 172.21.15.1:0/1608769836 wait complete. 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.943+0000 7fb695036740 20 client.25969 trim_cache size 0 max 16384 2024-08-28T20:28:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 Processor -- start 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 -- start start 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4dcd80 0x55a14e8ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881b3c50 con 0x55a14e4dcd80 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881b1520 con 0x55a14e4f52f0 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.976+0000 7fb695036740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881af370 con 0x55a14e4fd4d0 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:46794/0 (socket says 172.21.15.1:46794) 2024-08-28T20:28:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb687400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 -- 172.21.15.1:0/3629153428 learned_addr learned my addr 172.21.15.1:0/3629153428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb687400640 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4dcd80 0x55a14e8ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 -- 172.21.15.1:0/3629153428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 msgr2=0x55a14e8c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 -- 172.21.15.1:0/3629153428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4dcd80 msgr2=0x55a14e8ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4dcd80 0x55a14e8ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.977+0000 7fb686000640 1 -- 172.21.15.1:0/3629153428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a14e8bf4b0 con 0x55a14e4f52f0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.978+0000 7fb686000640 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c7f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb674009fd0 tx=0x7fb674014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a13d83ed17a334 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.978+0000 7fb673400640 1 -- 172.21.15.1:0/3629153428 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674014110 con 0x55a14e4f52f0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.978+0000 7fb673400640 1 -- 172.21.15.1:0/3629153428 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6740142b0 con 0x55a14e4f52f0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.979+0000 7fb673400640 1 -- 172.21.15.1:0/3629153428 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67401e430 con 0x55a14e4f52f0 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 -- 172.21.15.1:0/3629153428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 msgr2=0x55a14e8c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c7f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb674009fd0 tx=0x7fb674014840 comp rx=0 tx=0).stop 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 -- 172.21.15.1:0/3629153428 shutdown_connections 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4f52f0 0x55a14e8c7f10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 --2- 172.21.15.1:0/3629153428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4dcd80 0x55a14e8ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.980+0000 7fb695036740 1 -- 172.21.15.1:0/3629153428 >> 172.21.15.1:0/3629153428 conn(0x55a14e512300 msgr2=0x55a14e8cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.981+0000 7fb695036740 1 -- 172.21.15.1:0/3629153428 shutdown_connections 2024-08-28T20:28:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.981+0000 7fb695036740 1 -- 172.21.15.1:0/3629153428 wait complete. 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.981+0000 7fb695036740 1 -- start start 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.982+0000 7fb695036740 1 Processor -- start 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.983+0000 7fb695036740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 0x55a14e8de300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb695036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4f52f0 0x55a14e8dcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb687400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 0x55a14e8de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb687400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 0x55a14e8de300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:46804/0 (socket says 172.21.15.1:46804) 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb687400640 1 -- 172.21.15.1:0/460220237 learned_addr learned my addr 172.21.15.1:0/460220237 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:28:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881af9e0 con 0x55a14e4f52f0 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881b0e50 con 0x55a14e4dcd80 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.984+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6881b00b0 con 0x55a14e4fd4d0 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb695036740 10 client.0 _ll_register_callbacks cb 0x7fb680009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb686000640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4f52f0 0x55a14e8dcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb687400640 1 -- 172.21.15.1:0/460220237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 msgr2=0x55a14e8dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb687400640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb687400640 1 -- 172.21.15.1:0/460220237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4f52f0 msgr2=0x55a14e8dcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb687400640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4f52f0 0x55a14e8dcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb687400640 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a14e8ddcb0 con 0x55a14e4dcd80 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb686000640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4f52f0 0x55a14e8dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb687400640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 0x55a14e8de300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6800307a0 tx=0x7fb68002a880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7158904515a6653 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.985+0000 7fb670c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.986+0000 7fb670c00640 1 -- 172.21.15.1:0/460220237 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680009310 con 0x55a14e4dcd80 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.986+0000 7fb670c00640 1 -- 172.21.15.1:0/460220237 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb680004a90 con 0x55a14e4dcd80 2024-08-28T20:28:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.986+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a14e8be290 con 0x55a14e4dcd80 2024-08-28T20:28:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.986+0000 7fb670c00640 1 -- 172.21.15.1:0/460220237 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb680004c90 con 0x55a14e4dcd80 2024-08-28T20:28:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 10 client.26003 fetch_fsmap learned FSMap version 48 2024-08-28T20:28:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a14e94d950 con 0x55a14e4dcd80 2024-08-28T20:28:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb670c00640 1 -- 172.21.15.1:0/460220237 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a14e8be290 con 0x55a14e4dcd80 2024-08-28T20:28:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb670c00640 1 -- 172.21.15.1:0/460220237 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fb680005570 con 0x55a14e4dcd80 2024-08-28T20:28:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 10 client.26003 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 10 client.26003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 20 client.26003 populate_metadata read hostname 'smithi001' 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e51e1b0 0x55a14e950340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 4 client.26003 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.987+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a14e834960 con 0x55a14e51e1b0 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.988+0000 7fb686000640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e51e1b0 0x55a14e950340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.988+0000 7fb670c00640 10 client.26003 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:50.989+0000 7fb686000640 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e51e1b0 0x55a14e950340 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42b769c3244d2ae server_cookie=cf337d813e1eaf50 in_seq=0 out_seq=0 2024-08-28T20:28:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.000+0000 7fb670c00640 1 -- 172.21.15.1:0/460220237 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a14e834960 con 0x55a14e51e1b0 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.000+0000 7fb670c00640 10 client.26003 handle_command_reply: tid=0 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.000+0000 7fb695036740 1 client.26003 shutdown 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.001+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 msgr2=0x55a14e8de300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.001+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 0x55a14e8de300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6800307a0 tx=0x7fb68002a880 comp rx=0 tx=0).stop 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.001+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 shutdown_connections 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.001+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a14e51e1b0 0x55a14e950340 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.001+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a14e4f52f0 0x55a14e8dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.001+0000 7fb670c00640 0 client.26003 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.002+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a14e4fd4d0 0x55a14e8dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.002+0000 7fb695036740 1 --2- 172.21.15.1:0/460220237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a14e4dcd80 0x55a14e8de300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.002+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 >> 172.21.15.1:0/460220237 conn(0x55a14e512300 msgr2=0x55a14e8c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.002+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 shutdown_connections 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.002+0000 7fb695036740 1 -- 172.21.15.1:0/460220237 wait complete. 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.002+0000 7fb695036740 20 client.26003 trim_cache size 0 max 16384 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:28:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:28:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:28:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.003+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb66c0b4bf0 msgr2=0x7fb66c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.003+0000 7fb68de00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb66c0b4bf0 0x7fb66c0b7100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb6780abdb0 tx=0x7fb6780e2dc0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.003+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 msgr2=0x7fb6881a2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.003+0000 7fb68de00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 0x7fb6881a2470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ea60 tx=0x7fb67800ef20 comp rx=0 tx=0).stop 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 shutdown_connections 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb66c0b4bf0 0x7fb66c0b7100 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb688111d30 0x7fb6881a3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb68810ab40 0x7fb6881a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 --2- 172.21.15.1:0/3855330068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb68810a160 0x7fb6881a2470 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ea60 tx=0x7fb67800ef20 comp rx=0 tx=0).stop 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 >> 172.21.15.1:0/3855330068 conn(0x7fb6880705b0 msgr2=0x7fb68810dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:28:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 shutdown_connections 2024-08-28T20:28:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:28:51.004+0000 7fb68de00640 1 -- 172.21.15.1:0/3855330068 wait complete. 2024-08-28T20:28:52.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:51 smithi001 ceph-mon[20984]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 750 op/s 2024-08-28T20:28:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:51 smithi121 ceph-mon[25248]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 750 op/s 2024-08-28T20:28:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:51 smithi007 ceph-mon[25357]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 750 op/s 2024-08-28T20:28:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 625.0 s, 1270.3 tps, lat 77.800 ms stddev 93.296 2024-08-28T20:28:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:53 smithi001 ceph-mon[20984]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 MiB/s wr, 638 op/s 2024-08-28T20:28:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:53 smithi121 ceph-mon[25248]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 MiB/s wr, 638 op/s 2024-08-28T20:28:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:53 smithi007 ceph-mon[25357]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 MiB/s wr, 638 op/s 2024-08-28T20:28:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:55 smithi121 ceph-mon[25248]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 779 op/s 2024-08-28T20:28:56.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:55 smithi001 ceph-mon[20984]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 779 op/s 2024-08-28T20:28:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:55 smithi007 ceph-mon[25357]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 779 op/s 2024-08-28T20:28:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:57 smithi001 ceph-mon[20984]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 13 MiB/s wr, 635 op/s 2024-08-28T20:28:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:57 smithi121 ceph-mon[25248]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 13 MiB/s wr, 635 op/s 2024-08-28T20:28:58.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:57 smithi007 ceph-mon[25357]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 13 MiB/s wr, 635 op/s 2024-08-28T20:28:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 630.0 s, 1546.0 tps, lat 65.219 ms stddev 78.888 2024-08-28T20:29:00.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:28:59 smithi001 ceph-mon[20984]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 13 MiB/s wr, 672 op/s 2024-08-28T20:29:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:28:59 smithi121 ceph-mon[25248]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 13 MiB/s wr, 672 op/s 2024-08-28T20:29:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:28:59 smithi007 ceph-mon[25357]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 13 MiB/s wr, 672 op/s 2024-08-28T20:29:02.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:01 smithi001 ceph-mon[20984]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 655 op/s 2024-08-28T20:29:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:01 smithi121 ceph-mon[25248]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 655 op/s 2024-08-28T20:29:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:01 smithi007 ceph-mon[25357]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 655 op/s 2024-08-28T20:29:03.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 635.0 s, 1324.2 tps, lat 74.652 ms stddev 87.062 2024-08-28T20:29:04.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:03 smithi001 ceph-mon[20984]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 MiB/s wr, 558 op/s 2024-08-28T20:29:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:03 smithi121 ceph-mon[25248]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 MiB/s wr, 558 op/s 2024-08-28T20:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.299+0000 7fbe80200640 1 -- 172.21.15.1:0/593234084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810cb50 msgr2=0x7fbe7810f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.299+0000 7fbe80200640 1 --2- 172.21.15.1:0/593234084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810cb50 0x7fbe7810f030 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009900 tx=0x7fbe6402a410 comp rx=0 tx=0).stop 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 -- 172.21.15.1:0/593234084 shutdown_connections 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 --2- 172.21.15.1:0/593234084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 0x7fbe7811a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 --2- 172.21.15.1:0/593234084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810cb50 0x7fbe7810f030 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 --2- 172.21.15.1:0/593234084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810a160 0x7fbe7810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 -- 172.21.15.1:0/593234084 >> 172.21.15.1:0/593234084 conn(0x7fbe780705b0 msgr2=0x7fbe78072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 -- 172.21.15.1:0/593234084 shutdown_connections 2024-08-28T20:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.303+0000 7fbe80200640 1 -- 172.21.15.1:0/593234084 wait complete. 2024-08-28T20:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.305+0000 7fbe80200640 1 Processor -- start 2024-08-28T20:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.305+0000 7fbe80200640 1 -- start start 2024-08-28T20:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.306+0000 7fbe80200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810a160 0x7fbe781a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.306+0000 7fbe80200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 0x7fbe781a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe80200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 0x7fbe781a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe7d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810a160 0x7fbe781a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe80200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7811dfd0 con 0x7fbe7810f770 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe80200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7811de50 con 0x7fbe7810a160 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe80200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7811e150 con 0x7fbe7810cb50 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe7ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 0x7fbe781a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe7ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 0x7fbe781a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41458/0 (socket says 172.21.15.1:41458) 2024-08-28T20:29:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe7ce00640 1 -- 172.21.15.1:0/3744666809 learned_addr learned my addr 172.21.15.1:0/3744666809 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.307+0000 7fbe7ce00640 1 -- 172.21.15.1:0/3744666809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810a160 msgr2=0x7fbe781a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.308+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810a160 0x7fbe781a8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.308+0000 7fbe7ce00640 1 -- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 msgr2=0x7fbe781a9d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-28T20:29:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.308+0000 7fbe7e200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 0x7fbe781a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.309+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 0x7fbe781a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.313+0000 7fbe7ce00640 1 -- 172.21.15.1:0/3744666809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe781aa5a0 con 0x7fbe7810cb50 2024-08-28T20:29:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.313+0000 7fbe7e200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 0x7fbe781a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:03 smithi007 ceph-mon[25357]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 MiB/s wr, 558 op/s 2024-08-28T20:29:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.313+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 0x7fbe781a91d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe64006010 tx=0x7fbe640038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.314+0000 7fbe76000640 1 -- 172.21.15.1:0/3744666809 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6403f030 con 0x7fbe7810cb50 2024-08-28T20:29:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.314+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe781aa830 con 0x7fbe7810cb50 2024-08-28T20:29:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.314+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe781b0f80 con 0x7fbe7810cb50 2024-08-28T20:29:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.315+0000 7fbe76000640 1 -- 172.21.15.1:0/3744666809 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe64003ca0 con 0x7fbe7810cb50 2024-08-28T20:29:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.315+0000 7fbe76000640 1 -- 172.21.15.1:0/3744666809 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64049060 con 0x7fbe7810cb50 2024-08-28T20:29:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.323+0000 7fbe87200740 1 Processor -- start 2024-08-28T20:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.323+0000 7fbe87200740 1 -- start start 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe87200740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f708dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe87200740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f33a2f0 0x56248f709430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe87200740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3424d0 0x56248f709f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe87200740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56248f67bf70 con 0x56248f3424d0 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe87200740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56248f66b500 con 0x56248f3631b0 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe87200740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56248f66f4b0 con 0x56248f33a2f0 2024-08-28T20:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.324+0000 7fbe76000640 1 -- 172.21.15.1:0/3744666809 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbe64042030 con 0x7fbe7810cb50 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7ce00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3424d0 0x56248f709f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f708dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f708dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40502/0 (socket says 172.21.15.1:40502) 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 -- 172.21.15.1:0/3512560174 learned_addr learned my addr 172.21.15.1:0/3512560174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f33a2f0 0x56248f709430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 -- 172.21.15.1:0/3512560174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f33a2f0 msgr2=0x56248f709430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f33a2f0 0x56248f709430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 -- 172.21.15.1:0/3512560174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3424d0 msgr2=0x56248f709f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3424d0 0x56248f709f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.325+0000 7fbe7e200640 1 -- 172.21.15.1:0/3512560174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f625c10 con 0x56248f3631b0 2024-08-28T20:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.326+0000 7fbe7e200640 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f708dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe70007f30 tx=0x7fbe7000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32cc55d33f3b11a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.326+0000 7fbe6aa00640 1 -- 172.21.15.1:0/3512560174 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70014070 con 0x56248f3631b0 2024-08-28T20:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.326+0000 7fbe6aa00640 1 -- 172.21.15.1:0/3512560174 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7000fd00 con 0x56248f3631b0 2024-08-28T20:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.326+0000 7fbe6aa00640 1 -- 172.21.15.1:0/3512560174 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000ed10 con 0x56248f3631b0 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.327+0000 7fbe76000640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbe600b4e70 0x7fbe600b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.327+0000 7fbe76000640 1 -- 172.21.15.1:0/3744666809 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbe641055d0 con 0x7fbe7810cb50 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.327+0000 7fbe7d800640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbe600b4e70 0x7fbe600b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.327+0000 7fbe87200740 1 -- 172.21.15.1:0/3512560174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 msgr2=0x56248f708dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.327+0000 7fbe87200740 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f708dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe70007f30 tx=0x7fbe7000c750 comp rx=0 tx=0).stop 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.328+0000 7fbe87200740 1 -- 172.21.15.1:0/3512560174 shutdown_connections 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.328+0000 7fbe87200740 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3424d0 0x56248f709f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.328+0000 7fbe87200740 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f33a2f0 0x56248f709430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.328+0000 7fbe87200740 1 --2- 172.21.15.1:0/3512560174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f708dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.328+0000 7fbe87200740 1 -- 172.21.15.1:0/3512560174 >> 172.21.15.1:0/3512560174 conn(0x56248f357300 msgr2=0x56248f704850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.329+0000 7fbe7d800640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbe600b4e70 0x7fbe600b7380 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c006fd0 tx=0x7fbe6c0090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.329+0000 7fbe87200740 1 -- 172.21.15.1:0/3512560174 shutdown_connections 2024-08-28T20:29:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.330+0000 7fbe87200740 1 -- 172.21.15.1:0/3512560174 wait complete. 2024-08-28T20:29:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.331+0000 7fbe87200740 1 -- start start 2024-08-28T20:29:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.331+0000 7fbe87200740 1 Processor -- start 2024-08-28T20:29:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f712480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f712b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56248f5a4ab0 con 0x56248f33a2f0 2024-08-28T20:29:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56248f612320 con 0x56248f3631b0 2024-08-28T20:29:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56248f70aaa0 con 0x56248f3424d0 2024-08-28T20:29:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe87200740 10 client.0 _ll_register_callbacks cb 0x56248f6186a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe7ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f712b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe7ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f712b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41482/0 (socket says 172.21.15.1:41482) 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.332+0000 7fbe7ce00640 1 -- 172.21.15.1:0/1584619615 learned_addr learned my addr 172.21.15.1:0/1584619615 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7e200640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7ce00640 1 -- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 msgr2=0x56248f7136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7ce00640 1 -- 172.21.15.1:0/1584619615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 msgr2=0x56248f712480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7d800640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f712480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f712480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.333+0000 7fbe7ce00640 1 -- 172.21.15.1:0/1584619615 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248f3ce790 con 0x56248f3424d0 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.334+0000 7fbe7e200640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.334+0000 7fbe7d800640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f712480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.334+0000 7fbe5f400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.334+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f712b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe64108d40 tx=0x7fbe640c80b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4704a413e74fffe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.334+0000 7fbe5f400640 1 -- 172.21.15.1:0/1584619615 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6403f040 con 0x56248f3424d0 2024-08-28T20:29:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.335+0000 7fbe5f400640 1 -- 172.21.15.1:0/1584619615 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbe64031640 con 0x56248f3424d0 2024-08-28T20:29:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.336+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7000fd00 con 0x56248f3424d0 2024-08-28T20:29:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.336+0000 7fbe5f400640 1 -- 172.21.15.1:0/1584619615 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbe640cbcd0 con 0x56248f3424d0 2024-08-28T20:29:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.336+0000 7fbe87200740 10 client.25981 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.336+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x56248f447620 con 0x56248f3424d0 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe5f400640 1 -- 172.21.15.1:0/1584619615 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7000fd00 con 0x56248f3424d0 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe5f400640 1 -- 172.21.15.1:0/1584619615 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fbe640d4e20 con 0x56248f3424d0 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe87200740 10 client.25981 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe87200740 10 client.25981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe87200740 20 client.25981 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe87200740 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f321d80 0x56248f71fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe87200740 4 client.25981 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56248f67dec0 con 0x56248f321d80 2024-08-28T20:29:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.337+0000 7fbe7d800640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f321d80 0x56248f71fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.338+0000 7fbe7d800640 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f321d80 0x56248f71fce0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09b1452c83dcfdf server_cookie=92556020fce10e2f in_seq=0 out_seq=0 2024-08-28T20:29:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.338+0000 7fbe5f400640 10 client.25981 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe5f400640 1 -- 172.21.15.1:0/1584619615 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56248f67dec0 con 0x56248f321d80 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe5f400640 10 client.25981 handle_command_reply: tid=0 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 client.25981 shutdown 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 msgr2=0x56248f712b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f712b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe64108d40 tx=0x7fbe640c80b0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 shutdown_connections 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f321d80 0x56248f71fce0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f712b40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 --2- 172.21.15.1:0/1584619615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f712480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 >> 172.21.15.1:0/1584619615 conn(0x56248f357300 msgr2=0x56248f702cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.339+0000 7fbe5f400640 0 client.25981 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.340+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 shutdown_connections 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.340+0000 7fbe87200740 1 -- 172.21.15.1:0/1584619615 wait complete. 2024-08-28T20:29:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.340+0000 7fbe87200740 20 client.25981 trim_cache size 0 max 16384 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 Processor -- start 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 -- start start 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f70d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f704190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58010e80 con 0x56248f33a2f0 2024-08-28T20:29:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5800e750 con 0x56248f3631b0 2024-08-28T20:29:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.362+0000 7fbe87200740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5800c5a0 con 0x56248f3424d0 2024-08-28T20:29:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7d800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f70d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f704190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7d800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f70d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44838/0 (socket says 172.21.15.1:44838) 2024-08-28T20:29:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7d800640 1 -- 172.21.15.1:0/4231869714 learned_addr learned my addr 172.21.15.1:0/4231869714 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 -- 172.21.15.1:0/4231869714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 msgr2=0x56248f704190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f704190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 -- 172.21.15.1:0/4231869714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 msgr2=0x56248f70d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f70d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 -- 172.21.15.1:0/4231869714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f71a650 con 0x56248f3631b0 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.363+0000 7fbe7e200640 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7116d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbe70004be0 tx=0x7fbe70007bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44a1544164c0eac8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.364+0000 7fbe6a000640 1 -- 172.21.15.1:0/4231869714 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70029070 con 0x56248f3631b0 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.364+0000 7fbe6a000640 1 -- 172.21.15.1:0/4231869714 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7000e920 con 0x56248f3631b0 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.364+0000 7fbe6a000640 1 -- 172.21.15.1:0/4231869714 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70014040 con 0x56248f3631b0 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.364+0000 7fbe87200740 1 -- 172.21.15.1:0/4231869714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 msgr2=0x56248f7116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.364+0000 7fbe87200740 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7116d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbe70004be0 tx=0x7fbe70007bf0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 -- 172.21.15.1:0/4231869714 shutdown_connections 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f3631b0 0x56248f7116d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f704190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 --2- 172.21.15.1:0/4231869714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f33a2f0 0x56248f70d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 -- 172.21.15.1:0/4231869714 >> 172.21.15.1:0/4231869714 conn(0x56248f357300 msgr2=0x56248f710fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 -- 172.21.15.1:0/4231869714 shutdown_connections 2024-08-28T20:29:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 -- 172.21.15.1:0/4231869714 wait complete. 2024-08-28T20:29:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 -- start start 2024-08-28T20:29:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.365+0000 7fbe87200740 1 Processor -- start 2024-08-28T20:29:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 0x56248f719bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f718460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3631b0 0x56248f7189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5800cc10 con 0x56248f3631b0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5800e080 con 0x56248f33a2f0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5800d2e0 con 0x56248f3424d0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe87200740 10 client.0 _ll_register_callbacks cb 0x7fbe6403bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe7d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 0x56248f719bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe7d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 0x56248f719bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:40522/0 (socket says 172.21.15.1:40522) 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe7d800640 1 -- 172.21.15.1:0/955921986 learned_addr learned my addr 172.21.15.1:0/955921986 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f718460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe7e200640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3631b0 0x56248f7189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.366+0000 7fbe7d800640 1 -- 172.21.15.1:0/955921986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 msgr2=0x56248f718460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.367+0000 7fbe7d800640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f718460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.367+0000 7fbe7d800640 1 -- 172.21.15.1:0/955921986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3631b0 msgr2=0x56248f7189a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.367+0000 7fbe7d800640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3631b0 0x56248f7189a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.367+0000 7fbe7d800640 1 -- 172.21.15.1:0/955921986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248f718f60 con 0x56248f33a2f0 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.367+0000 7fbe7d800640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 0x56248f719bd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x56248f720410 tx=0x7fbe6c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad90e2c3501fd47 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.368+0000 7fbe5f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.368+0000 7fbe5f400640 1 -- 172.21.15.1:0/955921986 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c033480 con 0x56248f33a2f0 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.368+0000 7fbe5f400640 1 -- 172.21.15.1:0/955921986 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbe6c033620 con 0x56248f33a2f0 2024-08-28T20:29:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.368+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7000e920 con 0x56248f33a2f0 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.369+0000 7fbe5f400640 1 -- 172.21.15.1:0/955921986 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbe6c033820 con 0x56248f33a2f0 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.369+0000 7fbe87200740 10 client.26018 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.369+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x56248f78b500 con 0x56248f33a2f0 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe5f400640 1 -- 172.21.15.1:0/955921986 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7000e920 con 0x56248f33a2f0 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe5f400640 1 -- 172.21.15.1:0/955921986 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7fbe6c020040 con 0x56248f33a2f0 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe87200740 10 client.26018 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe87200740 10 client.26018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe87200740 20 client.26018 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe87200740 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f2f71c0 0x56248f78df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe87200740 4 client.26018 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:29:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56248f679960 con 0x56248f2f71c0 2024-08-28T20:29:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.370+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f2f71c0 0x56248f78df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.371+0000 7fbe5f400640 10 client.26018 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.371+0000 7fbe7ce00640 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f2f71c0 0x56248f78df10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735d658a23f8821 server_cookie=7fa088b30a5d298c in_seq=0 out_seq=0 2024-08-28T20:29:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.382+0000 7fbe5f400640 1 -- 172.21.15.1:0/955921986 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56248f679960 con 0x56248f2f71c0 2024-08-28T20:29:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.382+0000 7fbe5f400640 10 client.26018 handle_command_reply: tid=0 2024-08-28T20:29:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.382+0000 7fbe87200740 1 client.26018 shutdown 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 msgr2=0x56248f719bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 0x56248f719bd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x56248f720410 tx=0x7fbe6c014000 comp rx=0 tx=0).stop 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 shutdown_connections 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56248f2f71c0 0x56248f78df10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56248f3631b0 0x56248f7189a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56248f3424d0 0x56248f718460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 --2- 172.21.15.1:0/955921986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56248f33a2f0 0x56248f719bd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 >> 172.21.15.1:0/955921986 conn(0x56248f357300 msgr2=0x56248f70d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe5f400640 0 client.26018 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 shutdown_connections 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 1 -- 172.21.15.1:0/955921986 wait complete. 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.383+0000 7fbe87200740 20 client.26018 trim_cache size 0 max 16384 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:29:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:29:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbe600b4e70 msgr2=0x7fbe600b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbe600b4e70 0x7fbe600b7380 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c006fd0 tx=0x7fbe6c0090e0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 msgr2=0x7fbe781a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 0x7fbe781a91d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe64006010 tx=0x7fbe640038a0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 shutdown_connections 2024-08-28T20:29:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbe600b4e70 0x7fbe600b7380 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7810f770 0x7fbe781a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7810cb50 0x7fbe781a91d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 --2- 172.21.15.1:0/3744666809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe7810a160 0x7fbe781a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 >> 172.21.15.1:0/3744666809 conn(0x7fbe780705b0 msgr2=0x7fbe7810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.384+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 shutdown_connections 2024-08-28T20:29:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:04.385+0000 7fbe80200640 1 -- 172.21.15.1:0/3744666809 wait complete. 2024-08-28T20:29:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:05 smithi001 ceph-mon[20984]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 710 op/s 2024-08-28T20:29:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:05 smithi121 ceph-mon[25248]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 710 op/s 2024-08-28T20:29:06.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:05 smithi007 ceph-mon[25357]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 710 op/s 2024-08-28T20:29:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:07 smithi007 ceph-mon[25357]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 13 MiB/s wr, 610 op/s 2024-08-28T20:29:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:07 smithi001 ceph-mon[20984]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 13 MiB/s wr, 610 op/s 2024-08-28T20:29:08.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:07 smithi121 ceph-mon[25248]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 13 MiB/s wr, 610 op/s 2024-08-28T20:29:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 640.0 s, 1715.2 tps, lat 59.259 ms stddev 75.591 2024-08-28T20:29:10.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:09 smithi007 ceph-mon[25357]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 15 MiB/s wr, 669 op/s 2024-08-28T20:29:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:09 smithi001 ceph-mon[20984]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 15 MiB/s wr, 669 op/s 2024-08-28T20:29:10.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:09 smithi121 ceph-mon[25248]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 15 MiB/s wr, 669 op/s 2024-08-28T20:29:12.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:11 smithi007 ceph-mon[25357]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 688 op/s 2024-08-28T20:29:12.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:11 smithi001 ceph-mon[20984]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 688 op/s 2024-08-28T20:29:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:11 smithi121 ceph-mon[25248]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 688 op/s 2024-08-28T20:29:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 645.0 s, 1566.6 tps, lat 63.624 ms stddev 73.185 2024-08-28T20:29:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:13 smithi007 ceph-mon[25357]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 12 MiB/s wr, 588 op/s 2024-08-28T20:29:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:13 smithi001 ceph-mon[20984]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 12 MiB/s wr, 588 op/s 2024-08-28T20:29:14.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:13 smithi121 ceph-mon[25248]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 12 MiB/s wr, 588 op/s 2024-08-28T20:29:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:15 smithi007 ceph-mon[25357]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 719 op/s 2024-08-28T20:29:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:15 smithi001 ceph-mon[20984]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 719 op/s 2024-08-28T20:29:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:16 smithi121 ceph-mon[25248]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 719 op/s 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 -- 172.21.15.1:0/837801954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7406b620 msgr2=0x7f4a741060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 --2- 172.21.15.1:0/837801954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7406b620 0x7f4a741060a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009860 tx=0x7f4a6802a340 comp rx=0 tx=0).stop 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 -- 172.21.15.1:0/837801954 shutdown_connections 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 --2- 172.21.15.1:0/837801954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a741091a0 0x7f4a7410b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 --2- 172.21.15.1:0/837801954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741065e0 0x7f4a74108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 --2- 172.21.15.1:0/837801954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a7406b620 0x7f4a741060a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 -- 172.21.15.1:0/837801954 >> 172.21.15.1:0/837801954 conn(0x7f4a740fdca0 msgr2=0x7f4a74100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 -- 172.21.15.1:0/837801954 shutdown_connections 2024-08-28T20:29:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.670+0000 7f4a7b800640 1 -- 172.21.15.1:0/837801954 wait complete. 2024-08-28T20:29:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.671+0000 7f4a7b800640 1 Processor -- start 2024-08-28T20:29:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.671+0000 7f4a7b800640 1 -- start start 2024-08-28T20:29:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a7b800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406b620 0x7f4a74197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a7b800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a741065e0 0x7f4a741981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a7b800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741091a0 0x7f4a74198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a7b800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74103510 con 0x7f4a741065e0 2024-08-28T20:29:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a7b800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74103390 con 0x7f4a7406b620 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a7b800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74103690 con 0x7f4a741091a0 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a78e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406b620 0x7f4a74197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a78e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406b620 0x7f4a74197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59484/0 (socket says 172.21.15.1:59484) 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a78e00640 1 -- 172.21.15.1:0/1786159194 learned_addr learned my addr 172.21.15.1:0/1786159194 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a73e00640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a741065e0 0x7f4a741981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.672+0000 7f4a79800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741091a0 0x7f4a74198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a79800640 1 -- 172.21.15.1:0/1786159194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406b620 msgr2=0x7f4a74197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a79800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406b620 0x7f4a74197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a79800640 1 -- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a741065e0 msgr2=0x7f4a741981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a79800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a741065e0 0x7f4a741981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a79800640 1 -- 172.21.15.1:0/1786159194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a74199590 con 0x7f4a741091a0 2024-08-28T20:29:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a79800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741091a0 0x7f4a74198d70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009fd0 tx=0x7f4a6c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.673+0000 7f4a71600640 1 -- 172.21.15.1:0/1786159194 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00cd60 con 0x7f4a741091a0 2024-08-28T20:29:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.674+0000 7f4a71600640 1 -- 172.21.15.1:0/1786159194 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a6c005020 con 0x7f4a741091a0 2024-08-28T20:29:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.674+0000 7f4a71600640 1 -- 172.21.15.1:0/1786159194 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c010690 con 0x7f4a741091a0 2024-08-28T20:29:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.674+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a74199880 con 0x7f4a741091a0 2024-08-28T20:29:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.674+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7419df60 con 0x7f4a741091a0 2024-08-28T20:29:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.680+0000 7f4a827e2740 1 Processor -- start 2024-08-28T20:29:17.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a71600640 1 -- 172.21.15.1:0/1786159194 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f4a6c010830 con 0x7f4a741091a0 2024-08-28T20:29:17.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 -- start start 2024-08-28T20:29:17.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b14a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b14af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b26b0bcf70 con 0x55b26ad7b2f0 2024-08-28T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b26b0ac500 con 0x55b26ad834d0 2024-08-28T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.681+0000 7f4a827e2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b26b0b04b0 con 0x55b26ada41b0 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b14a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45632/0 (socket says 172.21.15.1:45632) 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 -- 172.21.15.1:0/3080871377 learned_addr learned my addr 172.21.15.1:0/3080871377 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a73e00640 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a73e00640 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 -- 172.21.15.1:0/3080871377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 msgr2=0x55b26b149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 -- 172.21.15.1:0/3080871377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 msgr2=0x55b26b14af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.682+0000 7f4a78e00640 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b14af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.683+0000 7f4a78e00640 1 -- 172.21.15.1:0/3080871377 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26b066c10 con 0x55b26ad7b2f0 2024-08-28T20:29:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.683+0000 7f4a73e00640 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:29:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.683+0000 7f4a71600640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4a5c0b4bf0 0x7f4a5c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.683+0000 7f4a71600640 1 -- 172.21.15.1:0/1786159194 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4a6c0e57b0 con 0x7f4a741091a0 2024-08-28T20:29:17.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.683+0000 7f4a78e00640 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b14a430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c244cd0b5d1e20 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:17.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.683+0000 7f4a73e00640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4a5c0b4bf0 0x7f4a5c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.686+0000 7f4a66000640 1 -- 172.21.15.1:0/3080871377 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68037040 con 0x55b26ad7b2f0 2024-08-28T20:29:17.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.686+0000 7f4a73e00640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4a5c0b4bf0 0x7f4a5c0b7100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009690 tx=0x7f4a60009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.686+0000 7f4a66000640 1 -- 172.21.15.1:0/3080871377 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a68004040 con 0x55b26ad7b2f0 2024-08-28T20:29:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.686+0000 7f4a66000640 1 -- 172.21.15.1:0/3080871377 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a680055a0 con 0x55b26ad7b2f0 2024-08-28T20:29:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 -- 172.21.15.1:0/3080871377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 msgr2=0x55b26b14a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b14a430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68009540 comp rx=0 tx=0).stop 2024-08-28T20:29:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 -- 172.21.15.1:0/3080871377 shutdown_connections 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b14a430 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3080871377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 -- 172.21.15.1:0/3080871377 >> 172.21.15.1:0/3080871377 conn(0x55b26ad98300 msgr2=0x55b26b145850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 -- 172.21.15.1:0/3080871377 shutdown_connections 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.687+0000 7f4a827e2740 1 -- 172.21.15.1:0/3080871377 wait complete. 2024-08-28T20:29:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.688+0000 7f4a827e2740 1 -- start start 2024-08-28T20:29:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.688+0000 7f4a827e2740 1 Processor -- start 2024-08-28T20:29:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 0x55b26b153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad834d0 0x55b26b153b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ada41b0 0x55b26b1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b26afe5ab0 con 0x55b26ad834d0 2024-08-28T20:29:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b26b053320 con 0x55b26ada41b0 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b26b14ba40 con 0x55b26ad7b2f0 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a827e2740 10 client.0 _ll_register_callbacks cb 0x55b26b0596a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a78e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 0x55b26b153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a78e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 0x55b26b153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58236/0 (socket says 172.21.15.1:58236) 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.689+0000 7f4a78e00640 1 -- 172.21.15.1:0/317574472 learned_addr learned my addr 172.21.15.1:0/317574472 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a73e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad834d0 0x55b26b153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a78e00640 1 -- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ada41b0 msgr2=0x55b26b1546a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a79800640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ada41b0 0x55b26b1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a78e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ada41b0 0x55b26b1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a78e00640 1 -- 172.21.15.1:0/317574472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad834d0 msgr2=0x55b26b153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a78e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad834d0 0x55b26b153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a78e00640 1 -- 172.21.15.1:0/317574472 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b26ae0f790 con 0x55b26ad7b2f0 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a73e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad834d0 0x55b26b153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a79800640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ada41b0 0x55b26b1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a78e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 0x55b26b153470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009830 tx=0x7f4a68004560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9113207ab960ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.690+0000 7f4a5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.691+0000 7f4a5aa00640 1 -- 172.21.15.1:0/317574472 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68037040 con 0x55b26ad7b2f0 2024-08-28T20:29:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.691+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a68004040 con 0x55b26ad7b2f0 2024-08-28T20:29:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.691+0000 7f4a5aa00640 1 -- 172.21.15.1:0/317574472 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4a68030550 con 0x55b26ad7b2f0 2024-08-28T20:29:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.692+0000 7f4a5aa00640 1 -- 172.21.15.1:0/317574472 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4a68030750 con 0x55b26ad7b2f0 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.692+0000 7f4a827e2740 10 client.25999 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.692+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b26ae88620 con 0x55b26ad7b2f0 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.693+0000 7f4a5aa00640 1 -- 172.21.15.1:0/317574472 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a68004040 con 0x55b26ad7b2f0 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.693+0000 7f4a5aa00640 1 -- 172.21.15.1:0/317574472 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7f4a68004860 con 0x55b26ad7b2f0 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.694+0000 7f4a827e2740 10 client.25999 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.694+0000 7f4a827e2740 10 client.25999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.694+0000 7f4a827e2740 20 client.25999 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.694+0000 7f4a827e2740 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad62d80 0x55b26b160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.694+0000 7f4a827e2740 4 client.25999 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:29:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.694+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b26b0beec0 con 0x55b26ad62d80 2024-08-28T20:29:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.695+0000 7f4a73e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad62d80 0x55b26b160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.695+0000 7f4a73e00640 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad62d80 0x55b26b160780 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346f9f0446a5463 server_cookie=58146177e3c5f5a2 in_seq=0 out_seq=0 2024-08-28T20:29:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.695+0000 7f4a5aa00640 10 client.25999 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.696+0000 7f4a5aa00640 1 -- 172.21.15.1:0/317574472 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b26b0beec0 con 0x55b26ad62d80 2024-08-28T20:29:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.696+0000 7f4a5aa00640 10 client.25999 handle_command_reply: tid=0 2024-08-28T20:29:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.696+0000 7f4a827e2740 1 client.25999 shutdown 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 msgr2=0x55b26b153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 0x55b26b153470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009830 tx=0x7f4a68004560 comp rx=0 tx=0).stop 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 shutdown_connections 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad62d80 0x55b26b160780 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad834d0 0x55b26b153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ada41b0 0x55b26b1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 --2- 172.21.15.1:0/317574472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ad7b2f0 0x55b26b153470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 >> 172.21.15.1:0/317574472 conn(0x55b26ad98300 msgr2=0x55b26b143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a5aa00640 0 client.25999 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 shutdown_connections 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 1 -- 172.21.15.1:0/317574472 wait complete. 2024-08-28T20:29:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.697+0000 7f4a827e2740 20 client.25999 trim_cache size 0 max 16384 2024-08-28T20:29:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.735+0000 7f4a827e2740 1 Processor -- start 2024-08-28T20:29:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.735+0000 7f4a827e2740 1 -- start start 2024-08-28T20:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.736+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b149d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.737+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.737+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b14a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.737+0000 7f4a79800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b14a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.737+0000 7f4a79800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b14a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58252/0 (socket says 172.21.15.1:58252) 2024-08-28T20:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.738+0000 7f4a827e2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741bc460 con 0x55b26ad7b2f0 2024-08-28T20:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.738+0000 7f4a827e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b9d30 con 0x55b26ad834d0 2024-08-28T20:29:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.738+0000 7f4a827e2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b7b80 con 0x55b26ada41b0 2024-08-28T20:29:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.738+0000 7f4a73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.738+0000 7f4a79800640 1 -- 172.21.15.1:0/3180148921 learned_addr learned my addr 172.21.15.1:0/3180148921 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.739+0000 7f4a79800640 1 -- 172.21.15.1:0/3180148921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 msgr2=0x55b26b15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.739+0000 7f4a79800640 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.739+0000 7f4a79800640 1 -- 172.21.15.1:0/3180148921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 msgr2=0x55b26b149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.739+0000 7f4a79800640 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.739+0000 7f4a79800640 1 -- 172.21.15.1:0/3180148921 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26b151630 con 0x55b26ada41b0 2024-08-28T20:29:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.739+0000 7f4a79800640 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b14a2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0e3610 tx=0x7f4a6c0b54f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20cd50758b860769 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.740+0000 7f4a65600640 1 -- 172.21.15.1:0/3180148921 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0054d0 con 0x55b26ada41b0 2024-08-28T20:29:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.740+0000 7f4a65600640 1 -- 172.21.15.1:0/3180148921 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a6c005670 con 0x55b26ada41b0 2024-08-28T20:29:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.740+0000 7f4a65600640 1 -- 172.21.15.1:0/3180148921 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c010d80 con 0x55b26ada41b0 2024-08-28T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 -- 172.21.15.1:0/3180148921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 msgr2=0x55b26b14a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b14a2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0e3610 tx=0x7f4a6c0b54f0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 -- 172.21.15.1:0/3180148921 shutdown_connections 2024-08-28T20:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b14a2a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 --2- 172.21.15.1:0/3180148921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.742+0000 7f4a827e2740 1 -- 172.21.15.1:0/3180148921 >> 172.21.15.1:0/3180148921 conn(0x55b26ad98300 msgr2=0x55b26b152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.744+0000 7f4a827e2740 1 -- 172.21.15.1:0/3180148921 shutdown_connections 2024-08-28T20:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.744+0000 7f4a827e2740 1 -- 172.21.15.1:0/3180148921 wait complete. 2024-08-28T20:29:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.745+0000 7f4a827e2740 1 -- start start 2024-08-28T20:29:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.745+0000 7f4a827e2740 1 Processor -- start 2024-08-28T20:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b81f0 con 0x55b26ad7b2f0 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b9660 con 0x55b26ad834d0 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b88c0 con 0x55b26ada41b0 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a827e2740 10 client.0 _ll_register_callbacks cb 0x7f4a680096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a79800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a79800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:58266/0 (socket says 172.21.15.1:58266) 2024-08-28T20:29:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a79800640 1 -- 172.21.15.1:0/1650843113 learned_addr learned my addr 172.21.15.1:0/1650843113 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.747+0000 7f4a73e00640 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.748+0000 7f4a79800640 1 -- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 msgr2=0x55b26b15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.748+0000 7f4a79800640 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.748+0000 7f4a79800640 1 -- 172.21.15.1:0/1650843113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 msgr2=0x55b26b15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.748+0000 7f4a79800640 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.748+0000 7f4a79800640 1 -- 172.21.15.1:0/1650843113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b26b15a4a0 con 0x55b26ada41b0 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.749+0000 7f4a79800640 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b159d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c01c040 tx=0x7f4a6c0e3470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e170d9f9ec9353 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.749+0000 7f4a5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:29:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.750+0000 7f4a5aa00640 1 -- 172.21.15.1:0/1650843113 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0c6060 con 0x55b26ada41b0 2024-08-28T20:29:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.750+0000 7f4a5aa00640 1 -- 172.21.15.1:0/1650843113 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4a6c010b20 con 0x55b26ada41b0 2024-08-28T20:29:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.750+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a6c005670 con 0x55b26ada41b0 2024-08-28T20:29:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.752+0000 7f4a5aa00640 1 -- 172.21.15.1:0/1650843113 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4a6c0cd050 con 0x55b26ada41b0 2024-08-28T20:29:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.752+0000 7f4a827e2740 10 client.26005 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.752+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b26b159470 con 0x55b26ada41b0 2024-08-28T20:29:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.753+0000 7f4a5aa00640 1 -- 172.21.15.1:0/1650843113 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a6c005670 con 0x55b26ada41b0 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a5aa00640 1 -- 172.21.15.1:0/1650843113 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7f4a6c0a7d00 con 0x55b26ada41b0 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a827e2740 10 client.26005 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a827e2740 10 client.26005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a827e2740 20 client.26005 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a827e2740 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad381c0 0x55b26b1cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a827e2740 4 client.26005 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b26b0ba960 con 0x55b26ad381c0 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.754+0000 7f4a78e00640 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad381c0 0x55b26b1cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.755+0000 7f4a5aa00640 10 client.26005 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.755+0000 7f4a78e00640 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad381c0 0x55b26b1cd6e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749a7fdc44188b17 server_cookie=cb8845939101f866 in_seq=0 out_seq=0 2024-08-28T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.777+0000 7f4a5aa00640 1 -- 172.21.15.1:0/1650843113 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b26b0ba960 con 0x55b26ad381c0 2024-08-28T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.777+0000 7f4a5aa00640 10 client.26005 handle_command_reply: tid=0 2024-08-28T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.777+0000 7f4a827e2740 1 client.26005 shutdown 2024-08-28T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 msgr2=0x55b26b159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b159d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c01c040 tx=0x7f4a6c0e3470 comp rx=0 tx=0).stop 2024-08-28T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 shutdown_connections 2024-08-28T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b26ad381c0 0x55b26b1cd6e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b26ada41b0 0x55b26b159d10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26ad834d0 0x55b26b15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a5aa00640 0 client.26005 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 --2- 172.21.15.1:0/1650843113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b26ad7b2f0 0x55b26b15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 >> 172.21.15.1:0/1650843113 conn(0x55b26ad98300 msgr2=0x55b26b152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.778+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 shutdown_connections 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.779+0000 7f4a827e2740 1 -- 172.21.15.1:0/1650843113 wait complete. 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.779+0000 7f4a827e2740 20 client.26005 trim_cache size 0 max 16384 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:29:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:29:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:29:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:29:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4a5c0b4bf0 msgr2=0x7f4a5c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4a5c0b4bf0 0x7f4a5c0b7100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009690 tx=0x7f4a60009620 comp rx=0 tx=0).stop 2024-08-28T20:29:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741091a0 msgr2=0x7f4a74198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741091a0 0x7f4a74198d70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009fd0 tx=0x7f4a6c00ee50 comp rx=0 tx=0).stop 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 shutdown_connections 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4a5c0b4bf0 0x7f4a5c0b7100 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a741065e0 0x7f4a741981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a741091a0 0x7f4a74198d70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 --2- 172.21.15.1:0/1786159194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406b620 0x7f4a74197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 >> 172.21.15.1:0/1786159194 conn(0x7f4a740fdca0 msgr2=0x7f4a74105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 shutdown_connections 2024-08-28T20:29:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:17.781+0000 7f4a7b800640 1 -- 172.21.15.1:0/1786159194 wait complete. 2024-08-28T20:29:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:18 smithi007 ceph-mon[25357]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 MiB/s wr, 605 op/s 2024-08-28T20:29:18.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:18 smithi001 ceph-mon[20984]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 MiB/s wr, 605 op/s 2024-08-28T20:29:18.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:18 smithi121 ceph-mon[25248]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 MiB/s wr, 605 op/s 2024-08-28T20:29:18.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 650.0 s, 1497.2 tps, lat 66.465 ms stddev 76.566 2024-08-28T20:29:20.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:20 smithi007 ceph-mon[25357]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 652 op/s 2024-08-28T20:29:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:20 smithi001 ceph-mon[20984]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 652 op/s 2024-08-28T20:29:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:20 smithi121 ceph-mon[25248]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 652 op/s 2024-08-28T20:29:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:22 smithi007 ceph-mon[25357]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 667 op/s 2024-08-28T20:29:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:22 smithi001 ceph-mon[20984]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 667 op/s 2024-08-28T20:29:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:22 smithi121 ceph-mon[25248]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 667 op/s 2024-08-28T20:29:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 655.0 s, 1547.0 tps, lat 64.466 ms stddev 74.165 2024-08-28T20:29:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:24 smithi007 ceph-mon[25357]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 605 op/s 2024-08-28T20:29:24.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:24 smithi001 ceph-mon[20984]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 605 op/s 2024-08-28T20:29:24.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:24 smithi121 ceph-mon[25248]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 605 op/s 2024-08-28T20:29:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:26 smithi007 ceph-mon[25357]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-08-28T20:29:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:26 smithi001 ceph-mon[20984]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-08-28T20:29:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:26 smithi121 ceph-mon[25248]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-08-28T20:29:28.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:28 smithi001 ceph-mon[20984]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 617 op/s 2024-08-28T20:29:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:28 smithi121 ceph-mon[25248]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 617 op/s 2024-08-28T20:29:28.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:28 smithi007 ceph-mon[25357]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 617 op/s 2024-08-28T20:29:28.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 660.0 s, 1351.9 tps, lat 67.244 ms stddev 83.321 2024-08-28T20:29:30.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:30 smithi001 ceph-mon[20984]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 MiB/s wr, 714 op/s 2024-08-28T20:29:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:30 smithi121 ceph-mon[25248]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 MiB/s wr, 714 op/s 2024-08-28T20:29:30.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:30 smithi007 ceph-mon[25357]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 MiB/s wr, 714 op/s 2024-08-28T20:29:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 -- 172.21.15.1:0/2612504753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c105690 msgr2=0x7eff2c105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 --2- 172.21.15.1:0/2612504753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c105690 0x7eff2c105b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009900 tx=0x7eff1c02a410 comp rx=0 tx=0).stop 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 -- 172.21.15.1:0/2612504753 shutdown_connections 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 --2- 172.21.15.1:0/2612504753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c1070b0 0x7eff2c10da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 --2- 172.21.15.1:0/2612504753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff2c106710 0x7eff2c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 --2- 172.21.15.1:0/2612504753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c105690 0x7eff2c105b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.991+0000 7eff31400640 1 -- 172.21.15.1:0/2612504753 >> 172.21.15.1:0/2612504753 conn(0x7eff2c100fd0 msgr2=0x7eff2c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.992+0000 7eff31400640 1 -- 172.21.15.1:0/2612504753 shutdown_connections 2024-08-28T20:29:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.992+0000 7eff31400640 1 -- 172.21.15.1:0/2612504753 wait complete. 2024-08-28T20:29:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 Processor -- start 2024-08-28T20:29:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 -- start start 2024-08-28T20:29:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 0x7eff2c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c106710 0x7eff2c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff2c1070b0 0x7eff2c19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1112d0 con 0x7eff2c105690 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c111150 con 0x7eff2c1070b0 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff31400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c111450 con 0x7eff2c106710 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff2a800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 0x7eff2c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff21e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c106710 0x7eff2c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff2a800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 0x7eff2c19bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56644/0 (socket says 172.21.15.1:56644) 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.993+0000 7eff2a800640 1 -- 172.21.15.1:0/2940585094 learned_addr learned my addr 172.21.15.1:0/2940585094 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2b200640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff2c1070b0 0x7eff2c19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2a800640 1 -- 172.21.15.1:0/2940585094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c106710 msgr2=0x7eff2c19c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2a800640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c106710 0x7eff2c19c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2a800640 1 -- 172.21.15.1:0/2940585094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff2c1070b0 msgr2=0x7eff2c19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2a800640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff2c1070b0 0x7eff2c19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2a800640 1 -- 172.21.15.1:0/2940585094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c19d940 con 0x7eff2c105690 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff21e00640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c106710 0x7eff2c19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff2a800640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 0x7eff2c19bf00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff1c006010 tx=0x7eff1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff23e00640 1 -- 172.21.15.1:0/2940585094 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c03f030 con 0x7eff2c105690 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.994+0000 7eff23e00640 1 -- 172.21.15.1:0/2940585094 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c032e50 con 0x7eff2c105690 2024-08-28T20:29:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.995+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2c19dbd0 con 0x7eff2c105690 2024-08-28T20:29:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.995+0000 7eff23e00640 1 -- 172.21.15.1:0/2940585094 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c035070 con 0x7eff2c105690 2024-08-28T20:29:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.995+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2c19dee0 con 0x7eff2c105690 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 Processor -- start 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 -- start start 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff23e00640 1 -- 172.21.15.1:0/2940585094 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7eff1c042030 con 0x7eff2c105690 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a72b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a73cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0a99e5f70 con 0x55b0a96ac4d0 2024-08-28T20:29:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b0a99d5500 con 0x55b0a96cd1b0 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff38464740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b0a99d94b0 con 0x55b0a96a42f0 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff2a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff2b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a72b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff2a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57424/0 (socket says 172.21.15.1:57424) 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff2a800640 1 -- 172.21.15.1:0/309958402 learned_addr learned my addr 172.21.15.1:0/309958402 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.998+0000 7eff21e00640 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a73cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.999+0000 7eff2b200640 1 -- 172.21.15.1:0/309958402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 msgr2=0x55b0a9a731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.999+0000 7eff2b200640 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.999+0000 7eff2b200640 1 -- 172.21.15.1:0/309958402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 msgr2=0x55b0a9a73cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.999+0000 7eff2b200640 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a73cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.999+0000 7eff2b200640 1 -- 172.21.15.1:0/309958402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a998fc10 con 0x55b0a96cd1b0 2024-08-28T20:29:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:30.999+0000 7eff2b200640 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a72b30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff24009f00 tx=0x7eff24011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506005b4deae9e5d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff1b400640 1 -- 172.21.15.1:0/309958402 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24004d20 con 0x55b0a96cd1b0 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff1b400640 1 -- 172.21.15.1:0/309958402 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff24004030 con 0x55b0a96cd1b0 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff1b400640 1 -- 172.21.15.1:0/309958402 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24005260 con 0x55b0a96cd1b0 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff23e00640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7eff100b4b30 0x7eff100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff23e00640 1 -- 172.21.15.1:0/2940585094 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7eff1c105660 con 0x7eff2c105690 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff2a800640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7eff100b4b30 0x7eff100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff38464740 1 -- 172.21.15.1:0/309958402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 msgr2=0x55b0a9a72b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.000+0000 7eff38464740 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a72b30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff24009f00 tx=0x7eff24011810 comp rx=0 tx=0).stop 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 -- 172.21.15.1:0/309958402 shutdown_connections 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a73cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 --2- 172.21.15.1:0/309958402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a72b30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 -- 172.21.15.1:0/309958402 >> 172.21.15.1:0/309958402 conn(0x55b0a96c1300 msgr2=0x55b0a9a6e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff2a800640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7eff100b4b30 0x7eff100b7040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7eff1c03b580 tx=0x7eff1c10b110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 -- 172.21.15.1:0/309958402 shutdown_connections 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 -- 172.21.15.1:0/309958402 wait complete. 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.001+0000 7eff38464740 1 -- start start 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 Processor -- start 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0a990eab0 con 0x55b0a96cd1b0 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b0a997c320 con 0x55b0a96ac4d0 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b0a9a74810 con 0x55b0a96a42f0 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff38464740 10 client.0 _ll_register_callbacks cb 0x55b0a99b5e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff2b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff2b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57428/0 (socket says 172.21.15.1:57428) 2024-08-28T20:29:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff2b200640 1 -- 172.21.15.1:0/3504249049 learned_addr learned my addr 172.21.15.1:0/3504249049 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.002+0000 7eff21e00640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff2b200640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff21e00640 1 -- 172.21.15.1:0/3504249049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 msgr2=0x55b0a9a7c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff21e00640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff21e00640 1 -- 172.21.15.1:0/3504249049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96cd1b0 msgr2=0x55b0a9a7d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff21e00640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff21e00640 1 -- 172.21.15.1:0/3504249049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0a9738790 con 0x55b0a96ac4d0 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff21e00640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7c820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff14012d20 tx=0x7eff1400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9715ec7d645cfb4c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff0fe00640 1 -- 172.21.15.1:0/3504249049 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1400fe60 con 0x55b0a96ac4d0 2024-08-28T20:29:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff0fe00640 1 -- 172.21.15.1:0/3504249049 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7eff14012110 con 0x55b0a96ac4d0 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.003+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff24004030 con 0x55b0a96ac4d0 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.004+0000 7eff0fe00640 1 -- 172.21.15.1:0/3504249049 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7eff14004050 con 0x55b0a96ac4d0 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.004+0000 7eff38464740 10 client.26045 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.004+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b0a97b1620 con 0x55b0a96ac4d0 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.004+0000 7eff0fe00640 1 -- 172.21.15.1:0/3504249049 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff24004030 con 0x55b0a96ac4d0 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.004+0000 7eff0fe00640 1 -- 172.21.15.1:0/3504249049 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7eff14010430 con 0x55b0a96ac4d0 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff38464740 10 client.26045 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff38464740 10 client.26045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff38464740 20 client.26045 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff38464740 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a968bd80 0x55b0a9a899e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff38464740 4 client.26045 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0a99e7ec0 con 0x55b0a968bd80 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff2b200640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a968bd80 0x55b0a9a899e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff2b200640 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a968bd80 0x55b0a9a899e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77c4fae46b86f68 server_cookie=1f133822d14884a5 in_seq=0 out_seq=0 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.005+0000 7eff0fe00640 10 client.26045 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.006+0000 7eff0fe00640 1 -- 172.21.15.1:0/3504249049 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0a99e7ec0 con 0x55b0a968bd80 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.006+0000 7eff0fe00640 10 client.26045 handle_command_reply: tid=0 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.006+0000 7eff38464740 1 client.26045 shutdown 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96ac4d0 msgr2=0x55b0a9a7c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7c820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff14012d20 tx=0x7eff1400f790 comp rx=0 tx=0).stop 2024-08-28T20:29:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 shutdown_connections 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a968bd80 0x55b0a9a899e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7c820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff0fe00640 0 client.26045 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 --2- 172.21.15.1:0/3504249049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 >> 172.21.15.1:0/3504249049 conn(0x55b0a96c1300 msgr2=0x55b0a9a6cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 shutdown_connections 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 1 -- 172.21.15.1:0/3504249049 wait complete. 2024-08-28T20:29:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.007+0000 7eff38464740 20 client.26045 trim_cache size 0 max 16384 2024-08-28T20:29:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.022+0000 7eff38464740 1 Processor -- start 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.022+0000 7eff38464740 1 -- start start 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff38464740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff38464740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff38464740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff38464740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1af830 con 0x55b0a96ac4d0 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff38464740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1ad100 con 0x55b0a96a42f0 2024-08-28T20:29:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff38464740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1aaf50 con 0x55b0a96cd1b0 2024-08-28T20:29:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56658/0 (socket says 172.21.15.1:56658) 2024-08-28T20:29:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 -- 172.21.15.1:0/927812853 learned_addr learned my addr 172.21.15.1:0/927812853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff2b200640 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff2b200640 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 -- 172.21.15.1:0/927812853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96cd1b0 msgr2=0x55b0a9a7d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 -- 172.21.15.1:0/927812853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96a42f0 msgr2=0x55b0a9a7c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff21e00640 1 -- 172.21.15.1:0/927812853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a9a699e0 con 0x55b0a96ac4d0 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.023+0000 7eff2b200640 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.024+0000 7eff21e00640 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7b380 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7eff140059f0 tx=0x7eff14012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790744e6345da285 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.024+0000 7eff1aa00640 1 -- 172.21.15.1:0/927812853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140121d0 con 0x55b0a96ac4d0 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.024+0000 7eff1aa00640 1 -- 172.21.15.1:0/927812853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff14010ac0 con 0x55b0a96ac4d0 2024-08-28T20:29:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.024+0000 7eff1aa00640 1 -- 172.21.15.1:0/927812853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140039b0 con 0x55b0a96ac4d0 2024-08-28T20:29:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 -- 172.21.15.1:0/927812853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 msgr2=0x55b0a9a7b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7b380 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7eff140059f0 tx=0x7eff14012910 comp rx=0 tx=0).stop 2024-08-28T20:29:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 -- 172.21.15.1:0/927812853 shutdown_connections 2024-08-28T20:29:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a7b380 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a7d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 --2- 172.21.15.1:0/927812853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96a42f0 0x55b0a9a7c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 -- 172.21.15.1:0/927812853 >> 172.21.15.1:0/927812853 conn(0x55b0a96c1300 msgr2=0x55b0a9a7c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 -- 172.21.15.1:0/927812853 shutdown_connections 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.025+0000 7eff38464740 1 -- 172.21.15.1:0/927812853 wait complete. 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 -- start start 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 Processor -- start 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a83f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a82c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a83140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1ab5c0 con 0x55b0a96ac4d0 2024-08-28T20:29:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1aca30 con 0x55b0a96cd1b0 2024-08-28T20:29:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1abc90 con 0x55b0a96a42f0 2024-08-28T20:29:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff38464740 10 client.0 _ll_register_callbacks cb 0x7eff14009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.026+0000 7eff2b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a83f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a83f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:57452/0 (socket says 172.21.15.1:57452) 2024-08-28T20:29:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 -- 172.21.15.1:0/4138866941 learned_addr learned my addr 172.21.15.1:0/4138866941 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff21e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a82c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a83140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 -- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 msgr2=0x55b0a9a83140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a83140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 -- 172.21.15.1:0/4138866941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 msgr2=0x55b0a9a82c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a82c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 -- 172.21.15.1:0/4138866941 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0a9a838b0 con 0x55b0a96a42f0 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff21e00640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a82c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff2b200640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a83f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff24005c10 tx=0x7eff24011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18963e0cfd2ef1a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff0fe00640 1 -- 172.21.15.1:0/4138866941 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2401e040 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff14010ac0 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.027+0000 7eff0fe00640 1 -- 172.21.15.1:0/4138866941 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7eff24031040 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.028+0000 7eff0fe00640 1 -- 172.21.15.1:0/4138866941 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7eff24003fe0 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.028+0000 7eff38464740 10 client.26023 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.028+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b0a9af43a0 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.028+0000 7eff0fe00640 1 -- 172.21.15.1:0/4138866941 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff14010ac0 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.028+0000 7eff0fe00640 1 -- 172.21.15.1:0/4138866941 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7eff24024040 con 0x55b0a96a42f0 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff38464740 10 client.26023 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff38464740 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff38464740 20 client.26023 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff38464740 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a96611c0 0x55b0a9af6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff38464740 4 client.26023 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:29:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0a99e3960 con 0x55b0a96611c0 2024-08-28T20:29:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff21e00640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a96611c0 0x55b0a9af6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff21e00640 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a96611c0 0x55b0a9af6c30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29a735869ab9fa67 server_cookie=9ddf1a26cce4c3f in_seq=0 out_seq=0 2024-08-28T20:29:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:31.029+0000 7eff0fe00640 10 client.26023 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:32 smithi001 ceph-mon[20984]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 MiB/s wr, 923 op/s 2024-08-28T20:29:32.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:32 smithi121 ceph-mon[25248]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 MiB/s wr, 923 op/s 2024-08-28T20:29:32.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:32 smithi007 ceph-mon[25357]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 MiB/s wr, 923 op/s 2024-08-28T20:29:33.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 665.0 s, 19.8 tps, lat 1242.291 ms stddev 607.069 2024-08-28T20:29:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:34 smithi001 ceph-mon[20984]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 944 op/s 2024-08-28T20:29:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:34 smithi121 ceph-mon[25248]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 944 op/s 2024-08-28T20:29:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:34 smithi007 ceph-mon[25357]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 944 op/s 2024-08-28T20:29:35.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.718+0000 7eff0fe00640 1 -- 172.21.15.1:0/4138866941 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0a99e3960 con 0x55b0a96611c0 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.718+0000 7eff0fe00640 10 client.26023 handle_command_reply: tid=0 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 client.26023 shutdown 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 msgr2=0x55b0a9a83f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a83f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff24005c10 tx=0x7eff24011810 comp rx=0 tx=0).stop 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 shutdown_connections 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55b0a96611c0 0x55b0a9af6c30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0a96ac4d0 0x55b0a9a82c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0a96cd1b0 0x55b0a9a83140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 --2- 172.21.15.1:0/4138866941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0a96a42f0 0x55b0a9a83f40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff0fe00640 0 client.26023 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.719+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 >> 172.21.15.1:0/4138866941 conn(0x55b0a96c1300 msgr2=0x55b0a9a76c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.720+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 shutdown_connections 2024-08-28T20:29:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.720+0000 7eff38464740 1 -- 172.21.15.1:0/4138866941 wait complete. 2024-08-28T20:29:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.721+0000 7eff38464740 20 client.26023 trim_cache size 0 max 16384 2024-08-28T20:29:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:29:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:29:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:29:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:29:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.722+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7eff100b4b30 msgr2=0x7eff100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.722+0000 7eff31400640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7eff100b4b30 0x7eff100b7040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7eff1c03b580 tx=0x7eff1c10b110 comp rx=0 tx=0).stop 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.722+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 msgr2=0x7eff2c19bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.722+0000 7eff31400640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 0x7eff2c19bf00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff1c006010 tx=0x7eff1c0042f0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.723+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 shutdown_connections 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.723+0000 7eff31400640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7eff100b4b30 0x7eff100b7040 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.723+0000 7eff31400640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff2c1070b0 0x7eff2c19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.723+0000 7eff31400640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff2c106710 0x7eff2c19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.723+0000 7eff31400640 1 --2- 172.21.15.1:0/2940585094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff2c105690 0x7eff2c19bf00 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff1c006010 tx=0x7eff1c0042f0 comp rx=0 tx=0).stop 2024-08-28T20:29:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.723+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 >> 172.21.15.1:0/2940585094 conn(0x7eff2c100fd0 msgr2=0x7eff2c109a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:35.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.724+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 shutdown_connections 2024-08-28T20:29:35.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:35.724+0000 7eff31400640 1 -- 172.21.15.1:0/2940585094 wait complete. 2024-08-28T20:29:36.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:36 smithi001 ceph-mon[20984]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.26k op/s 2024-08-28T20:29:36.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:36 smithi121 ceph-mon[25248]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.26k op/s 2024-08-28T20:29:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:36 smithi007 ceph-mon[25357]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.26k op/s 2024-08-28T20:29:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:37 smithi001 ceph-mon[20984]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 MiB/s wr, 1.13k op/s 2024-08-28T20:29:37.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:37 smithi001 ceph-mon[20984]: Health check update: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:29:37.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:37 smithi121 ceph-mon[25248]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 MiB/s wr, 1.13k op/s 2024-08-28T20:29:37.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:37 smithi121 ceph-mon[25248]: Health check update: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:29:37.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:37 smithi007 ceph-mon[25357]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 MiB/s wr, 1.13k op/s 2024-08-28T20:29:37.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:37 smithi007 ceph-mon[25357]: Health check update: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:29:38.465 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:38 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:29:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:38 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:29:38.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:38 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:29:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 670.0 s, 903.7 tps, lat 204.751 ms stddev 926.188 2024-08-28T20:29:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 1.15k op/s 2024-08-28T20:29:39.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:29:39.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:29:39.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.729 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 1.15k op/s 2024-08-28T20:29:39.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:29:39.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:29:39.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:39.815 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 1.15k op/s 2024-08-28T20:29:39.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:29:39.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:29:39.816 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:29:41.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:41 smithi001 ceph-mon[20984]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 32 MiB/s wr, 1.07k op/s 2024-08-28T20:29:41.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:41 smithi121 ceph-mon[25248]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 32 MiB/s wr, 1.07k op/s 2024-08-28T20:29:42.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:41 smithi007 ceph-mon[25357]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 32 MiB/s wr, 1.07k op/s 2024-08-28T20:29:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 675.0 s, 1689.0 tps, lat 59.469 ms stddev 79.990 2024-08-28T20:29:43.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:43 smithi121 ceph-mon[25248]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 24 MiB/s wr, 796 op/s 2024-08-28T20:29:43.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:43 smithi001 ceph-mon[20984]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 24 MiB/s wr, 796 op/s 2024-08-28T20:29:44.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:43 smithi007 ceph-mon[25357]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 24 MiB/s wr, 796 op/s 2024-08-28T20:29:44.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:44 smithi121 ceph-mon[25248]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:29:44.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:44 smithi001 ceph-mon[20984]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:29:45.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:44 smithi007 ceph-mon[25357]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:29:45.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:45 smithi001 ceph-mon[20984]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 801 op/s 2024-08-28T20:29:45.981 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:45 smithi121 ceph-mon[25248]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 801 op/s 2024-08-28T20:29:46.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:45 smithi007 ceph-mon[25357]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 801 op/s 2024-08-28T20:29:47.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:47 smithi001 ceph-mon[20984]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.0 MiB/s wr, 514 op/s 2024-08-28T20:29:47.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:47 smithi121 ceph-mon[25248]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.0 MiB/s wr, 514 op/s 2024-08-28T20:29:48.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:47 smithi007 ceph-mon[25357]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.0 MiB/s wr, 514 op/s 2024-08-28T20:29:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 680.0 s, 1879.4 tps, lat 52.938 ms stddev 61.479 2024-08-28T20:29:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 -- 172.21.15.1:0/2940699422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504076e90 msgr2=0x7f3504075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 --2- 172.21.15.1:0/2940699422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504076e90 0x7f3504075550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f802a3f0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 -- 172.21.15.1:0/2940699422 shutdown_connections 2024-08-28T20:29:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 --2- 172.21.15.1:0/2940699422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3504075a90 0x7f3504075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 --2- 172.21.15.1:0/2940699422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 0x7f350410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 --2- 172.21.15.1:0/2940699422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504076e90 0x7f3504075550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.035+0000 7f350a000640 1 -- 172.21.15.1:0/2940699422 >> 172.21.15.1:0/2940699422 conn(0x7f35040fec50 msgr2=0x7f3504101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.036+0000 7f350a000640 1 -- 172.21.15.1:0/2940699422 shutdown_connections 2024-08-28T20:29:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.036+0000 7f350a000640 1 -- 172.21.15.1:0/2940699422 wait complete. 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 Processor -- start 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 -- start start 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504075a90 0x7f350419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3504076e90 0x7f350419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 0x7f350419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3504111100 con 0x7f3504076e90 2024-08-28T20:29:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3504110f80 con 0x7f350410b2c0 2024-08-28T20:29:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f350a000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3504111280 con 0x7f3504075a90 2024-08-28T20:29:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f3508c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504075a90 0x7f350419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f3503e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3504076e90 0x7f350419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f3509600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 0x7f350419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f3508c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504075a90 0x7f350419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35502/0 (socket says 172.21.15.1:35502) 2024-08-28T20:29:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.037+0000 7f3508c00640 1 -- 172.21.15.1:0/4235357485 learned_addr learned my addr 172.21.15.1:0/4235357485 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.038+0000 7f3509600640 1 -- 172.21.15.1:0/4235357485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504075a90 msgr2=0x7f350419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.038+0000 7f3509600640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504075a90 0x7f350419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.038+0000 7f3509600640 1 -- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3504076e90 msgr2=0x7f350419c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.038+0000 7f3509600640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3504076e90 0x7f350419c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.038+0000 7f3509600640 1 -- 172.21.15.1:0/4235357485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350419d730 con 0x7f350410b2c0 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.039+0000 7f3509600640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 0x7f350419cf10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009fd0 tx=0x7f34fc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.039+0000 7f3501600640 1 -- 172.21.15.1:0/4235357485 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00ce20 con 0x7f350410b2c0 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.039+0000 7f3501600640 1 -- 172.21.15.1:0/4235357485 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34fc005020 con 0x7f350410b2c0 2024-08-28T20:29:49.042 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.039+0000 7f3501600640 1 -- 172.21.15.1:0/4235357485 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc010690 con 0x7f350410b2c0 2024-08-28T20:29:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.040+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350419da20 con 0x7f350410b2c0 2024-08-28T20:29:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.040+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35041a4110 con 0x7f350410b2c0 2024-08-28T20:29:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.044+0000 7f3501600640 1 -- 172.21.15.1:0/4235357485 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f34fc0054d0 con 0x7f350410b2c0 2024-08-28T20:29:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 Processor -- start 2024-08-28T20:29:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 -- start start 2024-08-28T20:29:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 0x55e07be9dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07be9e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07bad74d0 0x55e07be9ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e07be10f70 con 0x55e07baf81b0 2024-08-28T20:29:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e07be00500 con 0x55e07bad74d0 2024-08-28T20:29:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.045+0000 7f3512645740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e07be044b0 con 0x55e07bacf2f0 2024-08-28T20:29:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.046+0000 7f3503e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 0x55e07be9dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.046+0000 7f3503e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 0x55e07be9dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36174/0 (socket says 172.21.15.1:36174) 2024-08-28T20:29:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.046+0000 7f3503e00640 1 -- 172.21.15.1:0/1964017535 learned_addr learned my addr 172.21.15.1:0/1964017535 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.047+0000 7f3503e00640 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07bad74d0 0x55e07be9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.047+0000 7f3508c00640 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07be9e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.048+0000 7f3503e00640 1 -- 172.21.15.1:0/1964017535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 msgr2=0x55e07be9e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.048+0000 7f3503e00640 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07be9e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.048+0000 7f3503e00640 1 -- 172.21.15.1:0/1964017535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07bad74d0 msgr2=0x55e07be9ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.048+0000 7f3503e00640 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07bad74d0 0x55e07be9ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.048+0000 7f3503e00640 1 -- 172.21.15.1:0/1964017535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e07bdbac10 con 0x55e07baf81b0 2024-08-28T20:29:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.049+0000 7f3508c00640 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07be9e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.049+0000 7f3501600640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34ec0b4cf0 0x7f34ec0b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.050+0000 7f3503e00640 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 0x55e07be9dd40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009f90 tx=0x7f34f00097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fd77391747f3f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.050+0000 7f34f5c00640 1 -- 172.21.15.1:0/1964017535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0005220 con 0x55e07baf81b0 2024-08-28T20:29:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.050+0000 7f3501600640 1 -- 172.21.15.1:0/4235357485 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f34fc0e5770 con 0x7f350410b2c0 2024-08-28T20:29:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.050+0000 7f34f5c00640 1 -- 172.21.15.1:0/1964017535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f00047a0 con 0x55e07baf81b0 2024-08-28T20:29:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.050+0000 7f34f5c00640 1 -- 172.21.15.1:0/1964017535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0010650 con 0x55e07baf81b0 2024-08-28T20:29:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.050+0000 7f3508c00640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34ec0b4cf0 0x7f34ec0b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.051+0000 7f3512645740 1 -- 172.21.15.1:0/1964017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 msgr2=0x55e07be9dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.051+0000 7f3512645740 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 0x55e07be9dd40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009f90 tx=0x7f34f00097a0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.051+0000 7f3508c00640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34ec0b4cf0 0x7f34ec0b7200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005f70 tx=0x7f34f80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.051+0000 7f3512645740 1 -- 172.21.15.1:0/1964017535 shutdown_connections 2024-08-28T20:29:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.051+0000 7f3512645740 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07bad74d0 0x55e07be9ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.052+0000 7f3512645740 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07be9e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.052+0000 7f3512645740 1 --2- 172.21.15.1:0/1964017535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07baf81b0 0x55e07be9dd40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.052+0000 7f3512645740 1 -- 172.21.15.1:0/1964017535 >> 172.21.15.1:0/1964017535 conn(0x55e07baec300 msgr2=0x55e07be997d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.052+0000 7f3512645740 1 -- 172.21.15.1:0/1964017535 shutdown_connections 2024-08-28T20:29:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.052+0000 7f3512645740 1 -- 172.21.15.1:0/1964017535 wait complete. 2024-08-28T20:29:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.052+0000 7f3512645740 1 -- start start 2024-08-28T20:29:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.053+0000 7f3512645740 1 Processor -- start 2024-08-28T20:29:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.054+0000 7f3512645740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07bea7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.054+0000 7f3512645740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07bea7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.054+0000 7f3512645740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07bea8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.054+0000 7f3512645740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e07bd39ab0 con 0x55e07bacf2f0 2024-08-28T20:29:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3512645740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e07bda7320 con 0x55e07baf81b0 2024-08-28T20:29:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3512645740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e07be9fa20 con 0x55e07bad74d0 2024-08-28T20:29:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3512645740 10 client.0 _ll_register_callbacks cb 0x55e07bde0e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3503e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07bea7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3503e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07bea7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35512/0 (socket says 172.21.15.1:35512) 2024-08-28T20:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3503e00640 1 -- 172.21.15.1:0/2919503625 learned_addr learned my addr 172.21.15.1:0/2919503625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.055+0000 7f3509600640 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07bea8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f3503e00640 1 -- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 msgr2=0x55e07bea8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f3503e00640 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07bea8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f3503e00640 1 -- 172.21.15.1:0/2919503625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 msgr2=0x55e07bea7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f3503e00640 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07bea7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f3503e00640 1 -- 172.21.15.1:0/2919503625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e07bb63790 con 0x55e07bad74d0 2024-08-28T20:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f3503e00640 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07bea7af0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f34f0005290 tx=0x7f34f00052c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b0e3cd2fb3ee194 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.056+0000 7f34ea000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f34ea000640 1 -- 172.21.15.1:0/2919503625 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0010430 con 0x55e07bad74d0 2024-08-28T20:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f34ea000640 1 -- 172.21.15.1:0/2919503625 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f34f00105d0 con 0x55e07bad74d0 2024-08-28T20:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f00047a0 con 0x55e07bad74d0 2024-08-28T20:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f34ea000640 1 -- 172.21.15.1:0/2919503625 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f34f00107d0 con 0x55e07bad74d0 2024-08-28T20:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f3512645740 10 client.26032 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e07bbdc620 con 0x55e07bad74d0 2024-08-28T20:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f34ea000640 1 -- 172.21.15.1:0/2919503625 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f00047a0 con 0x55e07bad74d0 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.057+0000 7f34ea000640 1 -- 172.21.15.1:0/2919503625 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7f34f002f050 con 0x55e07bad74d0 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3512645740 10 client.26032 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3512645740 10 client.26032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3512645740 20 client.26032 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3512645740 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07bab6d80 0x55e07beb49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3512645740 4 client.26032 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e07be12ec0 con 0x55e07bab6d80 2024-08-28T20:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.058+0000 7f3508c00640 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07bab6d80 0x55e07beb49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.059+0000 7f3508c00640 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07bab6d80 0x55e07beb49c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d1cb8c3dd02363 server_cookie=1e74f506a731c9eb in_seq=0 out_seq=0 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.059+0000 7f34ea000640 10 client.26032 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.059+0000 7f34ea000640 1 -- 172.21.15.1:0/2919503625 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e07be12ec0 con 0x55e07bab6d80 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.059+0000 7f34ea000640 10 client.26032 handle_command_reply: tid=0 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.059+0000 7f3512645740 1 client.26032 shutdown 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.060+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 msgr2=0x55e07bea7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.060+0000 7f3512645740 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07bea7af0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f34f0005290 tx=0x7f34f00052c0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 shutdown_connections 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07bab6d80 0x55e07beb49c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07bea8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07bea7af0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 --2- 172.21.15.1:0/2919503625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07bea7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 >> 172.21.15.1:0/2919503625 conn(0x55e07baec300 msgr2=0x55e07be97d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f34ea000640 0 client.26032 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 shutdown_connections 2024-08-28T20:29:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.061+0000 7f3512645740 1 -- 172.21.15.1:0/2919503625 wait complete. 2024-08-28T20:29:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.062+0000 7f3512645740 20 client.26032 trim_cache size 0 max 16384 2024-08-28T20:29:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 Processor -- start 2024-08-28T20:29:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 -- start start 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07be98d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07beaf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07be992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f35041af4e0 con 0x55e07bacf2f0 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35041acdb0 con 0x55e07baf81b0 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.107+0000 7f3512645740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35041aac00 con 0x55e07bad74d0 2024-08-28T20:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07be992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07be992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55864/0 (socket says 172.21.15.1:55864) 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 -- 172.21.15.1:0/3520193759 learned_addr learned my addr 172.21.15.1:0/3520193759 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3508c00640 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07be98d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 -- 172.21.15.1:0/3520193759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 msgr2=0x55e07beaf540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07beaf540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 -- 172.21.15.1:0/3520193759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 msgr2=0x55e07be98d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07be98d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3509600640 1 -- 172.21.15.1:0/3520193759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e07be99800 con 0x55e07baf81b0 2024-08-28T20:29:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.108+0000 7f3508c00640 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07be98d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:29:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.109+0000 7f3509600640 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07be992c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0a8160 tx=0x7f34fc0ac8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ace92ac34c56afc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.110+0000 7f34f5200640 1 -- 172.21.15.1:0/3520193759 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0b5450 con 0x55e07baf81b0 2024-08-28T20:29:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.110+0000 7f34f5200640 1 -- 172.21.15.1:0/3520193759 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34fc0051d0 con 0x55e07baf81b0 2024-08-28T20:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.110+0000 7f34f5200640 1 -- 172.21.15.1:0/3520193759 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc097420 con 0x55e07baf81b0 2024-08-28T20:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.111+0000 7f3512645740 1 -- 172.21.15.1:0/3520193759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 msgr2=0x55e07be992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.111+0000 7f3512645740 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07be992c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0a8160 tx=0x7f34fc0ac8f0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.111+0000 7f3512645740 1 -- 172.21.15.1:0/3520193759 shutdown_connections 2024-08-28T20:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.111+0000 7f3512645740 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07be992c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.111+0000 7f3512645740 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bad74d0 0x55e07beaf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.111+0000 7f3512645740 1 --2- 172.21.15.1:0/3520193759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bacf2f0 0x55e07be98d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.112+0000 7f3512645740 1 -- 172.21.15.1:0/3520193759 >> 172.21.15.1:0/3520193759 conn(0x55e07baec300 msgr2=0x55e07be9eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.112+0000 7f3512645740 1 -- 172.21.15.1:0/3520193759 shutdown_connections 2024-08-28T20:29:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.112+0000 7f3512645740 1 -- 172.21.15.1:0/3520193759 wait complete. 2024-08-28T20:29:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.113+0000 7f3512645740 1 -- start start 2024-08-28T20:29:49.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.113+0000 7f3512645740 1 Processor -- start 2024-08-28T20:29:49.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07beaf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bad74d0 0x55e07beaddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07beae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ab270 con 0x55e07bad74d0 2024-08-28T20:29:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ac6e0 con 0x55e07baf81b0 2024-08-28T20:29:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35041ab940 con 0x55e07bacf2f0 2024-08-28T20:29:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.114+0000 7f3512645740 10 client.0 _ll_register_callbacks cb 0x7f34f0009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.115+0000 7f3509600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07beae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.115+0000 7f3509600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07beae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55872/0 (socket says 172.21.15.1:55872) 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.115+0000 7f3509600640 1 -- 172.21.15.1:0/2462050504 learned_addr learned my addr 172.21.15.1:0/2462050504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.115+0000 7f3508c00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07beaf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.115+0000 7f3503e00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bad74d0 0x55e07beaddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f3508c00640 1 -- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 msgr2=0x55e07beae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f3508c00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07beae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f3508c00640 1 -- 172.21.15.1:0/2462050504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bad74d0 msgr2=0x55e07beaddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f3508c00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bad74d0 0x55e07beaddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f3508c00640 1 -- 172.21.15.1:0/2462050504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e07beae940 con 0x55e07bacf2f0 2024-08-28T20:29:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f34ea000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:29:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.116+0000 7f3508c00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07beaf100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f34f8004770 tx=0x7f34f8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ddae588a4d63eb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:29:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.117+0000 7f34ea000640 1 -- 172.21.15.1:0/2462050504 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f80315a0 con 0x55e07bacf2f0 2024-08-28T20:29:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.117+0000 7f34ea000640 1 -- 172.21.15.1:0/2462050504 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f34f8051070 con 0x55e07bacf2f0 2024-08-28T20:29:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.117+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34fc0051d0 con 0x55e07bacf2f0 2024-08-28T20:29:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.118+0000 7f34ea000640 1 -- 172.21.15.1:0/2462050504 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f34f80315a0 con 0x55e07bacf2f0 2024-08-28T20:29:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.118+0000 7f3512645740 10 client.26035 fetch_fsmap learned FSMap version 48 2024-08-28T20:29:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.118+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e07bead760 con 0x55e07bacf2f0 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.120+0000 7f34ea000640 1 -- 172.21.15.1:0/2462050504 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f8057070 con 0x55e07bacf2f0 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.120+0000 7f34ea000640 1 -- 172.21.15.1:0/2462050504 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8354+0+0 (secure 0 0 0) 0x7f34f805c6e0 con 0x55e07bacf2f0 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.120+0000 7f3512645740 10 client.26035 fetch_fsmap finished waiting for FSMap version 48 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.120+0000 7f3512645740 10 client.26035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.120+0000 7f3512645740 20 client.26035 populate_metadata read hostname 'smithi001' 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.120+0000 7f3512645740 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07ba8c1c0 0x55e07bf2a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:29:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.121+0000 7f3512645740 4 client.26035 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:29:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.121+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f34fc0051d0 con 0x55e07ba8c1c0 2024-08-28T20:29:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.121+0000 7f3503e00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07ba8c1c0 0x55e07bf2a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:29:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.123+0000 7f3503e00640 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07ba8c1c0 0x55e07bf2a440 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44ea0de030c2f009 server_cookie=a167735a97f15a69 in_seq=0 out_seq=0 2024-08-28T20:29:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.123+0000 7f34ea000640 10 client.26035 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f34ea000640 1 -- 172.21.15.1:0/2462050504 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f34fc0051d0 con 0x55e07ba8c1c0 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f34ea000640 10 client.26035 handle_command_reply: tid=0 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 client.26035 shutdown 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 msgr2=0x55e07beaf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07beaf100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f34f8004770 tx=0x7f34f8009260 comp rx=0 tx=0).stop 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 shutdown_connections 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e07ba8c1c0 0x55e07bf2a440 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e07bad74d0 0x55e07beaddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e07baf81b0 0x55e07beae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f34ea000640 0 client.26035 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 --2- 172.21.15.1:0/2462050504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e07bacf2f0 0x55e07beaf100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.181+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 >> 172.21.15.1:0/2462050504 conn(0x55e07baec300 msgr2=0x55e07be9eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 shutdown_connections 2024-08-28T20:29:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f3512645740 1 -- 172.21.15.1:0/2462050504 wait complete. 2024-08-28T20:29:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f3512645740 20 client.26035 trim_cache size 0 max 16384 2024-08-28T20:29:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:29:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:29:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:29:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34ec0b4cf0 msgr2=0x7f34ec0b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34ec0b4cf0 0x7f34ec0b7200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005f70 tx=0x7f34f80314a0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 msgr2=0x7f350419cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 0x7f350419cf10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009fd0 tx=0x7f34fc00ef10 comp rx=0 tx=0).stop 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 shutdown_connections 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f34ec0b4cf0 0x7f34ec0b7200 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3504076e90 0x7f350419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350410b2c0 0x7f350419cf10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.182+0000 7f350a000640 1 --2- 172.21.15.1:0/4235357485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3504075a90 0x7f350419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:29:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.183+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 >> 172.21.15.1:0/4235357485 conn(0x7f35040fec50 msgr2=0x7f35041072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:29:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.183+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 shutdown_connections 2024-08-28T20:29:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:29:49.183+0000 7f350a000640 1 -- 172.21.15.1:0/4235357485 wait complete. 2024-08-28T20:29:49.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:49 smithi001 ceph-mon[20984]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 603 op/s 2024-08-28T20:29:49.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:49 smithi121 ceph-mon[25248]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 603 op/s 2024-08-28T20:29:50.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:49 smithi007 ceph-mon[25357]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 603 op/s 2024-08-28T20:29:51.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:51 smithi001 ceph-mon[20984]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 671 op/s 2024-08-28T20:29:51.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:51 smithi121 ceph-mon[25248]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 671 op/s 2024-08-28T20:29:52.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:51 smithi007 ceph-mon[25357]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 671 op/s 2024-08-28T20:29:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 685.0 s, 1714.0 tps, lat 58.627 ms stddev 71.661 2024-08-28T20:29:53.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:53 smithi001 ceph-mon[20984]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 10 MiB/s wr, 625 op/s 2024-08-28T20:29:53.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:53 smithi121 ceph-mon[25248]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 10 MiB/s wr, 625 op/s 2024-08-28T20:29:54.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:53 smithi007 ceph-mon[25357]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 10 MiB/s wr, 625 op/s 2024-08-28T20:29:55.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:55 smithi001 ceph-mon[20984]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-08-28T20:29:55.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:55 smithi121 ceph-mon[25248]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-08-28T20:29:56.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:55 smithi007 ceph-mon[25357]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-08-28T20:29:56.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:56 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:29:56.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:56 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:29:57.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:56 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:29:57.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:57 smithi001 ceph-mon[20984]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 MiB/s wr, 640 op/s 2024-08-28T20:29:57.980 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:57 smithi121 ceph-mon[25248]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 MiB/s wr, 640 op/s 2024-08-28T20:29:58.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:57 smithi007 ceph-mon[25357]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 MiB/s wr, 640 op/s 2024-08-28T20:29:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 690.0 s, 1401.2 tps, lat 70.223 ms stddev 80.235 2024-08-28T20:30:00.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:29:59 smithi007 ceph-mon[25357]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 MiB/s wr, 659 op/s 2024-08-28T20:30:00.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:29:59 smithi001 ceph-mon[20984]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 MiB/s wr, 659 op/s 2024-08-28T20:30:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:29:59 smithi121 ceph-mon[25248]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 MiB/s wr, 659 op/s 2024-08-28T20:30:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:00 smithi007 ceph-mon[25357]: Health detail: HEALTH_WARN 4 OSD(s) experiencing slow operations in BlueStore 2024-08-28T20:30:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:00 smithi007 ceph-mon[25357]: [WRN] BLUESTORE_SLOW_OP_ALERT: 4 OSD(s) experiencing slow operations in BlueStore 2024-08-28T20:30:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:00 smithi007 ceph-mon[25357]: osd.2 observed slow operation indications in BlueStore 2024-08-28T20:30:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:00 smithi007 ceph-mon[25357]: osd.5 observed slow operation indications in BlueStore 2024-08-28T20:30:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:00 smithi007 ceph-mon[25357]: osd.8 observed slow operation indications in BlueStore 2024-08-28T20:30:01.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:00 smithi007 ceph-mon[25357]: osd.11 observed slow operation indications in BlueStore 2024-08-28T20:30:01.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:00 smithi001 ceph-mon[20984]: Health detail: HEALTH_WARN 4 OSD(s) experiencing slow operations in BlueStore 2024-08-28T20:30:01.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:00 smithi001 ceph-mon[20984]: [WRN] BLUESTORE_SLOW_OP_ALERT: 4 OSD(s) experiencing slow operations in BlueStore 2024-08-28T20:30:01.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:00 smithi001 ceph-mon[20984]: osd.2 observed slow operation indications in BlueStore 2024-08-28T20:30:01.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:00 smithi001 ceph-mon[20984]: osd.5 observed slow operation indications in BlueStore 2024-08-28T20:30:01.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:00 smithi001 ceph-mon[20984]: osd.8 observed slow operation indications in BlueStore 2024-08-28T20:30:01.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:00 smithi001 ceph-mon[20984]: osd.11 observed slow operation indications in BlueStore 2024-08-28T20:30:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:00 smithi121 ceph-mon[25248]: Health detail: HEALTH_WARN 4 OSD(s) experiencing slow operations in BlueStore 2024-08-28T20:30:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:00 smithi121 ceph-mon[25248]: [WRN] BLUESTORE_SLOW_OP_ALERT: 4 OSD(s) experiencing slow operations in BlueStore 2024-08-28T20:30:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:00 smithi121 ceph-mon[25248]: osd.2 observed slow operation indications in BlueStore 2024-08-28T20:30:01.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:00 smithi121 ceph-mon[25248]: osd.5 observed slow operation indications in BlueStore 2024-08-28T20:30:01.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:00 smithi121 ceph-mon[25248]: osd.8 observed slow operation indications in BlueStore 2024-08-28T20:30:01.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:00 smithi121 ceph-mon[25248]: osd.11 observed slow operation indications in BlueStore 2024-08-28T20:30:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:01 smithi007 ceph-mon[25357]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-08-28T20:30:02.130 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:01 smithi001 ceph-mon[20984]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-08-28T20:30:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:01 smithi121 ceph-mon[25248]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-08-28T20:30:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.478+0000 7f0121600640 1 -- 172.21.15.1:0/351273241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c104c90 msgr2=0x7f011c10b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.478+0000 7f0121600640 1 --2- 172.21.15.1:0/351273241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c104c90 0x7f011c10b630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0114009be0 tx=0x7f011402a6c0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 -- 172.21.15.1:0/351273241 shutdown_connections 2024-08-28T20:30:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 --2- 172.21.15.1:0/351273241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f011c1042f0 0x7f011c104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 --2- 172.21.15.1:0/351273241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c104c90 0x7f011c10b630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 --2- 172.21.15.1:0/351273241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011c103270 0x7f011c1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 -- 172.21.15.1:0/351273241 >> 172.21.15.1:0/351273241 conn(0x7f011c0febd0 msgr2=0x7f011c101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 -- 172.21.15.1:0/351273241 shutdown_connections 2024-08-28T20:30:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.479+0000 7f0121600640 1 -- 172.21.15.1:0/351273241 wait complete. 2024-08-28T20:30:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.481+0000 7f0121600640 1 Processor -- start 2024-08-28T20:30:02.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.482+0000 7f0121600640 1 -- start start 2024-08-28T20:30:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.482+0000 7f0121600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 0x7f011c076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f0121600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f011c1042f0 0x7f011c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f0121600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011c104c90 0x7f011c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f0121600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f011c10eef0 con 0x7f011c1042f0 2024-08-28T20:30:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f0121600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f011c10ed70 con 0x7f011c104c90 2024-08-28T20:30:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f0121600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f011c10f070 con 0x7f011c103270 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f011be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 0x7f011c076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f011be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 0x7f011c076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53974/0 (socket says 172.21.15.1:53974) 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f011be00640 1 -- 172.21.15.1:0/3692137000 learned_addr learned my addr 172.21.15.1:0/3692137000 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.483+0000 7f0120c00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011c104c90 0x7f011c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011b400640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f011c1042f0 0x7f011c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011be00640 1 -- 172.21.15.1:0/3692137000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011c104c90 msgr2=0x7f011c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011be00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011c104c90 0x7f011c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011be00640 1 -- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f011c1042f0 msgr2=0x7f011c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011be00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f011c1042f0 0x7f011c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011be00640 1 -- 172.21.15.1:0/3692137000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c076090 con 0x7f011c103270 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.484+0000 7f011be00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 0x7f011c076bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f010800d950 tx=0x7f010800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.485+0000 7f0118c00640 1 -- 172.21.15.1:0/3692137000 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108017070 con 0x7f011c103270 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.485+0000 7f0118c00640 1 -- 172.21.15.1:0/3692137000 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0108009c30 con 0x7f011c103270 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.485+0000 7f0118c00640 1 -- 172.21.15.1:0/3692137000 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010800f620 con 0x7f011c103270 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.485+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c1a3b60 con 0x7f011c103270 2024-08-28T20:30:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.485+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c1a3f70 con 0x7f011c103270 2024-08-28T20:30:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.491+0000 7f0129e17740 1 Processor -- start 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.491+0000 7f0129e17740 1 -- start start 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.492+0000 7f0129e17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe59d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.492+0000 7f0129e17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe5a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.492+0000 7f0129e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.492+0000 7f0129e17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5617ebdccf70 con 0x5617ebab41b0 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.492+0000 7f0129e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617ebdbc500 con 0x5617eba934d0 2024-08-28T20:30:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.492+0000 7f0129e17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5617ebdc04b0 con 0x5617eba8b2f0 2024-08-28T20:30:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44098/0 (socket says 172.21.15.1:44098) 2024-08-28T20:30:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 -- 172.21.15.1:0/3295888943 learned_addr learned my addr 172.21.15.1:0/3295888943 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 -- 172.21.15.1:0/3295888943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 msgr2=0x5617ebe5a3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:30:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe5a3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 -- 172.21.15.1:0/3295888943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 msgr2=0x5617ebe59d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe59d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.493+0000 7f011b400640 1 -- 172.21.15.1:0/3295888943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ebd76c10 con 0x5617eba934d0 2024-08-28T20:30:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.494+0000 7f011b400640 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5af00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f010c00bb10 tx=0x7f010c00d340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8573d7fe5b05bdda server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.495+0000 7f0111200640 1 -- 172.21.15.1:0/3295888943 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c017420 con 0x5617eba934d0 2024-08-28T20:30:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.495+0000 7f0118c00640 1 -- 172.21.15.1:0/3692137000 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f0108010460 con 0x7f011c103270 2024-08-28T20:30:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.495+0000 7f0111200640 1 -- 172.21.15.1:0/3295888943 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010c017a70 con 0x5617eba934d0 2024-08-28T20:30:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.495+0000 7f0111200640 1 -- 172.21.15.1:0/3295888943 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c00fac0 con 0x5617eba934d0 2024-08-28T20:30:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 -- 172.21.15.1:0/3295888943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 msgr2=0x5617ebe5af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5af00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f010c00bb10 tx=0x7f010c00d340 comp rx=0 tx=0).stop 2024-08-28T20:30:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 -- 172.21.15.1:0/3295888943 shutdown_connections 2024-08-28T20:30:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5af00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe5a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 --2- 172.21.15.1:0/3295888943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe59d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.496+0000 7f0129e17740 1 -- 172.21.15.1:0/3295888943 >> 172.21.15.1:0/3295888943 conn(0x5617ebaa8300 msgr2=0x5617ebe557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.497+0000 7f0129e17740 1 -- 172.21.15.1:0/3295888943 shutdown_connections 2024-08-28T20:30:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.497+0000 7f0129e17740 1 -- 172.21.15.1:0/3295888943 wait complete. 2024-08-28T20:30:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.497+0000 7f0129e17740 1 -- start start 2024-08-28T20:30:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.498+0000 7f0118c00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01000b4b00 0x7f01000b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.498+0000 7f0129e17740 1 Processor -- start 2024-08-28T20:30:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.498+0000 7f0118c00640 1 -- 172.21.15.1:0/3692137000 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f01080e4ea0 con 0x7f011c103270 2024-08-28T20:30:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.498+0000 7f0120c00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01000b4b00 0x7f01000b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.500+0000 7f0129e17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe63480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.500+0000 7f0129e17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 0x5617ebe63b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.500+0000 7f0129e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe64690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.500+0000 7f0129e17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5617ebcf5ab0 con 0x5617eba934d0 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.500+0000 7f0129e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617ebd63320 con 0x5617ebab41b0 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.500+0000 7f0129e17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5617ebe5ba20 con 0x5617eba8b2f0 2024-08-28T20:30:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f0129e17740 10 client.0 _ll_register_callbacks cb 0x5617ebd9ce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f0120c00640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01000b4b00 0x7f01000b7010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0114006010 tx=0x7f0114030970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f011be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe63480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f011b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 0x5617ebe63b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f0120c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe64690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f011b400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 0x5617ebe63b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35894/0 (socket says 172.21.15.1:35894) 2024-08-28T20:30:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.501+0000 7f011b400640 1 -- 172.21.15.1:0/3066062349 learned_addr learned my addr 172.21.15.1:0/3066062349 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.502+0000 7f011b400640 1 -- 172.21.15.1:0/3066062349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 msgr2=0x5617ebe63480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.502+0000 7f011b400640 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe63480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.502+0000 7f011b400640 1 -- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 msgr2=0x5617ebe64690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.502+0000 7f011b400640 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe64690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.502+0000 7f011b400640 1 -- 172.21.15.1:0/3066062349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ebb1f790 con 0x5617eba934d0 2024-08-28T20:30:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.503+0000 7f011b400640 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 0x5617ebe63b40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f010c00b310 tx=0x7f010c017650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb384eec6ed8bea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.503+0000 7f0105600640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:30:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.504+0000 7f0105600640 1 -- 172.21.15.1:0/3066062349 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c026020 con 0x5617eba934d0 2024-08-28T20:30:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.504+0000 7f0105600640 1 -- 172.21.15.1:0/3066062349 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f010c005230 con 0x5617eba934d0 2024-08-28T20:30:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.504+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010c017a70 con 0x5617eba934d0 2024-08-28T20:30:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.504+0000 7f0105600640 1 -- 172.21.15.1:0/3066062349 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f010c005450 con 0x5617eba934d0 2024-08-28T20:30:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.505+0000 7f0129e17740 10 client.15774 fetch_fsmap learned FSMap version 49 2024-08-28T20:30:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.505+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5617ebb98620 con 0x5617eba934d0 2024-08-28T20:30:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0105600640 1 -- 172.21.15.1:0/3066062349 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010c017a70 con 0x5617eba934d0 2024-08-28T20:30:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0105600640 1 -- 172.21.15.1:0/3066062349 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 49) ==== 8350+0+0 (secure 0 0 0) 0x7f010c0048c0 con 0x5617eba934d0 2024-08-28T20:30:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0129e17740 10 client.15774 fetch_fsmap finished waiting for FSMap version 49 2024-08-28T20:30:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0129e17740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0129e17740 20 client.15774 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0129e17740 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba72d80 0x5617ebe790e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0129e17740 4 client.15774 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:30:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.506+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617ebdceec0 con 0x5617eba72d80 2024-08-28T20:30:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.507+0000 7f011be00640 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba72d80 0x5617ebe790e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.508+0000 7f011be00640 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba72d80 0x5617ebe790e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14d5ba4464193c53 server_cookie=74b6fb7a5f9620e0 in_seq=0 out_seq=0 2024-08-28T20:30:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.508+0000 7f0105600640 10 client.15774 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.509+0000 7f0105600640 1 -- 172.21.15.1:0/3066062349 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617ebdceec0 con 0x5617eba72d80 2024-08-28T20:30:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.509+0000 7f0105600640 10 client.15774 handle_command_reply: tid=0 2024-08-28T20:30:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.509+0000 7f0129e17740 1 client.15774 shutdown 2024-08-28T20:30:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 msgr2=0x5617ebe63b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 0x5617ebe63b40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f010c00b310 tx=0x7f010c017650 comp rx=0 tx=0).stop 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 shutdown_connections 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba72d80 0x5617ebe790e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba934d0 0x5617ebe63b40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe64690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 --2- 172.21.15.1:0/3066062349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 >> 172.21.15.1:0/3066062349 conn(0x5617ebaa8300 msgr2=0x5617ebe53d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0105600640 0 client.15774 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 shutdown_connections 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.510+0000 7f0129e17740 1 -- 172.21.15.1:0/3066062349 wait complete. 2024-08-28T20:30:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.511+0000 7f0129e17740 20 client.15774 trim_cache size 0 max 16384 2024-08-28T20:30:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.537+0000 7f0129e17740 1 Processor -- start 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.537+0000 7f0129e17740 1 -- start start 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f0129e17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe59ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f0129e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f0129e17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe63480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f0129e17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1ab370 con 0x5617ebab41b0 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f0129e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1a8c40 con 0x5617eba934d0 2024-08-28T20:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f0129e17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1a6ab0 con 0x5617eba8b2f0 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f011b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f011be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe59ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f011b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:44118/0 (socket says 172.21.15.1:44118) 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.538+0000 7f011b400640 1 -- 172.21.15.1:0/3285976810 learned_addr learned my addr 172.21.15.1:0/3285976810 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.539+0000 7f011b400640 1 -- 172.21.15.1:0/3285976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 msgr2=0x5617ebe59ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.539+0000 7f011b400640 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe59ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.539+0000 7f011b400640 1 -- 172.21.15.1:0/3285976810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 msgr2=0x5617ebe63480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.539+0000 7f0120c00640 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe63480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.539+0000 7f011b400640 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe63480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.539+0000 7f011b400640 1 -- 172.21.15.1:0/3285976810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ebe64a00 con 0x5617eba934d0 2024-08-28T20:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.540+0000 7f0120c00640 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.540+0000 7f011b400640 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5a220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f010c006010 tx=0x7f010c00b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2254fd516c146e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.540+0000 7f0107e00640 1 -- 172.21.15.1:0/3285976810 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c026050 con 0x5617eba934d0 2024-08-28T20:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.540+0000 7f0107e00640 1 -- 172.21.15.1:0/3285976810 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010c03a070 con 0x5617eba934d0 2024-08-28T20:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.540+0000 7f0107e00640 1 -- 172.21.15.1:0/3285976810 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c0049e0 con 0x5617eba934d0 2024-08-28T20:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.541+0000 7f0129e17740 1 -- 172.21.15.1:0/3285976810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 msgr2=0x5617ebe5a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.541+0000 7f0129e17740 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5a220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f010c006010 tx=0x7f010c00b890 comp rx=0 tx=0).stop 2024-08-28T20:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 -- 172.21.15.1:0/3285976810 shutdown_connections 2024-08-28T20:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617ebab41b0 0x5617ebe63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617eba934d0 0x5617ebe5a220 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 --2- 172.21.15.1:0/3285976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba8b2f0 0x5617ebe59ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 -- 172.21.15.1:0/3285976810 >> 172.21.15.1:0/3285976810 conn(0x5617ebaa8300 msgr2=0x5617ebe50490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 -- 172.21.15.1:0/3285976810 shutdown_connections 2024-08-28T20:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 -- 172.21.15.1:0/3285976810 wait complete. 2024-08-28T20:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.542+0000 7f0129e17740 1 -- start start 2024-08-28T20:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.543+0000 7f0129e17740 1 Processor -- start 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.543+0000 7f0129e17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba8b2f0 0x5617ebe662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.543+0000 7f0129e17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 0x5617ebe669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.543+0000 7f0129e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe67520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.543+0000 7f0129e17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1a7100 con 0x5617eba8b2f0 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.543+0000 7f0129e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1a8570 con 0x5617ebab41b0 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f0129e17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1a77d0 con 0x5617eba934d0 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f0129e17740 10 client.0 _ll_register_callbacks cb 0x7f010c00b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 0x5617ebe669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 0x5617ebe669b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53992/0 (socket says 172.21.15.1:53992) 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 -- 172.21.15.1:0/1664337515 learned_addr learned my addr 172.21.15.1:0/1664337515 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011be00640 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba8b2f0 0x5617ebe662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f0120c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe67520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 -- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 msgr2=0x5617ebe67520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe67520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 -- 172.21.15.1:0/1664337515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba8b2f0 msgr2=0x5617ebe662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba8b2f0 0x5617ebe662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.544+0000 7f011b400640 1 -- 172.21.15.1:0/1664337515 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ebe67c80 con 0x5617eba934d0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.545+0000 7f011b400640 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 0x5617ebe669b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f010c000c00 tx=0x7f010c0050e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90ab97c5a06cc6d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.545+0000 7f0105600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.545+0000 7f0105600640 1 -- 172.21.15.1:0/1664337515 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c026070 con 0x5617eba934d0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.545+0000 7f0105600640 1 -- 172.21.15.1:0/1664337515 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f010c0055f0 con 0x5617eba934d0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.545+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010c03a070 con 0x5617eba934d0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.546+0000 7f0105600640 1 -- 172.21.15.1:0/1664337515 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f010c00f420 con 0x5617eba934d0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.546+0000 7f0129e17740 10 client.26050 fetch_fsmap learned FSMap version 49 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.546+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5617ebe6aef0 con 0x5617eba934d0 2024-08-28T20:30:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.546+0000 7f0105600640 1 -- 172.21.15.1:0/1664337515 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010c03a070 con 0x5617eba934d0 2024-08-28T20:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.546+0000 7f0105600640 1 -- 172.21.15.1:0/1664337515 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 49) ==== 8350+0+0 (secure 0 0 0) 0x7f010c00f760 con 0x5617eba934d0 2024-08-28T20:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.546+0000 7f0129e17740 10 client.26050 fetch_fsmap finished waiting for FSMap version 49 2024-08-28T20:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.547+0000 7f0129e17740 10 client.26050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.547+0000 7f0129e17740 20 client.26050 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.547+0000 7f0129e17740 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba481c0 0x5617ebef6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.547+0000 7f0129e17740 4 client.26050 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.547+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617ebdca960 con 0x5617eba481c0 2024-08-28T20:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.547+0000 7f011be00640 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba481c0 0x5617ebef6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.548+0000 7f011be00640 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba481c0 0x5617ebef6b80 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cc899a4b89c9a58 server_cookie=de9ee0c3a6f4b980 in_seq=0 out_seq=0 2024-08-28T20:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.548+0000 7f0105600640 10 client.26050 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.559+0000 7f0105600640 1 -- 172.21.15.1:0/1664337515 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617ebdca960 con 0x5617eba481c0 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.559+0000 7f0105600640 10 client.26050 handle_command_reply: tid=0 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 client.26050 shutdown 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 msgr2=0x5617ebe669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 0x5617ebe669b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f010c000c00 tx=0x7f010c0050e0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 shutdown_connections 2024-08-28T20:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5617eba481c0 0x5617ebef6b80 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617ebab41b0 0x5617ebe67520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617eba934d0 0x5617ebe669b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 --2- 172.21.15.1:0/1664337515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617eba8b2f0 0x5617ebe662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 >> 172.21.15.1:0/1664337515 conn(0x5617ebaa8300 msgr2=0x5617ebe61840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.560+0000 7f0105600640 0 client.26050 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.561+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 shutdown_connections 2024-08-28T20:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.561+0000 7f0129e17740 1 -- 172.21.15.1:0/1664337515 wait complete. 2024-08-28T20:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.561+0000 7f0129e17740 20 client.26050 trim_cache size 0 max 16384 2024-08-28T20:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01000b4b00 msgr2=0x7f01000b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01000b4b00 0x7f01000b7010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0114006010 tx=0x7f0114030970 comp rx=0 tx=0).stop 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 msgr2=0x7f011c076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 0x7f011c076bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f010800d950 tx=0x7f010800de10 comp rx=0 tx=0).stop 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 shutdown_connections 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01000b4b00 0x7f01000b7010 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f011c1042f0 0x7f011c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011c104c90 0x7f011c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 --2- 172.21.15.1:0/3692137000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011c103270 0x7f011c076bf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 >> 172.21.15.1:0/3692137000 conn(0x7f011c0febd0 msgr2=0x7f011c1075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 shutdown_connections 2024-08-28T20:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:02.562+0000 7f0121600640 1 -- 172.21.15.1:0/3692137000 wait complete. 2024-08-28T20:30:03.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 695.0 s, 1604.5 tps, lat 62.959 ms stddev 75.079 2024-08-28T20:30:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:03 smithi007 ceph-mon[25357]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.0 MiB/s wr, 562 op/s 2024-08-28T20:30:04.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:03 smithi001 ceph-mon[20984]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.0 MiB/s wr, 562 op/s 2024-08-28T20:30:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:03 smithi121 ceph-mon[25248]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.0 MiB/s wr, 562 op/s 2024-08-28T20:30:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:05 smithi007 ceph-mon[25357]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2024-08-28T20:30:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:05 smithi001 ceph-mon[20984]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2024-08-28T20:30:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:05 smithi121 ceph-mon[25248]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2024-08-28T20:30:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:07 smithi007 ceph-mon[25357]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.7 MiB/s wr, 570 op/s 2024-08-28T20:30:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:07 smithi121 ceph-mon[25248]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.7 MiB/s wr, 570 op/s 2024-08-28T20:30:08.231 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:07 smithi001 ceph-mon[20984]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.7 MiB/s wr, 570 op/s 2024-08-28T20:30:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 700.0 s, 1837.4 tps, lat 54.419 ms stddev 66.049 2024-08-28T20:30:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:09 smithi007 ceph-mon[25357]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.0 MiB/s wr, 617 op/s 2024-08-28T20:30:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:09 smithi001 ceph-mon[20984]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.0 MiB/s wr, 617 op/s 2024-08-28T20:30:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:09 smithi121 ceph-mon[25248]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.0 MiB/s wr, 617 op/s 2024-08-28T20:30:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:11 smithi007 ceph-mon[25357]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.7 MiB/s wr, 658 op/s 2024-08-28T20:30:12.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:11 smithi001 ceph-mon[20984]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.7 MiB/s wr, 658 op/s 2024-08-28T20:30:12.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:11 smithi121 ceph-mon[25248]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.7 MiB/s wr, 658 op/s 2024-08-28T20:30:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 705.0 s, 1403.4 tps, lat 71.205 ms stddev 81.934 2024-08-28T20:30:14.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:13 smithi007 ceph-mon[25357]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.6 MiB/s wr, 573 op/s 2024-08-28T20:30:14.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:13 smithi001 ceph-mon[20984]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.6 MiB/s wr, 573 op/s 2024-08-28T20:30:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:13 smithi121 ceph-mon[25248]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.6 MiB/s wr, 573 op/s 2024-08-28T20:30:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.854+0000 7f497ac00640 1 -- 172.21.15.1:0/3880258765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49741065e0 msgr2=0x7f4974108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.854+0000 7f497ac00640 1 --2- 172.21.15.1:0/3880258765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49741065e0 0x7f4974108a60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4960009900 tx=0x7f496002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.857+0000 7f497ac00640 1 -- 172.21.15.1:0/3880258765 shutdown_connections 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.857+0000 7f497ac00640 1 --2- 172.21.15.1:0/3880258765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49741091a0 0x7f497410b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.857+0000 7f497ac00640 1 --2- 172.21.15.1:0/3880258765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49741065e0 0x7f4974108a60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.857+0000 7f497ac00640 1 --2- 172.21.15.1:0/3880258765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f497406b620 0x7f49741060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.857+0000 7f497ac00640 1 -- 172.21.15.1:0/3880258765 >> 172.21.15.1:0/3880258765 conn(0x7f49740fdca0 msgr2=0x7f4974100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.857+0000 7f497ac00640 1 -- 172.21.15.1:0/3880258765 shutdown_connections 2024-08-28T20:30:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.858+0000 7f497ac00640 1 -- 172.21.15.1:0/3880258765 wait complete. 2024-08-28T20:30:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.859+0000 7f497ac00640 1 Processor -- start 2024-08-28T20:30:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.859+0000 7f497ac00640 1 -- start start 2024-08-28T20:30:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.860+0000 7f497ac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f497406b620 0x7f49741a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.860+0000 7f497ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49741065e0 0x7f49741a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.860+0000 7f497ac00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49741091a0 0x7f49741a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.860+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f497406b620 0x7f49741a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.861+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f497406b620 0x7f49741a0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41156/0 (socket says 172.21.15.1:41156) 2024-08-28T20:30:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f497ac00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4974103510 con 0x7f49741091a0 2024-08-28T20:30:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f497ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4974103390 con 0x7f49741065e0 2024-08-28T20:30:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f497ac00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4974103690 con 0x7f497406b620 2024-08-28T20:30:15.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f4973e00640 1 -- 172.21.15.1:0/131234343 learned_addr learned my addr 172.21.15.1:0/131234343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f4973400640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49741065e0 0x7f49741a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f4978c00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49741091a0 0x7f49741a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f4973400640 1 -- 172.21.15.1:0/131234343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f497406b620 msgr2=0x7f49741a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.862+0000 7f4973400640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f497406b620 0x7f49741a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.863+0000 7f4973400640 1 -- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49741091a0 msgr2=0x7f49741a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.863+0000 7f4973400640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49741091a0 0x7f49741a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.863+0000 7f4973400640 1 -- 172.21.15.1:0/131234343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49741a1d00 con 0x7f49741065e0 2024-08-28T20:30:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.863+0000 7f4973400640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49741065e0 0x7f49741a09c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f496002a910 tx=0x7f4960003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.865+0000 7f4970c00640 1 -- 172.21.15.1:0/131234343 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496003f070 con 0x7f49741065e0 2024-08-28T20:30:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.865+0000 7f4970c00640 1 -- 172.21.15.1:0/131234343 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f496003b460 con 0x7f49741065e0 2024-08-28T20:30:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.865+0000 7f4970c00640 1 -- 172.21.15.1:0/131234343 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960035030 con 0x7f49741065e0 2024-08-28T20:30:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.865+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49741a1f90 con 0x7f49741065e0 2024-08-28T20:30:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.865+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49741a8590 con 0x7f49741065e0 2024-08-28T20:30:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.873+0000 7f4981e24740 1 Processor -- start 2024-08-28T20:30:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 -- start start 2024-08-28T20:30:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b882f0 0x55e9b0f57430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f57f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e9b0ec9f70 con 0x55e9b0b882f0 2024-08-28T20:30:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e9b0eb9500 con 0x55e9b0b904d0 2024-08-28T20:30:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.875+0000 7f4981e24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e9b0ebd4b0 con 0x55e9b0bb11b0 2024-08-28T20:30:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.876+0000 7f4970c00640 1 -- 172.21.15.1:0/131234343 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f4960042070 con 0x7f49741065e0 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.876+0000 7f4978c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.876+0000 7f4978c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41170/0 (socket says 172.21.15.1:41170) 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.876+0000 7f4978c00640 1 -- 172.21.15.1:0/2372873334 learned_addr learned my addr 172.21.15.1:0/2372873334 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.877+0000 7f4978c00640 1 -- 172.21.15.1:0/2372873334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 msgr2=0x55e9b0f57f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.877+0000 7f4978c00640 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f57f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.877+0000 7f4978c00640 1 -- 172.21.15.1:0/2372873334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b882f0 msgr2=0x55e9b0f57430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.877+0000 7f4978c00640 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b882f0 0x55e9b0f57430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.877+0000 7f4978c00640 1 -- 172.21.15.1:0/2372873334 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b0e73c10 con 0x55e9b0bb11b0 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.879+0000 7f4970c00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49580b4bb0 0x7f49580b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.879+0000 7f4970c00640 1 -- 172.21.15.1:0/131234343 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4960105960 con 0x7f49741065e0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.879+0000 7f4978c00640 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f496c008da0 tx=0x7f496c00d710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e6d1e29a2030d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.879+0000 7f4973e00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49580b4bb0 0x7f49580b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.880+0000 7f4969200640 1 -- 172.21.15.1:0/2372873334 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c00f830 con 0x55e9b0bb11b0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.880+0000 7f4969200640 1 -- 172.21.15.1:0/2372873334 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f496c00de20 con 0x55e9b0bb11b0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.880+0000 7f4969200640 1 -- 172.21.15.1:0/2372873334 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c00e3b0 con 0x55e9b0bb11b0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.881+0000 7f4981e24740 1 -- 172.21.15.1:0/2372873334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 msgr2=0x55e9b0f56dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.881+0000 7f4973e00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49580b4bb0 0x7f49580b70c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f496400bd70 tx=0x7f496400b830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.881+0000 7f4981e24740 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f496c008da0 tx=0x7f496c00d710 comp rx=0 tx=0).stop 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 -- 172.21.15.1:0/2372873334 shutdown_connections 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b882f0 0x55e9b0f57430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f57f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 --2- 172.21.15.1:0/2372873334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 -- 172.21.15.1:0/2372873334 >> 172.21.15.1:0/2372873334 conn(0x55e9b0ba5300 msgr2=0x55e9b0f52850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 -- 172.21.15.1:0/2372873334 shutdown_connections 2024-08-28T20:30:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.884+0000 7f4981e24740 1 -- 172.21.15.1:0/2372873334 wait complete. 2024-08-28T20:30:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.885+0000 7f4981e24740 1 -- start start 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.886+0000 7f4981e24740 1 Processor -- start 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.886+0000 7f4981e24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f82580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.886+0000 7f4981e24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f82c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.886+0000 7f4981e24740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4981e24740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e9b0df2ab0 con 0x55e9b0bb11b0 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4981e24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e9b0e60320 con 0x55e9b0b904d0 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4981e24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e9b0f58aa0 con 0x55e9b0b882f0 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4981e24740 10 client.0 _ll_register_callbacks cb 0x55e9b0e666a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4973400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f82c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f82580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4973400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f82c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:37120/0 (socket says 172.21.15.1:37120) 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.887+0000 7f4973400640 1 -- 172.21.15.1:0/1044961643 learned_addr learned my addr 172.21.15.1:0/1044961643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f4973400640 1 -- 172.21.15.1:0/1044961643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 msgr2=0x55e9b0f82580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f4973400640 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f82580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f4973400640 1 -- 172.21.15.1:0/1044961643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 msgr2=0x55e9b0f837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f4973400640 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f4973400640 1 -- 172.21.15.1:0/1044961643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b0c1c790 con 0x55e9b0b904d0 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f4973400640 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f82c40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4960103450 tx=0x7f49600cbd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fddd574b25aab4dd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.888+0000 7f495d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:30:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.889+0000 7f495d600640 1 -- 172.21.15.1:0/1044961643 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960049070 con 0x55e9b0b904d0 2024-08-28T20:30:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.889+0000 7f495d600640 1 -- 172.21.15.1:0/1044961643 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f496003b610 con 0x55e9b0b904d0 2024-08-28T20:30:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.889+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f496c00de20 con 0x55e9b0b904d0 2024-08-28T20:30:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.889+0000 7f495d600640 1 -- 172.21.15.1:0/1044961643 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f49600cca80 con 0x55e9b0b904d0 2024-08-28T20:30:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.891+0000 7f4981e24740 10 client.26093 fetch_fsmap learned FSMap version 49 2024-08-28T20:30:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.891+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e9b0c95620 con 0x55e9b0b904d0 2024-08-28T20:30:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.891+0000 7f495d600640 1 -- 172.21.15.1:0/1044961643 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f496c00de20 con 0x55e9b0b904d0 2024-08-28T20:30:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.891+0000 7f495d600640 1 -- 172.21.15.1:0/1044961643 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 49) ==== 8350+0+0 (secure 0 0 0) 0x7f496003b8d0 con 0x55e9b0b904d0 2024-08-28T20:30:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.892+0000 7f4981e24740 10 client.26093 fetch_fsmap finished waiting for FSMap version 49 2024-08-28T20:30:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.892+0000 7f4981e24740 10 client.26093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.893+0000 7f4981e24740 20 client.26093 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.893+0000 7f4981e24740 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b6fd80 0x55e9b0f8fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.893+0000 7f4981e24740 4 client.26093 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:30:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.893+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9b0ecbec0 con 0x55e9b0b6fd80 2024-08-28T20:30:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.893+0000 7f4973e00640 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b6fd80 0x55e9b0f8fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.894+0000 7f4973e00640 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b6fd80 0x55e9b0f8fc60 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e24bfee64d8e3ca server_cookie=eb9932b5ff3f8e69 in_seq=0 out_seq=0 2024-08-28T20:30:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.894+0000 7f495d600640 10 client.26093 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.895+0000 7f495d600640 1 -- 172.21.15.1:0/1044961643 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9b0ecbec0 con 0x55e9b0b6fd80 2024-08-28T20:30:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.895+0000 7f495d600640 10 client.26093 handle_command_reply: tid=0 2024-08-28T20:30:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.895+0000 7f4981e24740 1 client.26093 shutdown 2024-08-28T20:30:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.898+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 msgr2=0x55e9b0f82c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.898+0000 7f4981e24740 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f82c40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4960103450 tx=0x7f49600cbd50 comp rx=0 tx=0).stop 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 shutdown_connections 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b6fd80 0x55e9b0f8fc60 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f82c40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 --2- 172.21.15.1:0/1044961643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f82580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 >> 172.21.15.1:0/1044961643 conn(0x55e9b0ba5300 msgr2=0x55e9b0f50cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f495d600640 0 client.26093 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 shutdown_connections 2024-08-28T20:30:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 1 -- 172.21.15.1:0/1044961643 wait complete. 2024-08-28T20:30:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.899+0000 7f4981e24740 20 client.26093 trim_cache size 0 max 16384 2024-08-28T20:30:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.929+0000 7f4981e24740 1 Processor -- start 2024-08-28T20:30:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.929+0000 7f4981e24740 1 -- start start 2024-08-28T20:30:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4981e24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f51540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4981e24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f51a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4981e24740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4981e24740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f49741ab220 con 0x55e9b0bb11b0 2024-08-28T20:30:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4981e24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a8af0 con 0x55e9b0b904d0 2024-08-28T20:30:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4981e24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4974073590 con 0x55e9b0b882f0 2024-08-28T20:30:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.930+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f51540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f51540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41186/0 (socket says 172.21.15.1:41186) 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 -- 172.21.15.1:0/873670130 learned_addr learned my addr 172.21.15.1:0/873670130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973400640 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f51a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4978c00640 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 -- 172.21.15.1:0/873670130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 msgr2=0x55e9b0f51a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f51a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 -- 172.21.15.1:0/873670130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 msgr2=0x55e9b0f56d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4973e00640 1 -- 172.21.15.1:0/873670130 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b0f839e0 con 0x55e9b0b882f0 2024-08-28T20:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.931+0000 7f4978c00640 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.933+0000 7f4973e00640 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f51540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4964011660 tx=0x7f4964013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef5afb94bf16b97 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.933+0000 7f495fe00640 1 -- 172.21.15.1:0/873670130 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496402c070 con 0x55e9b0b882f0 2024-08-28T20:30:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.933+0000 7f495fe00640 1 -- 172.21.15.1:0/873670130 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f496401ec50 con 0x55e9b0b882f0 2024-08-28T20:30:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.933+0000 7f495fe00640 1 -- 172.21.15.1:0/873670130 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496401dbd0 con 0x55e9b0b882f0 2024-08-28T20:30:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 -- 172.21.15.1:0/873670130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 msgr2=0x55e9b0f51540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f51540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4964011660 tx=0x7f4964013000 comp rx=0 tx=0).stop 2024-08-28T20:30:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 -- 172.21.15.1:0/873670130 shutdown_connections 2024-08-28T20:30:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f56d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0b904d0 0x55e9b0f51a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 --2- 172.21.15.1:0/873670130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f51540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 -- 172.21.15.1:0/873670130 >> 172.21.15.1:0/873670130 conn(0x55e9b0ba5300 msgr2=0x55e9b0f52190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 -- 172.21.15.1:0/873670130 shutdown_connections 2024-08-28T20:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.935+0000 7f4981e24740 1 -- 172.21.15.1:0/873670130 wait complete. 2024-08-28T20:30:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.936+0000 7f4981e24740 1 -- start start 2024-08-28T20:30:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.936+0000 7f4981e24740 1 Processor -- start 2024-08-28T20:30:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.937+0000 7f4981e24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f8a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.937+0000 7f4981e24740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b904d0 0x55e9b0f88e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.937+0000 7f4981e24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f89340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.938+0000 7f4973400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b904d0 0x55e9b0f88e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.938+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.938+0000 7f4973e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f8a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41198/0 (socket says 172.21.15.1:41198) 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.938+0000 7f4973e00640 1 -- 172.21.15.1:0/1804444798 learned_addr learned my addr 172.21.15.1:0/1804444798 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4978c00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f89340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4974073be0 con 0x55e9b0b904d0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4974075050 con 0x55e9b0bb11b0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49740742b0 con 0x55e9b0b882f0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4981e24740 10 client.0 _ll_register_callbacks cb 0x7f49600cc150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4978c00640 1 -- 172.21.15.1:0/1804444798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 msgr2=0x55e9b0f8a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.939+0000 7f4978c00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f8a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.940+0000 7f4978c00640 1 -- 172.21.15.1:0/1804444798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b904d0 msgr2=0x55e9b0f88e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.940+0000 7f4978c00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b904d0 0x55e9b0f88e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.942+0000 7f4978c00640 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b0f89880 con 0x55e9b0bb11b0 2024-08-28T20:30:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.942+0000 7f4973e00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f8a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:30:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.942+0000 7f4973400640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b904d0 0x55e9b0f88e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.942+0000 7f4978c00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f89340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55e9b0f4cba0 tx=0x7f496c004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e1095ba2d6b1e7f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.942+0000 7f495d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.943+0000 7f495d600640 1 -- 172.21.15.1:0/1804444798 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c028060 con 0x55e9b0bb11b0 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.943+0000 7f495d600640 1 -- 172.21.15.1:0/1804444798 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f496c00fa40 con 0x55e9b0bb11b0 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.943+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f496401ec50 con 0x55e9b0bb11b0 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.943+0000 7f495d600640 1 -- 172.21.15.1:0/1804444798 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f496c00de20 con 0x55e9b0bb11b0 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.943+0000 7f4981e24740 10 client.26099 fetch_fsmap learned FSMap version 49 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.943+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e9b0f88740 con 0x55e9b0bb11b0 2024-08-28T20:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.944+0000 7f495d600640 1 -- 172.21.15.1:0/1804444798 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f496401ec50 con 0x55e9b0bb11b0 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f495d600640 1 -- 172.21.15.1:0/1804444798 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 49) ==== 8350+0+0 (secure 0 0 0) 0x7f496c018480 con 0x55e9b0bb11b0 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f4981e24740 10 client.26099 fetch_fsmap finished waiting for FSMap version 49 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f4981e24740 10 client.26099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f4981e24740 20 client.26099 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f4981e24740 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b451c0 0x55e9b0ffca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f4981e24740 4 client.26099 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.945+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e9b0ec7960 con 0x55e9b0b451c0 2024-08-28T20:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.946+0000 7f4973e00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b451c0 0x55e9b0ffca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.947+0000 7f495d600640 10 client.26099 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.947+0000 7f4973e00640 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b451c0 0x55e9b0ffca50 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b87d51a7f5055cfe server_cookie=28ff74281248b8ea in_seq=0 out_seq=0 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f495d600640 1 -- 172.21.15.1:0/1804444798 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e9b0ec7960 con 0x55e9b0b451c0 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f495d600640 10 client.26099 handle_command_reply: tid=0 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 client.26099 shutdown 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0bb11b0 msgr2=0x55e9b0f89340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f89340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55e9b0f4cba0 tx=0x7f496c004f90 comp rx=0 tx=0).stop 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 shutdown_connections 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55e9b0b451c0 0x55e9b0ffca50 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9b0b904d0 0x55e9b0f88e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e9b0bb11b0 0x55e9b0f89340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 --2- 172.21.15.1:0/1804444798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9b0b882f0 0x55e9b0f8a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f495d600640 0 client.26099 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:15.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.970+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 >> 172.21.15.1:0/1804444798 conn(0x55e9b0ba5300 msgr2=0x55e9b0f52190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:15.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.971+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 shutdown_connections 2024-08-28T20:30:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.971+0000 7f4981e24740 1 -- 172.21.15.1:0/1804444798 wait complete. 2024-08-28T20:30:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.971+0000 7f4981e24740 20 client.26099 trim_cache size 0 max 16384 2024-08-28T20:30:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:30:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:30:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:30:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49580b4bb0 msgr2=0x7f49580b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49580b4bb0 0x7f49580b70c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f496400bd70 tx=0x7f496400b830 comp rx=0 tx=0).stop 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49741065e0 msgr2=0x7f49741a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49741065e0 0x7f49741a09c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f496002a910 tx=0x7f4960003d50 comp rx=0 tx=0).stop 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 shutdown_connections 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49580b4bb0 0x7f49580b70c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49741091a0 0x7f49741a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.972+0000 7f497ac00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49741065e0 0x7f49741a09c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.973+0000 7f497ac00640 1 --2- 172.21.15.1:0/131234343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f497406b620 0x7f49741a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.973+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 >> 172.21.15.1:0/131234343 conn(0x7f49740fdca0 msgr2=0x7f4974105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.973+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 shutdown_connections 2024-08-28T20:30:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:15.973+0000 7f497ac00640 1 -- 172.21.15.1:0/131234343 wait complete. 2024-08-28T20:30:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:15 smithi007 ceph-mon[25357]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.6 MiB/s wr, 671 op/s 2024-08-28T20:30:16.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:15 smithi001 ceph-mon[20984]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.6 MiB/s wr, 671 op/s 2024-08-28T20:30:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:15 smithi121 ceph-mon[25248]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.6 MiB/s wr, 671 op/s 2024-08-28T20:30:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:17 smithi007 ceph-mon[25357]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.9 MiB/s wr, 671 op/s 2024-08-28T20:30:18.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:17 smithi001 ceph-mon[20984]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.9 MiB/s wr, 671 op/s 2024-08-28T20:30:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:17 smithi121 ceph-mon[25248]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.9 MiB/s wr, 671 op/s 2024-08-28T20:30:18.765 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 710.0 s, 1328.6 tps, lat 74.480 ms stddev 87.528 2024-08-28T20:30:20.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:19 smithi007 ceph-mon[25357]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 683 op/s 2024-08-28T20:30:20.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:19 smithi001 ceph-mon[20984]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 683 op/s 2024-08-28T20:30:20.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:19 smithi121 ceph-mon[25248]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 683 op/s 2024-08-28T20:30:22.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:21 smithi001 ceph-mon[20984]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 715 op/s 2024-08-28T20:30:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:21 smithi121 ceph-mon[25248]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 715 op/s 2024-08-28T20:30:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:21 smithi007 ceph-mon[25357]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 715 op/s 2024-08-28T20:30:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 715.0 s, 1699.2 tps, lat 59.171 ms stddev 72.877 2024-08-28T20:30:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:23 smithi001 ceph-mon[20984]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 596 op/s 2024-08-28T20:30:24.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:23 smithi121 ceph-mon[25248]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 596 op/s 2024-08-28T20:30:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:23 smithi007 ceph-mon[25357]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 596 op/s 2024-08-28T20:30:26.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:25 smithi001 ceph-mon[20984]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 693 op/s 2024-08-28T20:30:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:25 smithi121 ceph-mon[25248]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 693 op/s 2024-08-28T20:30:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:25 smithi007 ceph-mon[25357]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 693 op/s 2024-08-28T20:30:28.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:27 smithi001 ceph-mon[20984]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 665 op/s 2024-08-28T20:30:28.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:27 smithi121 ceph-mon[25248]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 665 op/s 2024-08-28T20:30:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:27 smithi007 ceph-mon[25357]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 665 op/s 2024-08-28T20:30:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 720.0 s, 1582.8 tps, lat 63.556 ms stddev 76.795 2024-08-28T20:30:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 -- 172.21.15.1:0/276978146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409e070 msgr2=0x7f90e40a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 --2- 172.21.15.1:0/276978146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409e070 0x7f90e40a4780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009930 tx=0x7f90d802a440 comp rx=0 tx=0).stop 2024-08-28T20:30:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 -- 172.21.15.1:0/276978146 shutdown_connections 2024-08-28T20:30:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 --2- 172.21.15.1:0/276978146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e409d720 0x7f90e409db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 --2- 172.21.15.1:0/276978146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409e070 0x7f90e40a4780 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 --2- 172.21.15.1:0/276978146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409c970 0x7f90e409cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.283+0000 7f90ef200640 1 -- 172.21.15.1:0/276978146 >> 172.21.15.1:0/276978146 conn(0x7f90e400b6c0 msgr2=0x7f90e400bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.284+0000 7f90ef200640 1 -- 172.21.15.1:0/276978146 shutdown_connections 2024-08-28T20:30:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.285+0000 7f90ef200640 1 -- 172.21.15.1:0/276978146 wait complete. 2024-08-28T20:30:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.287+0000 7f90ef200640 1 Processor -- start 2024-08-28T20:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.288+0000 7f90ef200640 1 -- start start 2024-08-28T20:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.288+0000 7f90ef200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e409c970 0x7f90e41329b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.288+0000 7f90ef200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409d720 0x7f90e4133020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ef200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409e070 0x7f90e4133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ef200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40a7fb0 con 0x7f90e409c970 2024-08-28T20:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ef200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40a7e30 con 0x7f90e409e070 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ef200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40a8130 con 0x7f90e409d720 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ede00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e409c970 0x7f90e41329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409e070 0x7f90e4133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ed400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409d720 0x7f90e4133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409e070 0x7f90e4133bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52418/0 (socket says 172.21.15.1:52418) 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.289+0000 7f90ee800640 1 -- 172.21.15.1:0/4112931822 learned_addr learned my addr 172.21.15.1:0/4112931822 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.290+0000 7f90ed400640 1 -- 172.21.15.1:0/4112931822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409e070 msgr2=0x7f90e4133bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.290+0000 7f90ed400640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409e070 0x7f90e4133bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.290+0000 7f90ed400640 1 -- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e409c970 msgr2=0x7f90e41329b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.290+0000 7f90ed400640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e409c970 0x7f90e41329b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.290+0000 7f90ed400640 1 -- 172.21.15.1:0/4112931822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e4134360 con 0x7f90e409d720 2024-08-28T20:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.290+0000 7f90ed400640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409d720 0x7f90e4133020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e9f0 tx=0x7f90dc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.291+0000 7f90e2a00640 1 -- 172.21.15.1:0/4112931822 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00ccc0 con 0x7f90e409d720 2024-08-28T20:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.291+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e4134650 con 0x7f90e409d720 2024-08-28T20:30:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.291+0000 7f90e2a00640 1 -- 172.21.15.1:0/4112931822 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90dc0108e0 con 0x7f90e409d720 2024-08-28T20:30:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.291+0000 7f90e2a00640 1 -- 172.21.15.1:0/4112931822 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0188e0 con 0x7f90e409d720 2024-08-28T20:30:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.291+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e413add0 con 0x7f90e409d720 2024-08-28T20:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.299+0000 7f90e2a00640 1 -- 172.21.15.1:0/4112931822 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f90dc010430 con 0x7f90e409d720 2024-08-28T20:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.302+0000 7f90f78a8740 1 Processor -- start 2024-08-28T20:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.302+0000 7f90e2a00640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90d00b4c30 0x7f90d00b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.303+0000 7f90e2a00640 1 -- 172.21.15.1:0/4112931822 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f90dc0e54b0 con 0x7f90e409d720 2024-08-28T20:30:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.303+0000 7f90f78a8740 1 -- start start 2024-08-28T20:30:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90ee800640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90d00b4c30 0x7f90d00b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d21474fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210a62f0 0x562d21475610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21476160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90f78a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562d213e7f70 con 0x562d210ae4d0 2024-08-28T20:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90f78a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d213d7500 con 0x562d210a62f0 2024-08-28T20:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.304+0000 7f90f78a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562d213db4b0 con 0x562d210cf1b0 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.305+0000 7f90ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d21474fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.305+0000 7f90ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d21474fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40946/0 (socket says 172.21.15.1:40946) 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.305+0000 7f90ede00640 1 -- 172.21.15.1:0/3801895405 learned_addr learned my addr 172.21.15.1:0/3801895405 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.305+0000 7f90ed400640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210a62f0 0x562d21475610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.305+0000 7f90ee800640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90d00b4c30 0x7f90d00b7140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f90d8004770 tx=0x7f90d800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.305+0000 7f90ee800640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21476160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.306+0000 7f90ede00640 1 -- 172.21.15.1:0/3801895405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210a62f0 msgr2=0x562d21475610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.306+0000 7f90ede00640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210a62f0 0x562d21475610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.306+0000 7f90ede00640 1 -- 172.21.15.1:0/3801895405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 msgr2=0x562d21476160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.306+0000 7f90ede00640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21476160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.306+0000 7f90ede00640 1 -- 172.21.15.1:0/3801895405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d21391c10 con 0x562d210cf1b0 2024-08-28T20:30:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.307+0000 7f90ed400640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210a62f0 0x562d21475610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:30:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.307+0000 7f90ee800640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21476160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.309+0000 7f90ede00640 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d21474fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90e8066a10 tx=0x7f90e8077950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12f72349f2b3753 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.310+0000 7f90d7000640 1 -- 172.21.15.1:0/3801895405 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8089070 con 0x562d210cf1b0 2024-08-28T20:30:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.310+0000 7f90d7000640 1 -- 172.21.15.1:0/3801895405 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e806c780 con 0x562d210cf1b0 2024-08-28T20:30:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.310+0000 7f90d7000640 1 -- 172.21.15.1:0/3801895405 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8084c50 con 0x562d210cf1b0 2024-08-28T20:30:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.311+0000 7f90f78a8740 1 -- 172.21.15.1:0/3801895405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 msgr2=0x562d21474fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.311+0000 7f90f78a8740 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d21474fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90e8066a10 tx=0x7f90e8077950 comp rx=0 tx=0).stop 2024-08-28T20:30:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 -- 172.21.15.1:0/3801895405 shutdown_connections 2024-08-28T20:30:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21476160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210a62f0 0x562d21475610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 --2- 172.21.15.1:0/3801895405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d21474fa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 -- 172.21.15.1:0/3801895405 >> 172.21.15.1:0/3801895405 conn(0x562d210c3300 msgr2=0x562d21470a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 -- 172.21.15.1:0/3801895405 shutdown_connections 2024-08-28T20:30:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.312+0000 7f90f78a8740 1 -- 172.21.15.1:0/3801895405 wait complete. 2024-08-28T20:30:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.313+0000 7f90f78a8740 1 -- start start 2024-08-28T20:30:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.313+0000 7f90f78a8740 1 Processor -- start 2024-08-28T20:30:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2148f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d2148fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210cf1b0 0x562d21490850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562d21310ab0 con 0x562d210cf1b0 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d2137e320 con 0x562d210ae4d0 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562d21476c80 con 0x562d210a62f0 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90f78a8740 10 client.0 _ll_register_callbacks cb 0x562d213846a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2148f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2148f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40952/0 (socket says 172.21.15.1:40952) 2024-08-28T20:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90ede00640 1 -- 172.21.15.1:0/338452209 learned_addr learned my addr 172.21.15.1:0/338452209 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90ee800640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210cf1b0 0x562d21490850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.314+0000 7f90ed400640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d2148fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ede00640 1 -- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 msgr2=0x562d2148fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ede00640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d2148fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ede00640 1 -- 172.21.15.1:0/338452209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210cf1b0 msgr2=0x562d21490850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ede00640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210cf1b0 0x562d21490850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ede00640 1 -- 172.21.15.1:0/338452209 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d2113a790 con 0x562d210a62f0 2024-08-28T20:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ed400640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d2148fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90ede00640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2148f620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90e8051dc0 tx=0x7f90e80846b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75fbed5185450f53 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.315+0000 7f90cb400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.316+0000 7f90cb400640 1 -- 172.21.15.1:0/338452209 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8089070 con 0x562d210a62f0 2024-08-28T20:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.316+0000 7f90cb400640 1 -- 172.21.15.1:0/338452209 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f90e8064230 con 0x562d210a62f0 2024-08-28T20:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.316+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90e806c780 con 0x562d210a62f0 2024-08-28T20:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.317+0000 7f90cb400640 1 -- 172.21.15.1:0/338452209 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f90e8064430 con 0x562d210a62f0 2024-08-28T20:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.317+0000 7f90f78a8740 10 client.26080 fetch_fsmap learned FSMap version 49 2024-08-28T20:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.317+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562d211b3620 con 0x562d210a62f0 2024-08-28T20:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90cb400640 1 -- 172.21.15.1:0/338452209 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e806c780 con 0x562d210a62f0 2024-08-28T20:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90cb400640 1 -- 172.21.15.1:0/338452209 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 49) ==== 8350+0+0 (secure 0 0 0) 0x7f90e8063ae0 con 0x562d210a62f0 2024-08-28T20:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90f78a8740 10 client.26080 fetch_fsmap finished waiting for FSMap version 49 2024-08-28T20:30:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90f78a8740 10 client.26080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90f78a8740 20 client.26080 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90f78a8740 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d2108dd80 0x562d2149cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90f78a8740 4 client.26080 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:30:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.318+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d213e9ec0 con 0x562d2108dd80 2024-08-28T20:30:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.319+0000 7f90ed400640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d2108dd80 0x562d2149cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.319+0000 7f90ed400640 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d2108dd80 0x562d2149cba0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dbb40946a2e0f2b server_cookie=eade6e6db6d1b734 in_seq=0 out_seq=0 2024-08-28T20:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.319+0000 7f90cb400640 10 client.26080 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.320+0000 7f90cb400640 1 -- 172.21.15.1:0/338452209 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f90dc085e50 con 0x562d2108dd80 2024-08-28T20:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.320+0000 7f90cb400640 10 client.26080 handle_command_reply: tid=0 2024-08-28T20:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.320+0000 7f90f78a8740 1 client.26080 shutdown 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 msgr2=0x562d2148f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2148f620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90e8051dc0 tx=0x7f90e80846b0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 shutdown_connections 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d2108dd80 0x562d2149cba0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210cf1b0 0x562d21490850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d2148fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90cb400640 0 client.26080 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 --2- 172.21.15.1:0/338452209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2148f620 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 >> 172.21.15.1:0/338452209 conn(0x562d210c3300 msgr2=0x562d2146ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 shutdown_connections 2024-08-28T20:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.321+0000 7f90f78a8740 1 -- 172.21.15.1:0/338452209 wait complete. 2024-08-28T20:30:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.322+0000 7f90f78a8740 20 client.26080 trim_cache size 0 max 16384 2024-08-28T20:30:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.342+0000 7f90f78a8740 1 Processor -- start 2024-08-28T20:30:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.342+0000 7f90f78a8740 1 -- start start 2024-08-28T20:30:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.343+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2146f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.343+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21497730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.343+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 0x562d2148f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.343+0000 7f90f78a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc010d20 con 0x562d210ae4d0 2024-08-28T20:30:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.343+0000 7f90f78a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00e5f0 con 0x562d210cf1b0 2024-08-28T20:30:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.343+0000 7f90f78a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00c440 con 0x562d210a62f0 2024-08-28T20:30:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.344+0000 7f90ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 0x562d2148f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.344+0000 7f90ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 0x562d2148f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52432/0 (socket says 172.21.15.1:52432) 2024-08-28T20:30:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.344+0000 7f90ee800640 1 -- 172.21.15.1:0/1826630724 learned_addr learned my addr 172.21.15.1:0/1826630724 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.344+0000 7f90ede00640 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2146f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.344+0000 7f90ed400640 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21497730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.345+0000 7f90ee800640 1 -- 172.21.15.1:0/1826630724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 msgr2=0x562d2146f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.345+0000 7f90ee800640 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2146f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.345+0000 7f90ee800640 1 -- 172.21.15.1:0/1826630724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 msgr2=0x562d21497730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.346+0000 7f90ee800640 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21497730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.346+0000 7f90ee800640 1 -- 172.21.15.1:0/1826630724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d21490bc0 con 0x562d210cf1b0 2024-08-28T20:30:29.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.346+0000 7f90ed400640 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21497730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:30:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.346+0000 7f90ee800640 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 0x562d2148f130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f90d80315b0 tx=0x7f90d803d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada961995fea8232 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.347+0000 7f90d6600640 1 -- 172.21.15.1:0/1826630724 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8035040 con 0x562d210cf1b0 2024-08-28T20:30:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.347+0000 7f90d6600640 1 -- 172.21.15.1:0/1826630724 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d804e070 con 0x562d210cf1b0 2024-08-28T20:30:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.347+0000 7f90d6600640 1 -- 172.21.15.1:0/1826630724 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8003850 con 0x562d210cf1b0 2024-08-28T20:30:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 -- 172.21.15.1:0/1826630724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 msgr2=0x562d2148f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 0x562d2148f130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f90d80315b0 tx=0x7f90d803d000 comp rx=0 tx=0).stop 2024-08-28T20:30:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 -- 172.21.15.1:0/1826630724 shutdown_connections 2024-08-28T20:30:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210ae4d0 0x562d21497730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210cf1b0 0x562d2148f130 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 --2- 172.21.15.1:0/1826630724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210a62f0 0x562d2146f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 -- 172.21.15.1:0/1826630724 >> 172.21.15.1:0/1826630724 conn(0x562d210c3300 msgr2=0x562d21479700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 -- 172.21.15.1:0/1826630724 shutdown_connections 2024-08-28T20:30:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.348+0000 7f90f78a8740 1 -- 172.21.15.1:0/1826630724 wait complete. 2024-08-28T20:30:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.349+0000 7f90f78a8740 1 -- start start 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.349+0000 7f90f78a8740 1 Processor -- start 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.349+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210a62f0 0x562d214974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.349+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d214961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90f78a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d214967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90f78a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00cab0 con 0x562d210a62f0 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90f78a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00df20 con 0x562d210ae4d0 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90f78a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc00d180 con 0x562d210cf1b0 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90f78a8740 10 client.0 _ll_register_callbacks cb 0x7f90e8069990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ede00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210a62f0 0x562d214974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d214961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d214961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52434/0 (socket says 172.21.15.1:52434) 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ede00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210a62f0 0x562d214974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39126/0 (socket says 172.21.15.1:39126) 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 -- 172.21.15.1:0/2637445295 learned_addr learned my addr 172.21.15.1:0/2637445295 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ee800640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d214967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 -- 172.21.15.1:0/2637445295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 msgr2=0x562d214967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d214967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 -- 172.21.15.1:0/2637445295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210a62f0 msgr2=0x562d214974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210a62f0 0x562d214974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ed400640 1 -- 172.21.15.1:0/2637445295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d21496f00 con 0x562d210ae4d0 2024-08-28T20:30:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.350+0000 7f90ee800640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d214967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:30:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90ed400640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d214961a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e9c0 tx=0x7f90dc0abfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a516789e3843a99 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90cb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:30:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90cb400640 1 -- 172.21.15.1:0/2637445295 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0971b0 con 0x562d210ae4d0 2024-08-28T20:30:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90cb400640 1 -- 172.21.15.1:0/2637445295 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f90dc0b02f0 con 0x562d210ae4d0 2024-08-28T20:30:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90d804e070 con 0x562d210ae4d0 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90cb400640 1 -- 172.21.15.1:0/2637445295 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f90dc0b4d00 con 0x562d210ae4d0 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90f78a8740 10 client.26111 fetch_fsmap learned FSMap version 49 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.351+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562d21507620 con 0x562d210ae4d0 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90cb400640 1 -- 172.21.15.1:0/2637445295 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d804e070 con 0x562d210ae4d0 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90cb400640 1 -- 172.21.15.1:0/2637445295 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 49) ==== 8350+0+0 (secure 0 0 0) 0x7f90dc0a77e0 con 0x562d210ae4d0 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90f78a8740 10 client.26111 fetch_fsmap finished waiting for FSMap version 49 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90f78a8740 10 client.26111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90f78a8740 20 client.26111 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90f78a8740 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d210631c0 0x562d21509f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90f78a8740 4 client.26111 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:30:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d213e5960 con 0x562d210631c0 2024-08-28T20:30:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.354+0000 7f90ede00640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d210631c0 0x562d21509f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.355+0000 7f90cb400640 10 client.26111 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.355+0000 7f90ede00640 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d210631c0 0x562d21509f70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff89ceb1e29eadb5 server_cookie=8e6dbd78d3b00d9e in_seq=0 out_seq=0 2024-08-28T20:30:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.366+0000 7f90cb400640 1 -- 172.21.15.1:0/2637445295 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d213e5960 con 0x562d210631c0 2024-08-28T20:30:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.366+0000 7f90cb400640 10 client.26111 handle_command_reply: tid=0 2024-08-28T20:30:29.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 client.26111 shutdown 2024-08-28T20:30:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 msgr2=0x562d214961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d214961a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e9c0 tx=0x7f90dc0abfb0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 shutdown_connections 2024-08-28T20:30:29.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562d210631c0 0x562d21509f70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562d210cf1b0 0x562d214967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d210ae4d0 0x562d214961a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 --2- 172.21.15.1:0/2637445295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d210a62f0 0x562d214974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90cb400640 0 client.26111 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 >> 172.21.15.1:0/2637445295 conn(0x562d210c3300 msgr2=0x562d2146f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 shutdown_connections 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.367+0000 7f90f78a8740 1 -- 172.21.15.1:0/2637445295 wait complete. 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.368+0000 7f90f78a8740 20 client.26111 trim_cache size 0 max 16384 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:30:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:30:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:30:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:30:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90d00b4c30 msgr2=0x7f90d00b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90d00b4c30 0x7f90d00b7140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f90d8004770 tx=0x7f90d800b040 comp rx=0 tx=0).stop 2024-08-28T20:30:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409d720 msgr2=0x7f90e4133020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409d720 0x7f90e4133020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00e9f0 tx=0x7f90dc00eeb0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 shutdown_connections 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90d00b4c30 0x7f90d00b7140 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90e409e070 0x7f90e4133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e409d720 0x7f90e4133020 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 --2- 172.21.15.1:0/4112931822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e409c970 0x7f90e41329b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 >> 172.21.15.1:0/4112931822 conn(0x7f90e400b6c0 msgr2=0x7f90e40a0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 shutdown_connections 2024-08-28T20:30:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:29.369+0000 7f90ef200640 1 -- 172.21.15.1:0/4112931822 wait complete. 2024-08-28T20:30:30.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:29 smithi001 ceph-mon[20984]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 642 op/s 2024-08-28T20:30:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:29 smithi121 ceph-mon[25248]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 642 op/s 2024-08-28T20:30:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:29 smithi007 ceph-mon[25357]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 642 op/s 2024-08-28T20:30:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:31 smithi001 ceph-mon[20984]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 648 op/s 2024-08-28T20:30:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:31 smithi121 ceph-mon[25248]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 648 op/s 2024-08-28T20:30:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:31 smithi007 ceph-mon[25357]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 648 op/s 2024-08-28T20:30:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 725.0 s, 1867.4 tps, lat 53.420 ms stddev 69.138 2024-08-28T20:30:34.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:33 smithi001 ceph-mon[20984]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 540 op/s 2024-08-28T20:30:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:33 smithi121 ceph-mon[25248]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 540 op/s 2024-08-28T20:30:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:33 smithi007 ceph-mon[25357]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 540 op/s 2024-08-28T20:30:36.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:35 smithi001 ceph-mon[20984]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 693 op/s 2024-08-28T20:30:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:35 smithi121 ceph-mon[25248]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 693 op/s 2024-08-28T20:30:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:35 smithi007 ceph-mon[25357]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 693 op/s 2024-08-28T20:30:38.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:37 smithi001 ceph-mon[20984]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.4 MiB/s wr, 626 op/s 2024-08-28T20:30:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:37 smithi121 ceph-mon[25248]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.4 MiB/s wr, 626 op/s 2024-08-28T20:30:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:37 smithi007 ceph-mon[25357]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.4 MiB/s wr, 626 op/s 2024-08-28T20:30:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 730.0 s, 1669.2 tps, lat 59.875 ms stddev 83.851 2024-08-28T20:30:40.155 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:39 smithi007 ceph-mon[25357]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-08-28T20:30:40.156 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:39 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:30:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:39 smithi001 ceph-mon[20984]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-08-28T20:30:40.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:39 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:30:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:39 smithi121 ceph-mon[25248]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 641 op/s 2024-08-28T20:30:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:39 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:30:41.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:40 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:30:41.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:40 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:30:41.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:40 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:30:41.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:40 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:30:41.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:40 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:30:41.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:40 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:30:41.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:40 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:30:41.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:40 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:30:41.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:40 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:30:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:41 smithi001 ceph-mon[20984]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-08-28T20:30:42.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:41 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:30:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:41 smithi121 ceph-mon[25248]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-08-28T20:30:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:41 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:30:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:41 smithi007 ceph-mon[25357]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.0 MiB/s wr, 670 op/s 2024-08-28T20:30:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:41 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:30:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 -- 172.21.15.1:0/860296738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b641044f0 msgr2=0x7f1b64104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 --2- 172.21.15.1:0/860296738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b641044f0 0x7f1b64104900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009900 tx=0x7f1b5002a410 comp rx=0 tx=0).stop 2024-08-28T20:30:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 -- 172.21.15.1:0/860296738 shutdown_connections 2024-08-28T20:30:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 --2- 172.21.15.1:0/860296738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b64104e90 0x7f1b6410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 --2- 172.21.15.1:0/860296738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b641044f0 0x7f1b64104900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 --2- 172.21.15.1:0/860296738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b64103470 0x7f1b641038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.656+0000 7f1b6c000640 1 -- 172.21.15.1:0/860296738 >> 172.21.15.1:0/860296738 conn(0x7f1b640fedd0 msgr2=0x7f1b64101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.657+0000 7f1b6c000640 1 -- 172.21.15.1:0/860296738 shutdown_connections 2024-08-28T20:30:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.657+0000 7f1b6c000640 1 -- 172.21.15.1:0/860296738 wait complete. 2024-08-28T20:30:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.658+0000 7f1b6c000640 1 Processor -- start 2024-08-28T20:30:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.659+0000 7f1b6c000640 1 -- start start 2024-08-28T20:30:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.660+0000 7f1b6c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 0x7f1b641a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.660+0000 7f1b6c000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b641044f0 0x7f1b641a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.660+0000 7f1b6c000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b64104e90 0x7f1b641a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.660+0000 7f1b69600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 0x7f1b641a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.660+0000 7f1b69600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 0x7f1b641a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34110/0 (socket says 172.21.15.1:34110) 2024-08-28T20:30:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.660+0000 7f1b69600640 1 -- 172.21.15.1:0/1214930832 learned_addr learned my addr 172.21.15.1:0/1214930832 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.661+0000 7f1b6a000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b64104e90 0x7f1b641a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.661+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64076fc0 con 0x7f1b641044f0 2024-08-28T20:30:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.661+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64076e40 con 0x7f1b64103470 2024-08-28T20:30:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.661+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64077140 con 0x7f1b64104e90 2024-08-28T20:30:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.661+0000 7f1b68c00640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b641044f0 0x7f1b641a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.662+0000 7f1b69600640 1 -- 172.21.15.1:0/1214930832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b64104e90 msgr2=0x7f1b641a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.662+0000 7f1b69600640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b64104e90 0x7f1b641a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.662+0000 7f1b69600640 1 -- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b641044f0 msgr2=0x7f1b641a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.662+0000 7f1b69600640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b641044f0 0x7f1b641a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.662+0000 7f1b69600640 1 -- 172.21.15.1:0/1214930832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b641a1ed0 con 0x7f1b64103470 2024-08-28T20:30:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.663+0000 7f1b69600640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 0x7f1b641a0490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b450 tx=0x7f1b5800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.663+0000 7f1b62000640 1 -- 172.21.15.1:0/1214930832 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58015020 con 0x7f1b64103470 2024-08-28T20:30:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.663+0000 7f1b62000640 1 -- 172.21.15.1:0/1214930832 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b58011d40 con 0x7f1b64103470 2024-08-28T20:30:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.663+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b641a21c0 con 0x7f1b64103470 2024-08-28T20:30:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.663+0000 7f1b62000640 1 -- 172.21.15.1:0/1214930832 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58015020 con 0x7f1b64103470 2024-08-28T20:30:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.663+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b641a88b0 con 0x7f1b64103470 2024-08-28T20:30:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.669+0000 7f1b62000640 1 -- 172.21.15.1:0/1214930832 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f1b58018020 con 0x7f1b64103470 2024-08-28T20:30:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.673+0000 7f1b62000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1b4c0b4db0 0x7f1b4c0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.673+0000 7f1b62000640 1 -- 172.21.15.1:0/1214930832 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f1b580e4780 con 0x7f1b64103470 2024-08-28T20:30:42.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.675+0000 7f1b68c00640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1b4c0b4db0 0x7f1b4c0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.677+0000 7f1b7306b740 1 Processor -- start 2024-08-28T20:30:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.677+0000 7f1b68c00640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1b4c0b4db0 0x7f1b4c0b72c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000c00 tx=0x7f1b50031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.678+0000 7f1b7306b740 1 -- start start 2024-08-28T20:30:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.679+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.679+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.679+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.679+0000 7f1b69600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.680+0000 7f1b69600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42242/0 (socket says 172.21.15.1:42242) 2024-08-28T20:30:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.681+0000 7f1b68c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.681+0000 7f1b68c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655f11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47934/0 (socket says 172.21.15.1:47934) 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.681+0000 7f1b6a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.681+0000 7f1b6a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34124/0 (socket says 172.21.15.1:34124) 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b6a000640 1 -- 172.21.15.1:0/1345015423 learned_addr learned my addr 172.21.15.1:0/1345015423 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564e65563f70 con 0x564e6524b1b0 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564e65553500 con 0x564e6522a4d0 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564e655574b0 con 0x564e652222f0 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b69600640 1 -- 172.21.15.1:0/1345015423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 msgr2=0x564e655f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b69600640 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b69600640 1 -- 172.21.15.1:0/1345015423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 msgr2=0x564e655f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b69600640 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.682+0000 7f1b69600640 1 -- 172.21.15.1:0/1345015423 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6550dc10 con 0x564e6524b1b0 2024-08-28T20:30:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.683+0000 7f1b69600640 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655f0b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800be10 tx=0x7f1b58010930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30a121be8315b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.686+0000 7f1b56600640 1 -- 172.21.15.1:0/1345015423 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b580af9b0 con 0x564e6524b1b0 2024-08-28T20:30:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.687+0000 7f1b56600640 1 -- 172.21.15.1:0/1345015423 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b580b4460 con 0x564e6524b1b0 2024-08-28T20:30:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.687+0000 7f1b56600640 1 -- 172.21.15.1:0/1345015423 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b580aa3a0 con 0x564e6524b1b0 2024-08-28T20:30:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.689+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 msgr2=0x564e655f0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.689+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655f0b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800be10 tx=0x7f1b58010930 comp rx=0 tx=0).stop 2024-08-28T20:30:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 shutdown_connections 2024-08-28T20:30:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1345015423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655f0b30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 >> 172.21.15.1:0/1345015423 conn(0x564e6523f300 msgr2=0x564e655ec5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 shutdown_connections 2024-08-28T20:30:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.690+0000 7f1b7306b740 1 -- 172.21.15.1:0/1345015423 wait complete. 2024-08-28T20:30:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.691+0000 7f1b7306b740 1 -- start start 2024-08-28T20:30:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.692+0000 7f1b7306b740 1 Processor -- start 2024-08-28T20:30:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.692+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e655fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b69600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e655fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b69600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e655fa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:34132/0 (socket says 172.21.15.1:34132) 2024-08-28T20:30:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e6522a4d0 0x564e655fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655fb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b7306b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564e6548cab0 con 0x564e6524b1b0 2024-08-28T20:30:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b7306b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564e654fa320 con 0x564e652222f0 2024-08-28T20:30:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b7306b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564e655f27b0 con 0x564e6522a4d0 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b69600640 1 -- 172.21.15.1:0/542789392 learned_addr learned my addr 172.21.15.1:0/542789392 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b7306b740 10 client.0 _ll_register_callbacks cb 0x564e65533e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.693+0000 7f1b68c00640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e6522a4d0 0x564e655fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b6a000640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655fb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b69600640 1 -- 172.21.15.1:0/542789392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e6522a4d0 msgr2=0x564e655fa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b69600640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e6522a4d0 0x564e655fa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b69600640 1 -- 172.21.15.1:0/542789392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 msgr2=0x564e655fb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b69600640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655fb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b69600640 1 -- 172.21.15.1:0/542789392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e652b6790 con 0x564e652222f0 2024-08-28T20:30:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b6a000640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655fb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b69600640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e655fa180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b580aae40 tx=0x7f1b580a7600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c9651e72f5e88fd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.694+0000 7f1b4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:30:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.695+0000 7f1b4aa00640 1 -- 172.21.15.1:0/542789392 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011aa0 con 0x564e652222f0 2024-08-28T20:30:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.695+0000 7f1b4aa00640 1 -- 172.21.15.1:0/542789392 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f1b580aa3a0 con 0x564e652222f0 2024-08-28T20:30:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.695+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b580b4460 con 0x564e652222f0 2024-08-28T20:30:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.696+0000 7f1b4aa00640 1 -- 172.21.15.1:0/542789392 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1b580aa5a0 con 0x564e652222f0 2024-08-28T20:30:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.696+0000 7f1b7306b740 10 client.26123 fetch_fsmap learned FSMap version 50 2024-08-28T20:30:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.696+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x564e6532f620 con 0x564e652222f0 2024-08-28T20:30:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b4aa00640 1 -- 172.21.15.1:0/542789392 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b580b4460 con 0x564e652222f0 2024-08-28T20:30:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b4aa00640 1 -- 172.21.15.1:0/542789392 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f1b58096180 con 0x564e652222f0 2024-08-28T20:30:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b7306b740 10 client.26123 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:30:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b7306b740 10 client.26123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b7306b740 20 client.26123 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b7306b740 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e65209d80 0x564e65607490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b7306b740 4 client.26123 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:30:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.697+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e65565ec0 con 0x564e65209d80 2024-08-28T20:30:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.698+0000 7f1b68c00640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e65209d80 0x564e65607490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.699+0000 7f1b4aa00640 10 client.26123 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.699+0000 7f1b68c00640 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e65209d80 0x564e65607490 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca5ea7edef4eb4de server_cookie=c5f373da4cab668d in_seq=0 out_seq=0 2024-08-28T20:30:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b4aa00640 1 -- 172.21.15.1:0/542789392 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e65565ec0 con 0x564e65209d80 2024-08-28T20:30:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b4aa00640 10 client.26123 handle_command_reply: tid=0 2024-08-28T20:30:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 client.26123 shutdown 2024-08-28T20:30:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 msgr2=0x564e655fa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e655fa180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b580aae40 tx=0x7f1b580a7600 comp rx=0 tx=0).stop 2024-08-28T20:30:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 shutdown_connections 2024-08-28T20:30:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e65209d80 0x564e65607490 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6524b1b0 0x564e655fb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e6522a4d0 0x564e655fa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.700+0000 7f1b7306b740 1 --2- 172.21.15.1:0/542789392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e655fa180 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.701+0000 7f1b4aa00640 0 client.26123 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.701+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 >> 172.21.15.1:0/542789392 conn(0x564e6523f300 msgr2=0x564e655f1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.701+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 shutdown_connections 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.701+0000 7f1b7306b740 1 -- 172.21.15.1:0/542789392 wait complete. 2024-08-28T20:30:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.701+0000 7f1b7306b740 20 client.26123 trim_cache size 0 max 16384 2024-08-28T20:30:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.728+0000 7f1b7306b740 1 Processor -- start 2024-08-28T20:30:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 -- start start 2024-08-28T20:30:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e65209d80 0x564e655f9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1b641b3f10 con 0x564e65209d80 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b641b17e0 con 0x564e6522a4d0 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b7306b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b641af630 con 0x564e652222f0 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.729+0000 7f1b68c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655ebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:47946/0 (socket says 172.21.15.1:47946) 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 -- 172.21.15.1:0/1391955063 learned_addr learned my addr 172.21.15.1:0/1391955063 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b69600640 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e65209d80 0x564e655f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b6a000640 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 -- 172.21.15.1:0/1391955063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 msgr2=0x564e655ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655ec440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 -- 172.21.15.1:0/1391955063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e65209d80 msgr2=0x564e655f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e65209d80 0x564e655f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 -- 172.21.15.1:0/1391955063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e655f8390 con 0x564e652222f0 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b6a000640 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:30:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.730+0000 7f1b68c00640 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655ebf00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009230 tx=0x7f1b50040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24f9aee974aeb539 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.731+0000 7f1b55c00640 1 -- 172.21.15.1:0/1391955063 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50003e20 con 0x564e652222f0 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.731+0000 7f1b55c00640 1 -- 172.21.15.1:0/1391955063 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b50031a50 con 0x564e652222f0 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.731+0000 7f1b55c00640 1 -- 172.21.15.1:0/1391955063 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50054b40 con 0x564e652222f0 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 -- 172.21.15.1:0/1391955063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 msgr2=0x564e655ebf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655ebf00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009230 tx=0x7f1b50040000 comp rx=0 tx=0).stop 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 -- 172.21.15.1:0/1391955063 shutdown_connections 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e6522a4d0 0x564e655ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e652222f0 0x564e655ebf00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 --2- 172.21.15.1:0/1391955063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e65209d80 0x564e655f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 -- 172.21.15.1:0/1391955063 >> 172.21.15.1:0/1391955063 conn(0x564e6523f300 msgr2=0x564e655f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 -- 172.21.15.1:0/1391955063 shutdown_connections 2024-08-28T20:30:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.732+0000 7f1b7306b740 1 -- 172.21.15.1:0/1391955063 wait complete. 2024-08-28T20:30:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.733+0000 7f1b7306b740 1 -- start start 2024-08-28T20:30:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.733+0000 7f1b7306b740 1 Processor -- start 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e65209d80 0x564e65601bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e65602270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 0x564e655fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1b641afca0 con 0x564e6522a4d0 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b641b1110 con 0x564e652222f0 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b641b0370 con 0x564e65209d80 2024-08-28T20:30:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b7306b740 10 client.0 _ll_register_callbacks cb 0x7f1b580aa940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.734+0000 7f1b69600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e65209d80 0x564e65601bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 0x564e655fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 0x564e655fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42286/0 (socket says 172.21.15.1:42286) 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 -- 172.21.15.1:0/3274662176 learned_addr learned my addr 172.21.15.1:0/3274662176 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b68c00640 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e65602270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 -- 172.21.15.1:0/3274662176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e65209d80 msgr2=0x564e65601bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e65209d80 0x564e65601bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 -- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 msgr2=0x564e65602270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e65602270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 -- 172.21.15.1:0/3274662176 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e655fe390 con 0x564e6522a4d0 2024-08-28T20:30:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b6a000640 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 0x564e655fdc00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00ae70 tx=0x7f1b5c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0536028428b8de server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.735+0000 7f1b4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b4aa00640 1 -- 172.21.15.1:0/3274662176 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01a070 con 0x564e6522a4d0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b4aa00640 1 -- 172.21.15.1:0/3274662176 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f1b5c016600 con 0x564e6522a4d0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b50031a50 con 0x564e6522a4d0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b4aa00640 1 -- 172.21.15.1:0/3274662176 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1b5c026050 con 0x564e6522a4d0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b7306b740 10 client.15804 fetch_fsmap learned FSMap version 50 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x564e655ff970 con 0x564e6522a4d0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.736+0000 7f1b4aa00640 1 -- 172.21.15.1:0/3274662176 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b50031a50 con 0x564e6522a4d0 2024-08-28T20:30:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b4aa00640 1 -- 172.21.15.1:0/3274662176 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f1b5c01e6e0 con 0x564e6522a4d0 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b7306b740 10 client.15804 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b7306b740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b7306b740 20 client.15804 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b7306b740 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e6524b1b0 0x564e656745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b7306b740 4 client.15804 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.737+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e65561960 con 0x564e6524b1b0 2024-08-28T20:30:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.738+0000 7f1b69600640 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e6524b1b0 0x564e656745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.740+0000 7f1b4aa00640 10 client.15804 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.740+0000 7f1b69600640 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e6524b1b0 0x564e656745e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84eab53086928567 server_cookie=e732b046c4dec72a in_seq=0 out_seq=0 2024-08-28T20:30:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.752+0000 7f1b4aa00640 1 -- 172.21.15.1:0/3274662176 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e65561960 con 0x564e6524b1b0 2024-08-28T20:30:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.752+0000 7f1b4aa00640 10 client.15804 handle_command_reply: tid=0 2024-08-28T20:30:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.752+0000 7f1b7306b740 1 client.15804 shutdown 2024-08-28T20:30:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.752+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 msgr2=0x564e655fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.752+0000 7f1b7306b740 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 0x564e655fdc00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00ae70 tx=0x7f1b5c007680 comp rx=0 tx=0).stop 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 shutdown_connections 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x564e6524b1b0 0x564e656745e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564e6522a4d0 0x564e655fdc00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e652222f0 0x564e65602270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 --2- 172.21.15.1:0/3274662176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e65209d80 0x564e65601bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 >> 172.21.15.1:0/3274662176 conn(0x564e6523f300 msgr2=0x564e655eab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b4aa00640 0 client.15804 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 shutdown_connections 2024-08-28T20:30:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 1 -- 172.21.15.1:0/3274662176 wait complete. 2024-08-28T20:30:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.753+0000 7f1b7306b740 20 client.15804 trim_cache size 0 max 16384 2024-08-28T20:30:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:30:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:30:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:30:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:30:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1b4c0b4db0 msgr2=0x7f1b4c0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1b4c0b4db0 0x7f1b4c0b72c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000c00 tx=0x7f1b50031400 comp rx=0 tx=0).stop 2024-08-28T20:30:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 msgr2=0x7f1b641a0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 0x7f1b641a0490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b450 tx=0x7f1b5800b910 comp rx=0 tx=0).stop 2024-08-28T20:30:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 shutdown_connections 2024-08-28T20:30:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f1b4c0b4db0 0x7f1b4c0b72c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b641044f0 0x7f1b641a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b64104e90 0x7f1b641a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 --2- 172.21.15.1:0/1214930832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b64103470 0x7f1b641a0490 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 >> 172.21.15.1:0/1214930832 conn(0x7f1b640fedd0 msgr2=0x7f1b6410fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.754+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 shutdown_connections 2024-08-28T20:30:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:42.755+0000 7f1b6c000640 1 -- 172.21.15.1:0/1214930832 wait complete. 2024-08-28T20:30:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 735.0 s, 1412.6 tps, lat 70.709 ms stddev 89.337 2024-08-28T20:30:44.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:43 smithi001 ceph-mon[20984]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.3 MiB/s wr, 592 op/s 2024-08-28T20:30:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:43 smithi121 ceph-mon[25248]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.3 MiB/s wr, 592 op/s 2024-08-28T20:30:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:43 smithi007 ceph-mon[25357]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.3 MiB/s wr, 592 op/s 2024-08-28T20:30:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:45 smithi001 ceph-mon[20984]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-08-28T20:30:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:45 smithi121 ceph-mon[25248]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-08-28T20:30:46.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:45 smithi007 ceph-mon[25357]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-08-28T20:30:48.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:47 smithi001 ceph-mon[20984]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-08-28T20:30:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:47 smithi121 ceph-mon[25248]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-08-28T20:30:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:47 smithi007 ceph-mon[25357]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-08-28T20:30:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 740.0 s, 1819.6 tps, lat 55.084 ms stddev 65.351 2024-08-28T20:30:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:49 smithi121 ceph-mon[25248]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.8 MiB/s wr, 671 op/s 2024-08-28T20:30:50.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:49 smithi001 ceph-mon[20984]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.8 MiB/s wr, 671 op/s 2024-08-28T20:30:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:49 smithi007 ceph-mon[25357]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.8 MiB/s wr, 671 op/s 2024-08-28T20:30:52.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:51 smithi001 ceph-mon[20984]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-08-28T20:30:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:51 smithi121 ceph-mon[25248]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-08-28T20:30:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:51 smithi007 ceph-mon[25357]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 678 op/s 2024-08-28T20:30:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 745.0 s, 1755.6 tps, lat 56.326 ms stddev 69.909 2024-08-28T20:30:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:53 smithi001 ceph-mon[20984]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-08-28T20:30:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:53 smithi121 ceph-mon[25248]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-08-28T20:30:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:53 smithi007 ceph-mon[25357]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-08-28T20:30:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 -- 172.21.15.1:0/1599165989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff950106f90 msgr2=0x7ff950107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 --2- 172.21.15.1:0/1599165989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff950106f90 0x7ff950107490 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff948009ca0 tx=0x7ff94802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 -- 172.21.15.1:0/1599165989 shutdown_connections 2024-08-28T20:30:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 --2- 172.21.15.1:0/1599165989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff950106f90 0x7ff950107490 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 --2- 172.21.15.1:0/1599165989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9501043d0 0x7ff950106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 --2- 172.21.15.1:0/1599165989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff95006b620 0x7ff950103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 -- 172.21.15.1:0/1599165989 >> 172.21.15.1:0/1599165989 conn(0x7ff9500fdca0 msgr2=0x7ff950100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 -- 172.21.15.1:0/1599165989 shutdown_connections 2024-08-28T20:30:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.060+0000 7ff955600640 1 -- 172.21.15.1:0/1599165989 wait complete. 2024-08-28T20:30:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.064+0000 7ff955600640 1 Processor -- start 2024-08-28T20:30:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.065+0000 7ff955600640 1 -- start start 2024-08-28T20:30:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff955600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95006b620 0x7ff9501a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff955600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9501043d0 0x7ff9501a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff955600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff950106f90 0x7ff9501a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff955600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501156d0 con 0x7ff9501043d0 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff955600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff950115550 con 0x7ff95006b620 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff955600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff950115850 con 0x7ff950106f90 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.066+0000 7ff94f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff950106f90 0x7ff9501a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff950106f90 0x7ff9501a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45920/0 (socket says 172.21.15.1:45920) 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94f400640 1 -- 172.21.15.1:0/2254912419 learned_addr learned my addr 172.21.15.1:0/2254912419 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94ea00640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95006b620 0x7ff9501a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94e000640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9501043d0 0x7ff9501a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94ea00640 1 -- 172.21.15.1:0/2254912419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff950106f90 msgr2=0x7ff9501a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94ea00640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff950106f90 0x7ff9501a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94ea00640 1 -- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9501043d0 msgr2=0x7ff9501a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94ea00640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9501043d0 0x7ff9501a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.067+0000 7ff94ea00640 1 -- 172.21.15.1:0/2254912419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9501a1d10 con 0x7ff95006b620 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.068+0000 7ff94ea00640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95006b620 0x7ff9501a02d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9f0 tx=0x7ff94000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.068+0000 7ff947400640 1 -- 172.21.15.1:0/2254912419 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94000ccc0 con 0x7ff95006b620 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.068+0000 7ff947400640 1 -- 172.21.15.1:0/2254912419 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9400108e0 con 0x7ff95006b620 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.068+0000 7ff947400640 1 -- 172.21.15.1:0/2254912419 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940018880 con 0x7ff95006b620 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.068+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9501a2000 con 0x7ff95006b620 2024-08-28T20:30:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.069+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff950108680 con 0x7ff95006b620 2024-08-28T20:30:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.072+0000 7ff95c80e740 1 Processor -- start 2024-08-28T20:30:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.072+0000 7ff95c80e740 1 -- start start 2024-08-28T20:30:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de5051b0 0x5558de8aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4dc2f0 0x5558de8ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 0x5558de8abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff95c80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5558de81df70 con 0x5558de5051b0 2024-08-28T20:30:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff95c80e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5558de80d500 con 0x5558de4dc2f0 2024-08-28T20:30:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff95c80e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5558de8114b0 con 0x5558de4e44d0 2024-08-28T20:30:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff94e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 0x5558de8abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff94f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de5051b0 0x5558de8aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff94e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 0x5558de8abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45932/0 (socket says 172.21.15.1:45932) 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff94e000640 1 -- 172.21.15.1:0/3739214088 learned_addr learned my addr 172.21.15.1:0/3739214088 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.073+0000 7ff947400640 1 -- 172.21.15.1:0/2254912419 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ff940010430 con 0x7ff95006b620 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.074+0000 7ff94e000640 1 -- 172.21.15.1:0/3739214088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4dc2f0 msgr2=0x5558de8ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.074+0000 7ff94e000640 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4dc2f0 0x5558de8ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.074+0000 7ff94e000640 1 -- 172.21.15.1:0/3739214088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de5051b0 msgr2=0x5558de8aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.074+0000 7ff94e000640 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de5051b0 0x5558de8aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.074+0000 7ff94e000640 1 -- 172.21.15.1:0/3739214088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558de7c7c10 con 0x5558de4e44d0 2024-08-28T20:30:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.075+0000 7ff94e000640 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 0x5558de8abf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00bc90 tx=0x7ff93c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15c3ab5b6b74034 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.075+0000 7ff93b400640 1 -- 172.21.15.1:0/3739214088 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c005220 con 0x5558de4e44d0 2024-08-28T20:30:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.075+0000 7ff93b400640 1 -- 172.21.15.1:0/3739214088 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff93c00be40 con 0x5558de4e44d0 2024-08-28T20:30:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.075+0000 7ff93b400640 1 -- 172.21.15.1:0/3739214088 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0117b0 con 0x5558de4e44d0 2024-08-28T20:30:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.077+0000 7ff947400640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff9340b4bb0 0x7ff9340b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.077+0000 7ff947400640 1 -- 172.21.15.1:0/2254912419 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff9400e5450 con 0x7ff95006b620 2024-08-28T20:30:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.078+0000 7ff94f400640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff9340b4bb0 0x7ff9340b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.078+0000 7ff95c80e740 1 -- 172.21.15.1:0/3739214088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 msgr2=0x5558de8abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.079+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 0x5558de8abf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00bc90 tx=0x7ff93c0107a0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 -- 172.21.15.1:0/3739214088 shutdown_connections 2024-08-28T20:30:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4e44d0 0x5558de8abf80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4dc2f0 0x5558de8ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3739214088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de5051b0 0x5558de8aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 -- 172.21.15.1:0/3739214088 >> 172.21.15.1:0/3739214088 conn(0x5558de4f9300 msgr2=0x5558de8a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 -- 172.21.15.1:0/3739214088 shutdown_connections 2024-08-28T20:30:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff95c80e740 1 -- 172.21.15.1:0/3739214088 wait complete. 2024-08-28T20:30:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.080+0000 7ff94f400640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff9340b4bb0 0x7ff9340b70c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff94802f500 tx=0x7ff948031af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 -- start start 2024-08-28T20:30:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 Processor -- start 2024-08-28T20:30:56.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4e44d0 0x5558de8b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de5051b0 0x5558de8b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5558de746ab0 con 0x5558de4e44d0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5558de7b4320 con 0x5558de5051b0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5558de8acaa0 con 0x5558de4dc2f0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.081+0000 7ff95c80e740 10 client.0 _ll_register_callbacks cb 0x5558de7ba6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94e000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4e44d0 0x5558de8b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94e000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4e44d0 0x5558de8b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45624/0 (socket says 172.21.15.1:45624) 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94e000640 1 -- 172.21.15.1:0/3276160872 learned_addr learned my addr 172.21.15.1:0/3276160872 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94f400640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de5051b0 0x5558de8b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94ea00640 1 -- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de5051b0 msgr2=0x5558de8b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de5051b0 0x5558de8b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94ea00640 1 -- 172.21.15.1:0/3276160872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4e44d0 msgr2=0x5558de8b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4e44d0 0x5558de8b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.082+0000 7ff94ea00640 1 -- 172.21.15.1:0/3276160872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558de570790 con 0x5558de4dc2f0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8b44a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff9400abe50 tx=0x7ff940010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948e00999b5d1ccb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff92fe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff92fe00640 1 -- 172.21.15.1:0/3276160872 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9400b5130 con 0x5558de4dc2f0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff92fe00640 1 -- 172.21.15.1:0/3276160872 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff940010a90 con 0x5558de4dc2f0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5558de81fec0 con 0x5558de4dc2f0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff92fe00640 1 -- 172.21.15.1:0/3276160872 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff940097170 con 0x5558de4dc2f0 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff95c80e740 10 client.26113 fetch_fsmap learned FSMap version 50 2024-08-28T20:30:56.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.083+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5558de5e9620 con 0x5558de4dc2f0 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff92fe00640 1 -- 172.21.15.1:0/3276160872 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5558de81fec0 con 0x5558de4dc2f0 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff92fe00640 1 -- 172.21.15.1:0/3276160872 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ff9400a7830 con 0x5558de4dc2f0 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff95c80e740 10 client.26113 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff95c80e740 10 client.26113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff95c80e740 20 client.26113 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de4c3d80 0x5558de8c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff95c80e740 4 client.26113 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558de81b960 con 0x5558de4c3d80 2024-08-28T20:30:56.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.084+0000 7ff94e000640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de4c3d80 0x5558de8c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.085+0000 7ff94e000640 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de4c3d80 0x5558de8c1b70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b587ea55063602f7 server_cookie=bd70474cb6f3d2c4 in_seq=0 out_seq=0 2024-08-28T20:30:56.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.085+0000 7ff92fe00640 10 client.26113 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff92fe00640 1 -- 172.21.15.1:0/3276160872 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558de81b960 con 0x5558de4c3d80 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff92fe00640 10 client.26113 handle_command_reply: tid=0 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff95c80e740 1 client.26113 shutdown 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 msgr2=0x5558de8b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8b44a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff9400abe50 tx=0x7ff940010860 comp rx=0 tx=0).stop 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 shutdown_connections 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.086+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de4c3d80 0x5558de8c1b70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4e44d0 0x5558de8b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de5051b0 0x5558de8b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3276160872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8b44a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 >> 172.21.15.1:0/3276160872 conn(0x5558de4f9300 msgr2=0x5558de8a4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff92fe00640 0 client.26113 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 shutdown_connections 2024-08-28T20:30:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 1 -- 172.21.15.1:0/3276160872 wait complete. 2024-08-28T20:30:56.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.087+0000 7ff95c80e740 20 client.26113 trim_cache size 0 max 16384 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.113+0000 7ff95c80e740 1 Processor -- start 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.113+0000 7ff95c80e740 1 -- start start 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff95c80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501bc4b0 con 0x5558de4f9300 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff95c80e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501b9d80 con 0x5558de4e44d0 2024-08-28T20:30:56.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff95c80e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff95010f360 con 0x5558de4dc2f0 2024-08-28T20:30:56.116 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94ea00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:49370/0 (socket says 172.21.15.1:49370) 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94f400640 1 -- 172.21.15.1:0/1539078079 learned_addr learned my addr 172.21.15.1:0/1539078079 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94e000640 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94e000640 1 -- 172.21.15.1:0/1539078079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 msgr2=0x5558de8af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94e000640 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.114+0000 7ff94e000640 1 -- 172.21.15.1:0/1539078079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 msgr2=0x5558de8a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.115+0000 7ff94e000640 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.115+0000 7ff94e000640 1 -- 172.21.15.1:0/1539078079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558de8b5a40 con 0x5558de4dc2f0 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.115+0000 7ff94f400640 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:30:56.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.115+0000 7ff94e000640 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8aede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5558de8c2310 tx=0x7ff93c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f0ca167904993f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:56.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.116+0000 7ff93aa00640 1 -- 172.21.15.1:0/1539078079 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c033070 con 0x5558de4dc2f0 2024-08-28T20:30:56.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.116+0000 7ff93aa00640 1 -- 172.21.15.1:0/1539078079 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff93c02e440 con 0x5558de4dc2f0 2024-08-28T20:30:56.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.117+0000 7ff93aa00640 1 -- 172.21.15.1:0/1539078079 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011e60 con 0x5558de4dc2f0 2024-08-28T20:30:56.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.118+0000 7ff95c80e740 1 -- 172.21.15.1:0/1539078079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 msgr2=0x5558de8aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.118+0000 7ff95c80e740 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8aede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5558de8c2310 tx=0x7ff93c005fd0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 -- 172.21.15.1:0/1539078079 shutdown_connections 2024-08-28T20:30:56.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8aede0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 --2- 172.21.15.1:0/1539078079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 -- 172.21.15.1:0/1539078079 >> 172.21.15.1:0/1539078079 conn(0x5558de8a19c0 msgr2=0x5558de8a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:56.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 -- 172.21.15.1:0/1539078079 shutdown_connections 2024-08-28T20:30:56.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.119+0000 7ff95c80e740 1 -- 172.21.15.1:0/1539078079 wait complete. 2024-08-28T20:30:56.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.120+0000 7ff95c80e740 1 -- start start 2024-08-28T20:30:56.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.120+0000 7ff95c80e740 1 Processor -- start 2024-08-28T20:30:56.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff95010f9d0 con 0x5558de4f9300 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501b96b0 con 0x5558de4e44d0 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501100a0 con 0x5558de4dc2f0 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff95c80e740 10 client.0 _ll_register_callbacks cb 0x7ff9400ab700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8bbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:49374/0 (socket says 172.21.15.1:49374) 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 -- 172.21.15.1:0/3676828360 learned_addr learned my addr 172.21.15.1:0/3676828360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:30:56.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94f400640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 -- 172.21.15.1:0/3676828360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 msgr2=0x5558de8bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8bb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 -- 172.21.15.1:0/3676828360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 msgr2=0x5558de8ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:30:56.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.129 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.121+0000 7ff94e000640 1 -- 172.21.15.1:0/3676828360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558de8ba770 con 0x5558de4e44d0 2024-08-28T20:30:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.122+0000 7ff94e000640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8bbbb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00bbb0 tx=0x7ff93c005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf49a7631bf570bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:30:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.122+0000 7ff92fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:30:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.122+0000 7ff92fe00640 1 -- 172.21.15.1:0/3676828360 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c03b070 con 0x5558de4e44d0 2024-08-28T20:30:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.122+0000 7ff92fe00640 1 -- 172.21.15.1:0/3676828360 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff93c004020 con 0x5558de4e44d0 2024-08-28T20:30:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.122+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff93c02e440 con 0x5558de4e44d0 2024-08-28T20:30:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.123+0000 7ff92fe00640 1 -- 172.21.15.1:0/3676828360 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff93c046050 con 0x5558de4e44d0 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.123+0000 7ff95c80e740 10 client.26141 fetch_fsmap learned FSMap version 50 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.123+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5558de92cbd0 con 0x5558de4e44d0 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.123+0000 7ff92fe00640 1 -- 172.21.15.1:0/3676828360 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff93c02e440 con 0x5558de4e44d0 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff92fe00640 1 -- 172.21.15.1:0/3676828360 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ff93c036050 con 0x5558de4e44d0 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff95c80e740 10 client.26141 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff95c80e740 10 client.26141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff95c80e740 20 client.26141 populate_metadata read hostname 'smithi001' 2024-08-28T20:30:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de5051b0 0x5558de92f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:30:56.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff95c80e740 4 client.26141 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:30:56.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558de8190a0 con 0x5558de5051b0 2024-08-28T20:30:56.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.124+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de5051b0 0x5558de92f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:30:56.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.125+0000 7ff94ea00640 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de5051b0 0x5558de92f350 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bab3159f9bea63b server_cookie=6e21eb79b14ef6d5 in_seq=0 out_seq=0 2024-08-28T20:30:56.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.125+0000 7ff92fe00640 10 client.26141 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.137+0000 7ff92fe00640 1 -- 172.21.15.1:0/3676828360 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558de8190a0 con 0x5558de5051b0 2024-08-28T20:30:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.137+0000 7ff92fe00640 10 client.26141 handle_command_reply: tid=0 2024-08-28T20:30:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.137+0000 7ff95c80e740 1 client.26141 shutdown 2024-08-28T20:30:56.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.137+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 msgr2=0x5558de8bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.137+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8bbbb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00bbb0 tx=0x7ff93c005270 comp rx=0 tx=0).stop 2024-08-28T20:30:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 shutdown_connections 2024-08-28T20:30:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5558de5051b0 0x5558de92f350 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5558de4f9300 0x5558de8ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de4e44d0 0x5558de8bbbb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 --2- 172.21.15.1:0/3676828360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5558de4dc2f0 0x5558de8bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 >> 172.21.15.1:0/3676828360 conn(0x5558de8a19c0 msgr2=0x5558de8aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff92fe00640 0 client.26141 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:30:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 shutdown_connections 2024-08-28T20:30:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.138+0000 7ff95c80e740 1 -- 172.21.15.1:0/3676828360 wait complete. 2024-08-28T20:30:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.139+0000 7ff95c80e740 20 client.26141 trim_cache size 0 max 16384 2024-08-28T20:30:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:30:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:30:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:30:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.139+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff9340b4bb0 msgr2=0x7ff9340b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.139+0000 7ff955600640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff9340b4bb0 0x7ff9340b70c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff94802f500 tx=0x7ff948031af0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95006b620 msgr2=0x7ff9501a02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95006b620 0x7ff9501a02d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9f0 tx=0x7ff94000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 shutdown_connections 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff9340b4bb0 0x7ff9340b70c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9501043d0 0x7ff9501a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff950106f90 0x7ff9501a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 --2- 172.21.15.1:0/2254912419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95006b620 0x7ff9501a02d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:30:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 >> 172.21.15.1:0/2254912419 conn(0x7ff9500fdca0 msgr2=0x7ff9501052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:30:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 shutdown_connections 2024-08-28T20:30:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:30:56.140+0000 7ff955600640 1 -- 172.21.15.1:0/2254912419 wait complete. 2024-08-28T20:30:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:55 smithi001 ceph-mon[20984]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-08-28T20:30:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:55 smithi121 ceph-mon[25248]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-08-28T20:30:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:55 smithi007 ceph-mon[25357]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-08-28T20:30:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:57 smithi001 ceph-mon[20984]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 665 op/s 2024-08-28T20:30:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:57 smithi121 ceph-mon[25248]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 665 op/s 2024-08-28T20:30:58.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:57 smithi007 ceph-mon[25357]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 665 op/s 2024-08-28T20:30:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 750.0 s, 1571.4 tps, lat 63.715 ms stddev 78.506 2024-08-28T20:31:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:30:59 smithi121 ceph-mon[25248]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 654 op/s 2024-08-28T20:31:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:30:59 smithi007 ceph-mon[25357]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 654 op/s 2024-08-28T20:31:00.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:30:59 smithi001 ceph-mon[20984]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 654 op/s 2024-08-28T20:31:02.278 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:01 smithi001 ceph-mon[20984]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 646 op/s 2024-08-28T20:31:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:01 smithi007 ceph-mon[25357]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 646 op/s 2024-08-28T20:31:02.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:01 smithi121 ceph-mon[25248]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 646 op/s 2024-08-28T20:31:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 755.0 s, 1616.8 tps, lat 62.729 ms stddev 84.613 2024-08-28T20:31:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:03 smithi007 ceph-mon[25357]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.2 MiB/s wr, 590 op/s 2024-08-28T20:31:04.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:03 smithi001 ceph-mon[20984]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.2 MiB/s wr, 590 op/s 2024-08-28T20:31:04.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:03 smithi121 ceph-mon[25248]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.2 MiB/s wr, 590 op/s 2024-08-28T20:31:06.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:05 smithi007 ceph-mon[25357]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.7 MiB/s wr, 658 op/s 2024-08-28T20:31:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:05 smithi001 ceph-mon[20984]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.7 MiB/s wr, 658 op/s 2024-08-28T20:31:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:05 smithi121 ceph-mon[25248]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.7 MiB/s wr, 658 op/s 2024-08-28T20:31:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:08 smithi007 ceph-mon[25357]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 613 op/s 2024-08-28T20:31:08.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:08 smithi001 ceph-mon[20984]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 613 op/s 2024-08-28T20:31:08.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:08 smithi121 ceph-mon[25248]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 613 op/s 2024-08-28T20:31:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 760.0 s, 2467.4 tps, lat 40.223 ms stddev 57.449 2024-08-28T20:31:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.445+0000 7f4fa9200640 1 -- 172.21.15.1:0/1064705046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa41063f0 msgr2=0x7f4fa4108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.445+0000 7f4fa9200640 1 --2- 172.21.15.1:0/1064705046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa41063f0 0x7f4fa4108870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009900 tx=0x7f4f9002a420 comp rx=0 tx=0).stop 2024-08-28T20:31:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 -- 172.21.15.1:0/1064705046 shutdown_connections 2024-08-28T20:31:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 --2- 172.21.15.1:0/1064705046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa410b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 --2- 172.21.15.1:0/1064705046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa41063f0 0x7f4fa4108870 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 --2- 172.21.15.1:0/1064705046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fa406b620 0x7f4fa4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 -- 172.21.15.1:0/1064705046 >> 172.21.15.1:0/1064705046 conn(0x7f4fa40fdab0 msgr2=0x7f4fa40fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 -- 172.21.15.1:0/1064705046 shutdown_connections 2024-08-28T20:31:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.451+0000 7f4fa9200640 1 -- 172.21.15.1:0/1064705046 wait complete. 2024-08-28T20:31:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.452+0000 7f4fa9200640 1 Processor -- start 2024-08-28T20:31:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 -- start start 2024-08-28T20:31:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 0x7f4fa41034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fa41063f0 0x7f4fa4101db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa41022f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa410ef20 con 0x7f4fa41063f0 2024-08-28T20:31:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa410eda0 con 0x7f4fa406b620 2024-08-28T20:31:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa9200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa410f0a0 con 0x7f4fa4108fb0 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa41022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 0x7f4fa41034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa41022f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51714/0 (socket says 172.21.15.1:51714) 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa3e00640 1 -- 172.21.15.1:0/2177224440 learned_addr learned my addr 172.21.15.1:0/2177224440 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.453+0000 7f4fa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 0x7f4fa41034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51356/0 (socket says 172.21.15.1:51356) 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.454+0000 7f4fa3e00640 1 -- 172.21.15.1:0/2177224440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 msgr2=0x7f4fa41034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.454+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 0x7f4fa41034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.454+0000 7f4fa3e00640 1 -- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fa41063f0 msgr2=0x7f4fa4101db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.454+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fa41063f0 0x7f4fa4101db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.454+0000 7f4fa3e00640 1 -- 172.21.15.1:0/2177224440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa4102a20 con 0x7f4fa4108fb0 2024-08-28T20:31:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.454+0000 7f4fa3400640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 0x7f4fa41034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:31:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.456+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa41022f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00eaa0 tx=0x7f4f9c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.456+0000 7f4f9be00640 1 -- 172.21.15.1:0/2177224440 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00cdb0 con 0x7f4fa4108fb0 2024-08-28T20:31:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.456+0000 7f4f9be00640 1 -- 172.21.15.1:0/2177224440 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f9c005020 con 0x7f4fa4108fb0 2024-08-28T20:31:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.456+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa4073d20 con 0x7f4fa4108fb0 2024-08-28T20:31:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.456+0000 7f4f9be00640 1 -- 172.21.15.1:0/2177224440 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0116d0 con 0x7f4fa4108fb0 2024-08-28T20:31:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.456+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa4074270 con 0x7f4fa4108fb0 2024-08-28T20:31:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.463+0000 7f4fb1837740 1 Processor -- start 2024-08-28T20:31:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.465+0000 7f4f9be00640 1 -- 172.21.15.1:0/2177224440 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f4f9c0051d0 con 0x7f4fa4108fb0 2024-08-28T20:31:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 -- start start 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fa7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863bd92f0 0x558863fa8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863be14d0 0x558863fa9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558863f1af70 con 0x558863bd92f0 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558863f0a500 con 0x558863be14d0 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.466+0000 7f4fb1837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558863f0e4b0 con 0x558863c021b0 2024-08-28T20:31:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.467+0000 7f4fa2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fa7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.467+0000 7f4fa2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fa7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51728/0 (socket says 172.21.15.1:51728) 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.467+0000 7f4fa2a00640 1 -- 172.21.15.1:0/3791685697 learned_addr learned my addr 172.21.15.1:0/3791685697 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.467+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863be14d0 0x558863fa9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.468+0000 7f4fa2a00640 1 -- 172.21.15.1:0/3791685697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863be14d0 msgr2=0x558863fa9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.468+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863be14d0 0x558863fa9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.468+0000 7f4fa2a00640 1 -- 172.21.15.1:0/3791685697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863bd92f0 msgr2=0x558863fa8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.468+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863bd92f0 0x558863fa8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.468+0000 7f4fa2a00640 1 -- 172.21.15.1:0/3791685697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558863ec4c10 con 0x558863c021b0 2024-08-28T20:31:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.468+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fa7fa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4f900096c0 tx=0x7f4f90000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2ccab3ceae0bd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.469+0000 7f4f98c00640 1 -- 172.21.15.1:0/3791685697 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90046070 con 0x558863c021b0 2024-08-28T20:31:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.469+0000 7f4f98c00640 1 -- 172.21.15.1:0/3791685697 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f90005630 con 0x558863c021b0 2024-08-28T20:31:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.469+0000 7f4f98c00640 1 -- 172.21.15.1:0/3791685697 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9003bbd0 con 0x558863c021b0 2024-08-28T20:31:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.470+0000 7f4fb1837740 1 -- 172.21.15.1:0/3791685697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 msgr2=0x558863fa7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.470+0000 7f4fb1837740 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fa7fa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4f900096c0 tx=0x7f4f90000bc0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.471+0000 7f4f9be00640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f880b4ba0 0x7f4f880b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.471+0000 7f4fb1837740 1 -- 172.21.15.1:0/3791685697 shutdown_connections 2024-08-28T20:31:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.471+0000 7f4fb1837740 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863bd92f0 0x558863fa8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.471+0000 7f4fb1837740 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863be14d0 0x558863fa9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.471+0000 7f4fb1837740 1 --2- 172.21.15.1:0/3791685697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fa7fa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.471+0000 7f4fb1837740 1 -- 172.21.15.1:0/3791685697 >> 172.21.15.1:0/3791685697 conn(0x558863bf6300 msgr2=0x558863fa3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.472+0000 7f4f9be00640 1 -- 172.21.15.1:0/2177224440 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4f9c0e52d0 con 0x7f4fa4108fb0 2024-08-28T20:31:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.472+0000 7f4fb1837740 1 -- 172.21.15.1:0/3791685697 shutdown_connections 2024-08-28T20:31:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.472+0000 7f4fb1837740 1 -- 172.21.15.1:0/3791685697 wait complete. 2024-08-28T20:31:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.473+0000 7f4fb1837740 1 -- start start 2024-08-28T20:31:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.473+0000 7f4fb1837740 1 Processor -- start 2024-08-28T20:31:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.473+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f880b4ba0 0x7f4f880b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863bd92f0 0x558863fb15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fb1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 0x558863fb27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f880b4ba0 0x7f4f880b70b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004e10 tx=0x7f4f90005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558863e43ab0 con 0x558863be14d0 2024-08-28T20:31:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558863eb1320 con 0x558863c021b0 2024-08-28T20:31:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558863fa9c20 con 0x558863bd92f0 2024-08-28T20:31:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.474+0000 7f4fb1837740 10 client.0 _ll_register_callbacks cb 0x558863eb76a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 0x558863fb27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 0x558863fb27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51382/0 (socket says 172.21.15.1:51382) 2024-08-28T20:31:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 -- 172.21.15.1:0/1024710839 learned_addr learned my addr 172.21.15.1:0/1024710839 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3400640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863bd92f0 0x558863fb15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fb1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 -- 172.21.15.1:0/1024710839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863bd92f0 msgr2=0x558863fb15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863bd92f0 0x558863fb15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 -- 172.21.15.1:0/1024710839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 msgr2=0x558863fb1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.475+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fb1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.476+0000 7f4fa3e00640 1 -- 172.21.15.1:0/1024710839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558863c6d790 con 0x558863c021b0 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.476+0000 7f4fa3400640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863bd92f0 0x558863fb15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.476+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 0x558863fb27d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0a8f60 tx=0x7f4f9c0ab960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6023c3481745f5ac server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.476+0000 7f4f8d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:31:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.476+0000 7f4f8d600640 1 -- 172.21.15.1:0/1024710839 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c01f040 con 0x558863c021b0 2024-08-28T20:31:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.477+0000 7f4f8d600640 1 -- 172.21.15.1:0/1024710839 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4f9c0b01c0 con 0x558863c021b0 2024-08-28T20:31:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.477+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f90005630 con 0x558863c021b0 2024-08-28T20:31:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.477+0000 7f4f8d600640 1 -- 172.21.15.1:0/1024710839 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4f9c0b5010 con 0x558863c021b0 2024-08-28T20:31:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.477+0000 7f4fb1837740 10 client.26153 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.477+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558863ce6620 con 0x558863c021b0 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.477+0000 7f4f8d600640 1 -- 172.21.15.1:0/1024710839 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f90005630 con 0x558863c021b0 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.478+0000 7f4f8d600640 1 -- 172.21.15.1:0/1024710839 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f4f9c00f040 con 0x558863c021b0 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.479+0000 7f4fb1837740 10 client.26153 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.479+0000 7f4fb1837740 10 client.26153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.479+0000 7f4fb1837740 20 client.26153 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.479+0000 7f4fb1837740 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863bc0d80 0x558863fbec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.479+0000 7f4fb1837740 4 client.26153 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:31:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.479+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558863f1cec0 con 0x558863bc0d80 2024-08-28T20:31:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.481+0000 7f4fa3400640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863bc0d80 0x558863fbec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.483+0000 7f4fa3400640 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863bc0d80 0x558863fbec00 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29bb827e03fae087 server_cookie=dd365f02c459735 in_seq=0 out_seq=0 2024-08-28T20:31:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.484+0000 7f4f8d600640 10 client.26153 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.484+0000 7f4f8d600640 1 -- 172.21.15.1:0/1024710839 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558863f1cec0 con 0x558863bc0d80 2024-08-28T20:31:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.484+0000 7f4f8d600640 10 client.26153 handle_command_reply: tid=0 2024-08-28T20:31:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.484+0000 7f4fb1837740 1 client.26153 shutdown 2024-08-28T20:31:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.487+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 msgr2=0x558863fb27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.487+0000 7f4fb1837740 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 0x558863fb27d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0a8f60 tx=0x7f4f9c0ab960 comp rx=0 tx=0).stop 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 shutdown_connections 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4fb1837740 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863bc0d80 0x558863fbec00 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4fb1837740 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fb1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4fb1837740 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863c021b0 0x558863fb27d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4fb1837740 1 --2- 172.21.15.1:0/1024710839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863bd92f0 0x558863fb15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 >> 172.21.15.1:0/1024710839 conn(0x558863bf6300 msgr2=0x558863fa1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.488+0000 7f4f8d600640 0 client.26153 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.489+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 shutdown_connections 2024-08-28T20:31:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.489+0000 7f4fb1837740 1 -- 172.21.15.1:0/1024710839 wait complete. 2024-08-28T20:31:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.490+0000 7f4fb1837740 20 client.26153 trim_cache size 0 max 16384 2024-08-28T20:31:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.519+0000 7f4fb1837740 1 Processor -- start 2024-08-28T20:31:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.519+0000 7f4fb1837740 1 -- start start 2024-08-28T20:31:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.520+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fa8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.520+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fa4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fb1837740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa41c4a60 con 0x558863be14d0 2024-08-28T20:31:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fb1837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa41c2330 con 0x558863bd92f0 2024-08-28T20:31:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fb1837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa41a9630 con 0x558863c021b0 2024-08-28T20:31:09.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa2a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fa4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51740/0 (socket says 172.21.15.1:51740) 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa3e00640 1 -- 172.21.15.1:0/794784919 learned_addr learned my addr 172.21.15.1:0/794784919 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa3400640 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fa8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa3400640 1 -- 172.21.15.1:0/794784919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 msgr2=0x558863fac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.521+0000 7f4fa3400640 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4fa3400640 1 -- 172.21.15.1:0/794784919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 msgr2=0x558863fa4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4fa3400640 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fa4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4fa3400640 1 -- 172.21.15.1:0/794784919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558863f9dbe0 con 0x558863bd92f0 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4fa3400640 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fa8650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x558863fbf370 tx=0x7f4f94014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb59e1f326e6cf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4f8fe00640 1 -- 172.21.15.1:0/794784919 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94004220 con 0x558863bd92f0 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4f8fe00640 1 -- 172.21.15.1:0/794784919 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558863f1cec0 con 0x558863bd92f0 2024-08-28T20:31:09.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.522+0000 7f4f8fe00640 1 -- 172.21.15.1:0/794784919 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94004b20 con 0x558863bd92f0 2024-08-28T20:31:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.523+0000 7f4fb1837740 1 -- 172.21.15.1:0/794784919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 msgr2=0x558863fa8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.523+0000 7f4fb1837740 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fa8650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x558863fbf370 tx=0x7f4f94014040 comp rx=0 tx=0).stop 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 -- 172.21.15.1:0/794784919 shutdown_connections 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863be14d0 0x558863fa4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863c021b0 0x558863fac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 --2- 172.21.15.1:0/794784919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fa8650 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 -- 172.21.15.1:0/794784919 >> 172.21.15.1:0/794784919 conn(0x558863bf6300 msgr2=0x558863fa7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 -- 172.21.15.1:0/794784919 shutdown_connections 2024-08-28T20:31:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.524+0000 7f4fb1837740 1 -- 172.21.15.1:0/794784919 wait complete. 2024-08-28T20:31:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.525+0000 7f4fb1837740 1 -- start start 2024-08-28T20:31:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.525+0000 7f4fb1837740 1 Processor -- start 2024-08-28T20:31:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.527+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fb90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.527+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863be14d0 0x558863fb7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.527+0000 7f4fb1837740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863c021b0 0x558863fb82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.528+0000 7f4fa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fb90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.528+0000 7f4fa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fb90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51406/0 (socket says 172.21.15.1:51406) 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.528+0000 7f4fa2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863be14d0 0x558863fb7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.528+0000 7f4fa2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863be14d0 0x558863fb7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51742/0 (socket says 172.21.15.1:51742) 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa41c07f0 con 0x558863c021b0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa41c1c60 con 0x558863bd92f0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa41c0ec0 con 0x558863be14d0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fb1837740 10 client.0 _ll_register_callbacks cb 0x7f4f9c0ab530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fa3e00640 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863c021b0 0x558863fb82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fa3400640 1 -- 172.21.15.1:0/2139539008 learned_addr learned my addr 172.21.15.1:0/2139539008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fa3400640 1 -- 172.21.15.1:0/2139539008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863be14d0 msgr2=0x558863fb7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fa3400640 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863be14d0 0x558863fb7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fa3400640 1 -- 172.21.15.1:0/2139539008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863c021b0 msgr2=0x558863fb82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.529+0000 7f4fa3400640 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863c021b0 0x558863fb82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.530+0000 7f4fa3400640 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558863fb8810 con 0x558863bd92f0 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.530+0000 7f4fa3400640 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fb90d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f94005c50 tx=0x7f4f94005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d70948bfe8ecb490 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.530+0000 7f4f8d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.530+0000 7f4f8d600640 1 -- 172.21.15.1:0/2139539008 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94004aa0 con 0x558863bd92f0 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.531+0000 7f4f8d600640 1 -- 172.21.15.1:0/2139539008 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f4f94004c40 con 0x558863bd92f0 2024-08-28T20:31:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.531+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558863f1cec0 con 0x558863bd92f0 2024-08-28T20:31:09.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.531+0000 7f4f8d600640 1 -- 172.21.15.1:0/2139539008 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4f94004e40 con 0x558863bd92f0 2024-08-28T20:31:09.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.531+0000 7f4fb1837740 10 client.26159 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:09.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558863fb75b0 con 0x558863bd92f0 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4f8d600640 1 -- 172.21.15.1:0/2139539008 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558863f1cec0 con 0x558863bd92f0 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4f8d600640 1 -- 172.21.15.1:0/2139539008 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f4f94011560 con 0x558863bd92f0 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 10 client.26159 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 10 client.26159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 20 client.26159 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863b961c0 0x55886402bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 4 client.26159 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.532+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558863f18960 con 0x558863b961c0 2024-08-28T20:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.533+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863b961c0 0x55886402bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.535+0000 7f4fa2a00640 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863b961c0 0x55886402bad0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767afc15ae8de223 server_cookie=da0ce2311f7c26f7 in_seq=0 out_seq=0 2024-08-28T20:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.535+0000 7f4f8d600640 10 client.26159 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.547+0000 7f4f8d600640 1 -- 172.21.15.1:0/2139539008 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558863f18960 con 0x558863b961c0 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.547+0000 7f4f8d600640 10 client.26159 handle_command_reply: tid=0 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.547+0000 7f4fb1837740 1 client.26159 shutdown 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.547+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 msgr2=0x558863fb90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.547+0000 7f4fb1837740 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fb90d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f94005c50 tx=0x7f4f94005250 comp rx=0 tx=0).stop 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 shutdown_connections 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558863b961c0 0x55886402bad0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558863c021b0 0x558863fb82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558863be14d0 0x558863fb7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 --2- 172.21.15.1:0/2139539008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558863bd92f0 0x558863fb90d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 >> 172.21.15.1:0/2139539008 conn(0x558863bf6300 msgr2=0x558863faf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4f8d600640 0 client.26159 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 shutdown_connections 2024-08-28T20:31:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.548+0000 7f4fb1837740 1 -- 172.21.15.1:0/2139539008 wait complete. 2024-08-28T20:31:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.549+0000 7f4fb1837740 20 client.26159 trim_cache size 0 max 16384 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.551+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f880b4ba0 msgr2=0x7f4f880b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.551+0000 7f4fa9200640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f880b4ba0 0x7f4f880b70b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004e10 tx=0x7f4f90005fd0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.551+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 msgr2=0x7f4fa41022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:09.552 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.551+0000 7f4fa9200640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa41022f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00eaa0 tx=0x7f4f9c00ef60 comp rx=0 tx=0).stop 2024-08-28T20:31:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 shutdown_connections 2024-08-28T20:31:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f4f880b4ba0 0x7f4f880b70b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fa41063f0 0x7f4fa4101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fa4108fb0 0x7f4fa41022f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 --2- 172.21.15.1:0/2177224440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa406b620 0x7f4fa41034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 >> 172.21.15.1:0/2177224440 conn(0x7f4fa40fdab0 msgr2=0x7f4fa4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 shutdown_connections 2024-08-28T20:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:09.552+0000 7f4fa9200640 1 -- 172.21.15.1:0/2177224440 wait complete. 2024-08-28T20:31:10.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:10 smithi007 ceph-mon[25357]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 631 op/s 2024-08-28T20:31:10.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:10 smithi121 ceph-mon[25248]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 631 op/s 2024-08-28T20:31:10.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:10 smithi001 ceph-mon[20984]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 631 op/s 2024-08-28T20:31:12.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:12 smithi007 ceph-mon[25357]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 704 op/s 2024-08-28T20:31:12.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:12 smithi001 ceph-mon[20984]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 704 op/s 2024-08-28T20:31:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:12 smithi121 ceph-mon[25248]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 704 op/s 2024-08-28T20:31:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 765.0 s, 1583.6 tps, lat 62.989 ms stddev 85.576 2024-08-28T20:31:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:14 smithi007 ceph-mon[25357]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.3 MiB/s wr, 620 op/s 2024-08-28T20:31:14.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:14 smithi001 ceph-mon[20984]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.3 MiB/s wr, 620 op/s 2024-08-28T20:31:14.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:14 smithi121 ceph-mon[25248]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.3 MiB/s wr, 620 op/s 2024-08-28T20:31:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:16 smithi007 ceph-mon[25357]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 674 op/s 2024-08-28T20:31:16.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:16 smithi001 ceph-mon[20984]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 674 op/s 2024-08-28T20:31:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:16 smithi121 ceph-mon[25248]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 674 op/s 2024-08-28T20:31:18.322 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:18 smithi007 ceph-mon[25357]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.0 MiB/s wr, 692 op/s 2024-08-28T20:31:18.962 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:18 smithi121 ceph-mon[25248]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.0 MiB/s wr, 692 op/s 2024-08-28T20:31:18.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:18 smithi001 ceph-mon[20984]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.0 MiB/s wr, 692 op/s 2024-08-28T20:31:18.963 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 770.0 s, 1533.6 tps, lat 64.663 ms stddev 84.239 2024-08-28T20:31:20.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:20 smithi007 ceph-mon[25357]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.8 MiB/s wr, 687 op/s 2024-08-28T20:31:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:20 smithi121 ceph-mon[25248]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.8 MiB/s wr, 687 op/s 2024-08-28T20:31:20.482 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:20 smithi001 ceph-mon[20984]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.8 MiB/s wr, 687 op/s 2024-08-28T20:31:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:22 smithi007 ceph-mon[25357]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-08-28T20:31:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:22 smithi001 ceph-mon[20984]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-08-28T20:31:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:22 smithi121 ceph-mon[25248]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-08-28T20:31:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.867+0000 7ff751e00640 1 -- 172.21.15.1:0/2069817186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c06b620 msgr2=0x7ff74c105ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.867+0000 7ff751e00640 1 --2- 172.21.15.1:0/2069817186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c06b620 0x7ff74c105ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009900 tx=0x7ff73c02a400 comp rx=0 tx=0).stop 2024-08-28T20:31:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.870+0000 7ff751e00640 1 -- 172.21.15.1:0/2069817186 shutdown_connections 2024-08-28T20:31:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.870+0000 7ff751e00640 1 --2- 172.21.15.1:0/2069817186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c106430 0x7ff74c1088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.870+0000 7ff751e00640 1 --2- 172.21.15.1:0/2069817186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c108ff0 0x7ff74c10b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.870+0000 7ff751e00640 1 --2- 172.21.15.1:0/2069817186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c06b620 0x7ff74c105ef0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.870+0000 7ff751e00640 1 -- 172.21.15.1:0/2069817186 >> 172.21.15.1:0/2069817186 conn(0x7ff74c0fdaf0 msgr2=0x7ff74c0fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.871+0000 7ff751e00640 1 -- 172.21.15.1:0/2069817186 shutdown_connections 2024-08-28T20:31:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.871+0000 7ff751e00640 1 -- 172.21.15.1:0/2069817186 wait complete. 2024-08-28T20:31:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.873+0000 7ff751e00640 1 Processor -- start 2024-08-28T20:31:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.874+0000 7ff751e00640 1 -- start start 2024-08-28T20:31:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.876+0000 7ff751e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c06b620 0x7ff74c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff74aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c06b620 0x7ff74c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff751e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c106430 0x7ff74c197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff751e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c108ff0 0x7ff74c198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff751e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c10cdb0 con 0x7ff74c106430 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff751e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c10cc30 con 0x7ff74c06b620 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff751e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c10cf30 con 0x7ff74c108ff0 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.877+0000 7ff74aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c06b620 0x7ff74c197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55056/0 (socket says 172.21.15.1:55056) 2024-08-28T20:31:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74aa00640 1 -- 172.21.15.1:0/3104254300 learned_addr learned my addr 172.21.15.1:0/3104254300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74b400640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c108ff0 0x7ff74c198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74b400640 1 -- 172.21.15.1:0/3104254300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c06b620 msgr2=0x7ff74c197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74b400640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c06b620 0x7ff74c197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74b400640 1 -- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c106430 msgr2=0x7ff74c197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74b400640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c106430 0x7ff74c197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.878+0000 7ff74b400640 1 -- 172.21.15.1:0/3104254300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c1993c0 con 0x7ff74c108ff0 2024-08-28T20:31:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.879+0000 7ff74b400640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c108ff0 0x7ff74c198ba0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff744009fd0 tx=0x7ff74400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.879+0000 7ff750a00640 1 -- 172.21.15.1:0/3104254300 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74400ce20 con 0x7ff74c108ff0 2024-08-28T20:31:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.879+0000 7ff750a00640 1 -- 172.21.15.1:0/3104254300 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff744005020 con 0x7ff74c108ff0 2024-08-28T20:31:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.879+0000 7ff750a00640 1 -- 172.21.15.1:0/3104254300 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744010690 con 0x7ff74c108ff0 2024-08-28T20:31:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.880+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74c1996b0 con 0x7ff74c108ff0 2024-08-28T20:31:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.880+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74c19fda0 con 0x7ff74c108ff0 2024-08-28T20:31:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.885+0000 7ff758df1740 1 Processor -- start 2024-08-28T20:31:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.888+0000 7ff750a00640 1 -- 172.21.15.1:0/3104254300 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ff7440054d0 con 0x7ff74c108ff0 2024-08-28T20:31:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.890+0000 7ff758df1740 1 -- start start 2024-08-28T20:31:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff758df1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7875f1b0 0x55ec78b0d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff758df1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78b0dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff758df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7873e4d0 0x55ec78b0e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff758df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ec78a77f70 con 0x55ec7873e4d0 2024-08-28T20:31:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff758df1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec78a67500 con 0x55ec7875f1b0 2024-08-28T20:31:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff758df1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ec78a6b4b0 con 0x55ec787362f0 2024-08-28T20:31:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff750a00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff7300b4bb0 0x7ff7300b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.891+0000 7ff750a00640 1 -- 172.21.15.1:0/3104254300 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff7440e58d0 con 0x7ff74c108ff0 2024-08-28T20:31:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.892+0000 7ff742000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7875f1b0 0x55ec78b0d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.892+0000 7ff742000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7875f1b0 0x55ec78b0d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55060/0 (socket says 172.21.15.1:55060) 2024-08-28T20:31:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.892+0000 7ff742000640 1 -- 172.21.15.1:0/3830407959 learned_addr learned my addr 172.21.15.1:0/3830407959 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.892+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78b0dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.893+0000 7ff74aa00640 1 -- 172.21.15.1:0/3830407959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7875f1b0 msgr2=0x55ec78b0d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.893+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7875f1b0 0x55ec78b0d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.893+0000 7ff74aa00640 1 -- 172.21.15.1:0/3830407959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7873e4d0 msgr2=0x55ec78b0e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.893+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7873e4d0 0x55ec78b0e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.893+0000 7ff74aa00640 1 -- 172.21.15.1:0/3830407959 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec78a21c10 con 0x55ec787362f0 2024-08-28T20:31:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.894+0000 7ff74b400640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff7300b4bb0 0x7ff7300b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.895+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78b0dbc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff73c000c00 tx=0x7ff73c004150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fafa9fd34c3f4137 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.895+0000 7ff73be00640 1 -- 172.21.15.1:0/3830407959 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c035030 con 0x55ec787362f0 2024-08-28T20:31:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.895+0000 7ff73be00640 1 -- 172.21.15.1:0/3830407959 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff73c0054f0 con 0x55ec787362f0 2024-08-28T20:31:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.895+0000 7ff73be00640 1 -- 172.21.15.1:0/3830407959 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c035030 con 0x55ec787362f0 2024-08-28T20:31:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 -- 172.21.15.1:0/3830407959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 msgr2=0x55ec78b0dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78b0dbc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff73c000c00 tx=0x7ff73c004150 comp rx=0 tx=0).stop 2024-08-28T20:31:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 -- 172.21.15.1:0/3830407959 shutdown_connections 2024-08-28T20:31:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7873e4d0 0x55ec78b0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78b0dbc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 --2- 172.21.15.1:0/3830407959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7875f1b0 0x55ec78b0d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff758df1740 1 -- 172.21.15.1:0/3830407959 >> 172.21.15.1:0/3830407959 conn(0x55ec78753300 msgr2=0x55ec78b08fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.897+0000 7ff74b400640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff7300b4bb0 0x7ff7300b70c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff74401a040 tx=0x7ff744005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.899+0000 7ff758df1740 1 -- 172.21.15.1:0/3830407959 shutdown_connections 2024-08-28T20:31:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.899+0000 7ff758df1740 1 -- 172.21.15.1:0/3830407959 wait complete. 2024-08-28T20:31:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.900+0000 7ff758df1740 1 -- start start 2024-08-28T20:31:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.900+0000 7ff758df1740 1 Processor -- start 2024-08-28T20:31:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec787362f0 0x55ec78b16b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 0x55ec78b17230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec7875f1b0 0x55ec78b17da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ec789a0ab0 con 0x55ec787362f0 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec78a0e320 con 0x55ec7873e4d0 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ec78b0f1d0 con 0x55ec7875f1b0 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.901+0000 7ff758df1740 10 client.0 _ll_register_callbacks cb 0x55ec78a47e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.902+0000 7ff74aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 0x55ec78b17230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.902+0000 7ff74aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 0x55ec78b17230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55062/0 (socket says 172.21.15.1:55062) 2024-08-28T20:31:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.902+0000 7ff74aa00640 1 -- 172.21.15.1:0/4195624165 learned_addr learned my addr 172.21.15.1:0/4195624165 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.902+0000 7ff742000640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec7875f1b0 0x55ec78b17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.902+0000 7ff74aa00640 1 -- 172.21.15.1:0/4195624165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec7875f1b0 msgr2=0x55ec78b17da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.903+0000 7ff74aa00640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec7875f1b0 0x55ec78b17da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.903+0000 7ff74aa00640 1 -- 172.21.15.1:0/4195624165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec787362f0 msgr2=0x55ec78b16b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.903+0000 7ff74aa00640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec787362f0 0x55ec78b16b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.903+0000 7ff74aa00640 1 -- 172.21.15.1:0/4195624165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec787ca790 con 0x55ec7873e4d0 2024-08-28T20:31:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.903+0000 7ff742000640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec7875f1b0 0x55ec78b17da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:31:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.903+0000 7ff74aa00640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 0x55ec78b17230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff73c004fb0 tx=0x7ff73c004fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1f5ef34ca82080e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.904+0000 7ff738c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:31:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.904+0000 7ff738c00640 1 -- 172.21.15.1:0/4195624165 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c051060 con 0x55ec7873e4d0 2024-08-28T20:31:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.904+0000 7ff738c00640 1 -- 172.21.15.1:0/4195624165 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff73c0035f0 con 0x55ec7873e4d0 2024-08-28T20:31:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.905+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff73c0054f0 con 0x55ec7873e4d0 2024-08-28T20:31:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.906+0000 7ff738c00640 1 -- 172.21.15.1:0/4195624165 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff73c035040 con 0x55ec7873e4d0 2024-08-28T20:31:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.906+0000 7ff758df1740 10 client.26171 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.906+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ec78843620 con 0x55ec7873e4d0 2024-08-28T20:31:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.907+0000 7ff738c00640 1 -- 172.21.15.1:0/4195624165 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff73c0054f0 con 0x55ec7873e4d0 2024-08-28T20:31:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff738c00640 1 -- 172.21.15.1:0/4195624165 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ff73c04b030 con 0x55ec7873e4d0 2024-08-28T20:31:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff758df1740 10 client.26171 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff758df1740 10 client.26171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff758df1740 20 client.26171 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff758df1740 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec7871dd80 0x55ec78b23e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff758df1740 4 client.26171 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:31:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.908+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec78a79ec0 con 0x55ec7871dd80 2024-08-28T20:31:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.909+0000 7ff742000640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec7871dd80 0x55ec78b23e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.911+0000 7ff738c00640 10 client.26171 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.911+0000 7ff742000640 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec7871dd80 0x55ec78b23e80 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43e9394979bc7801 server_cookie=46a06cb8820325e0 in_seq=0 out_seq=0 2024-08-28T20:31:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.912+0000 7ff738c00640 1 -- 172.21.15.1:0/4195624165 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec78a79ec0 con 0x55ec7871dd80 2024-08-28T20:31:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.912+0000 7ff738c00640 10 client.26171 handle_command_reply: tid=0 2024-08-28T20:31:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.912+0000 7ff758df1740 1 client.26171 shutdown 2024-08-28T20:31:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 msgr2=0x55ec78b17230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 0x55ec78b17230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff73c004fb0 tx=0x7ff73c004fe0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 shutdown_connections 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec7871dd80 0x55ec78b23e80 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec7875f1b0 0x55ec78b17da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec7873e4d0 0x55ec78b17230 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 --2- 172.21.15.1:0/4195624165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec787362f0 0x55ec78b16b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 >> 172.21.15.1:0/4195624165 conn(0x55ec78753300 msgr2=0x55ec78afed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.913+0000 7ff738c00640 0 client.26171 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.914+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 shutdown_connections 2024-08-28T20:31:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.914+0000 7ff758df1740 1 -- 172.21.15.1:0/4195624165 wait complete. 2024-08-28T20:31:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.914+0000 7ff758df1740 20 client.26171 trim_cache size 0 max 16384 2024-08-28T20:31:22.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 Processor -- start 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 -- start start 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78afed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78aff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec786f31c0 0x55ec78aff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1ab210 con 0x55ec7875f1b0 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1a8ae0 con 0x55ec786f31c0 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.943+0000 7ff758df1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1a68f0 con 0x55ec787362f0 2024-08-28T20:31:22.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.944+0000 7ff742000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78afed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.944+0000 7ff742000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78afed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33870/0 (socket says 172.21.15.1:33870) 2024-08-28T20:31:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.944+0000 7ff742000640 1 -- 172.21.15.1:0/1535139416 learned_addr learned my addr 172.21.15.1:0/1535139416 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:22.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.944+0000 7ff742000640 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec786f31c0 0x55ec78aff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.946+0000 7ff74aa00640 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78aff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.946+0000 7ff742000640 1 -- 172.21.15.1:0/1535139416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec786f31c0 msgr2=0x55ec78aff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.946+0000 7ff742000640 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec786f31c0 0x55ec78aff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.946+0000 7ff742000640 1 -- 172.21.15.1:0/1535139416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 msgr2=0x55ec78aff2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.946+0000 7ff742000640 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78aff2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.946+0000 7ff742000640 1 -- 172.21.15.1:0/1535139416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec78b1f040 con 0x55ec787362f0 2024-08-28T20:31:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.947+0000 7ff742000640 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78afed70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ec78b244c0 tx=0x7ff734009b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=855b1393275a35d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.949+0000 7ff73b400640 1 -- 172.21.15.1:0/1535139416 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff734008b80 con 0x55ec787362f0 2024-08-28T20:31:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.949+0000 7ff73b400640 1 -- 172.21.15.1:0/1535139416 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff734008d20 con 0x55ec787362f0 2024-08-28T20:31:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.949+0000 7ff73b400640 1 -- 172.21.15.1:0/1535139416 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73401e610 con 0x55ec787362f0 2024-08-28T20:31:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.950+0000 7ff758df1740 1 -- 172.21.15.1:0/1535139416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 msgr2=0x55ec78afed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.950+0000 7ff758df1740 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78afed70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ec78b244c0 tx=0x7ff734009b40 comp rx=0 tx=0).stop 2024-08-28T20:31:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 -- 172.21.15.1:0/1535139416 shutdown_connections 2024-08-28T20:31:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78aff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec786f31c0 0x55ec78aff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 --2- 172.21.15.1:0/1535139416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec787362f0 0x55ec78afed70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 -- 172.21.15.1:0/1535139416 >> 172.21.15.1:0/1535139416 conn(0x55ec78753300 msgr2=0x55ec78afb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 -- 172.21.15.1:0/1535139416 shutdown_connections 2024-08-28T20:31:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.951+0000 7ff758df1740 1 -- 172.21.15.1:0/1535139416 wait complete. 2024-08-28T20:31:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.952+0000 7ff758df1740 1 -- start start 2024-08-28T20:31:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.952+0000 7ff758df1740 1 Processor -- start 2024-08-28T20:31:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.953+0000 7ff758df1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 0x55ec78b1e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.953+0000 7ff758df1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec787362f0 0x55ec78b1d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff758df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78b1d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff742000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 0x55ec78b1e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff742000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 0x55ec78b1e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:33884/0 (socket says 172.21.15.1:33884) 2024-08-28T20:31:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff742000640 1 -- 172.21.15.1:0/3809977834 learned_addr learned my addr 172.21.15.1:0/3809977834 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1a6fa0 con 0x55ec7875f1b0 2024-08-28T20:31:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1a8410 con 0x55ec787362f0 2024-08-28T20:31:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1a7670 con 0x55ec786f31c0 2024-08-28T20:31:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.954+0000 7ff74aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec787362f0 0x55ec78b1d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff758df1740 10 client.0 _ll_register_callbacks cb 0x7ff73c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff742000640 1 -- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec787362f0 msgr2=0x55ec78b1d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff742000640 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec787362f0 0x55ec78b1d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff742000640 1 -- 172.21.15.1:0/3809977834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 msgr2=0x55ec78b1d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff742000640 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78b1d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff742000640 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec78b1dd90 con 0x55ec786f31c0 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.955+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec787362f0 0x55ec78b1d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.956+0000 7ff742000640 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 0x55ec78b1e5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff734007630 tx=0x7ff734007660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=468f870f579b064f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.956+0000 7ff738c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.957+0000 7ff738c00640 1 -- 172.21.15.1:0/3809977834 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff734008ed0 con 0x55ec786f31c0 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.957+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff734008d20 con 0x55ec786f31c0 2024-08-28T20:31:22.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.957+0000 7ff738c00640 1 -- 172.21.15.1:0/3809977834 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff734009070 con 0x55ec786f31c0 2024-08-28T20:31:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.958+0000 7ff738c00640 1 -- 172.21.15.1:0/3809977834 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff734009270 con 0x55ec786f31c0 2024-08-28T20:31:22.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.959+0000 7ff758df1740 10 client.26152 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.959+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ec78b1cc00 con 0x55ec786f31c0 2024-08-28T20:31:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff738c00640 1 -- 172.21.15.1:0/3809977834 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff734008d20 con 0x55ec786f31c0 2024-08-28T20:31:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff738c00640 1 -- 172.21.15.1:0/3809977834 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ff73401d040 con 0x55ec786f31c0 2024-08-28T20:31:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff758df1740 10 client.26152 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff758df1740 10 client.26152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff758df1740 20 client.26152 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff758df1740 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec78b05470 0x55ec78b07890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff758df1740 4 client.26152 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:31:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.960+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec78a75960 con 0x55ec78b05470 2024-08-28T20:31:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.961+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec78b05470 0x55ec78b07890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.963+0000 7ff738c00640 10 client.26152 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:22.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:22.963+0000 7ff74aa00640 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec78b05470 0x55ec78b07890 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be68e4a337549244 server_cookie=c5b8a2572274cd73 in_seq=0 out_seq=0 2024-08-28T20:31:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff738c00640 1 -- 172.21.15.1:0/3809977834 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec78a75960 con 0x55ec78b05470 2024-08-28T20:31:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff738c00640 10 client.26152 handle_command_reply: tid=0 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 client.26152 shutdown 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 msgr2=0x55ec78b1e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 0x55ec78b1e5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff734007630 tx=0x7ff734007660 comp rx=0 tx=0).stop 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 shutdown_connections 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55ec78b05470 0x55ec78b07890 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec7875f1b0 0x55ec78b1d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec787362f0 0x55ec78b1d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 --2- 172.21.15.1:0/3809977834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec786f31c0 0x55ec78b1e5d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.019+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 >> 172.21.15.1:0/3809977834 conn(0x55ec78753300 msgr2=0x55ec78b11580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.020+0000 7ff738c00640 0 client.26152 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.020+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 shutdown_connections 2024-08-28T20:31:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.020+0000 7ff758df1740 1 -- 172.21.15.1:0/3809977834 wait complete. 2024-08-28T20:31:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.020+0000 7ff758df1740 20 client.26152 trim_cache size 0 max 16384 2024-08-28T20:31:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:31:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:31:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:31:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff7300b4bb0 msgr2=0x7ff7300b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff7300b4bb0 0x7ff7300b70c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff74401a040 tx=0x7ff744005f70 comp rx=0 tx=0).stop 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c108ff0 msgr2=0x7ff74c198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c108ff0 0x7ff74c198ba0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff744009fd0 tx=0x7ff74400ef10 comp rx=0 tx=0).stop 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 shutdown_connections 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff7300b4bb0 0x7ff7300b70c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c106430 0x7ff74c197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff74c108ff0 0x7ff74c198ba0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 --2- 172.21.15.1:0/3104254300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff74c06b620 0x7ff74c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.021+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 >> 172.21.15.1:0/3104254300 conn(0x7ff74c0fdaf0 msgr2=0x7ff74c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.022+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 shutdown_connections 2024-08-28T20:31:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:23.022+0000 7ff751e00640 1 -- 172.21.15.1:0/3104254300 wait complete. 2024-08-28T20:31:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 775.0 s, 1689.8 tps, lat 59.934 ms stddev 79.189 2024-08-28T20:31:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:24 smithi007 ceph-mon[25357]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.9 MiB/s wr, 600 op/s 2024-08-28T20:31:24.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:24 smithi001 ceph-mon[20984]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.9 MiB/s wr, 600 op/s 2024-08-28T20:31:24.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:24 smithi121 ceph-mon[25248]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.9 MiB/s wr, 600 op/s 2024-08-28T20:31:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:26 smithi007 ceph-mon[25357]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-08-28T20:31:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:26 smithi001 ceph-mon[20984]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-08-28T20:31:26.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:26 smithi121 ceph-mon[25248]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-08-28T20:31:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:28 smithi007 ceph-mon[25357]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:31:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:28 smithi001 ceph-mon[20984]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:31:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:28 smithi121 ceph-mon[25248]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 651 op/s 2024-08-28T20:31:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 780.0 s, 1873.0 tps, lat 52.782 ms stddev 65.466 2024-08-28T20:31:30.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:30 smithi001 ceph-mon[20984]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 657 op/s 2024-08-28T20:31:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:30 smithi121 ceph-mon[25248]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 657 op/s 2024-08-28T20:31:30.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:30 smithi007 ceph-mon[25357]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 657 op/s 2024-08-28T20:31:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:32 smithi001 ceph-mon[20984]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-08-28T20:31:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:32 smithi121 ceph-mon[25248]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-08-28T20:31:32.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:32 smithi007 ceph-mon[25357]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-08-28T20:31:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 785.0 s, 1936.8 tps, lat 52.287 ms stddev 68.845 2024-08-28T20:31:34.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:34 smithi001 ceph-mon[20984]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.3 MiB/s wr, 626 op/s 2024-08-28T20:31:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:34 smithi121 ceph-mon[25248]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.3 MiB/s wr, 626 op/s 2024-08-28T20:31:34.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:34 smithi007 ceph-mon[25357]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.3 MiB/s wr, 626 op/s 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 -- 172.21.15.1:0/3451251252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274106ed0 msgr2=0x7f827410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 --2- 172.21.15.1:0/3451251252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274106ed0 0x7f827410d870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f826c009ca0 tx=0x7f826c02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 -- 172.21.15.1:0/3451251252 shutdown_connections 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 --2- 172.21.15.1:0/3451251252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274106ed0 0x7f827410d870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 --2- 172.21.15.1:0/3451251252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f8274106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 --2- 172.21.15.1:0/3451251252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82741054b0 0x7f8274105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 -- 172.21.15.1:0/3451251252 >> 172.21.15.1:0/3451251252 conn(0x7f8274100df0 msgr2=0x7f82741032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 -- 172.21.15.1:0/3451251252 shutdown_connections 2024-08-28T20:31:36.304 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.301+0000 7f8273e00640 1 -- 172.21.15.1:0/3451251252 wait complete. 2024-08-28T20:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.302+0000 7f8273e00640 1 Processor -- start 2024-08-28T20:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.302+0000 7f8273e00640 1 -- start start 2024-08-28T20:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82741054b0 0x7f827419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f827419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8274106ed0 0x7f827419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8274111130 con 0x7f8274106ed0 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8274110fb0 con 0x7f82741054b0 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82741112b0 con 0x7f8274106530 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f827419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82741054b0 0x7f827419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f827419c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54872/0 (socket says 172.21.15.1:54872) 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 -- 172.21.15.1:0/1572518892 learned_addr learned my addr 172.21.15.1:0/1572518892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8273400640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8274106ed0 0x7f827419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 -- 172.21.15.1:0/1572518892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82741054b0 msgr2=0x7f827419bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82741054b0 0x7f827419bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 -- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8274106ed0 msgr2=0x7f827419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8274106ed0 0x7f827419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.303+0000 7f8272000640 1 -- 172.21.15.1:0/1572518892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827419d640 con 0x7f8274106530 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.304+0000 7f8273400640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8274106ed0 0x7f827419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.304+0000 7f8272000640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f827419c300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f826000e9f0 tx=0x7f826000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.304+0000 7f826b400640 1 -- 172.21.15.1:0/1572518892 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826000ccc0 con 0x7f8274106530 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.304+0000 7f826b400640 1 -- 172.21.15.1:0/1572518892 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82600108e0 con 0x7f8274106530 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.304+0000 7f826b400640 1 -- 172.21.15.1:0/1572518892 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260018880 con 0x7f8274106530 2024-08-28T20:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.305+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827419d930 con 0x7f8274106530 2024-08-28T20:31:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.305+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82741a3ed0 con 0x7f8274106530 2024-08-28T20:31:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.311+0000 7f8280897740 1 Processor -- start 2024-08-28T20:31:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.311+0000 7f8280897740 1 -- start start 2024-08-28T20:31:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8280897740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8280897740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8280897740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8280897740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fb4124df70 con 0x55fb40f351b0 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8280897740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb4123d500 con 0x55fb40f144d0 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8280897740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb412414b0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f826b400640 1 -- 172.21.15.1:0/1572518892 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f8260018a20 con 0x7f8274106530 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8273400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8272a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8272a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54886/0 (socket says 172.21.15.1:54886) 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8273400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60332/0 (socket says 172.21.15.1:60332) 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.312+0000 7f8272a00640 1 -- 172.21.15.1:0/2241816570 learned_addr learned my addr 172.21.15.1:0/2241816570 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8272000640 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8272a00640 1 -- 172.21.15.1:0/2241816570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 msgr2=0x55fb412e4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8272a00640 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8272a00640 1 -- 172.21.15.1:0/2241816570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 msgr2=0x55fb412e37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8272a00640 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412e37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8272a00640 1 -- 172.21.15.1:0/2241816570 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb411f7c10 con 0x55fb40f0c2f0 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.313+0000 7f8273400640 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f8272a00640 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3e20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f826400ad00 tx=0x7f826400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=441ec66f707928 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f826b400640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82580b4c70 0x7f82580b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f826b400640 1 -- 172.21.15.1:0/1572518892 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f82600e5400 con 0x7f8274106530 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f8272000640 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f825fe00640 1 -- 172.21.15.1:0/2241816570 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826401d070 con 0x55fb40f0c2f0 2024-08-28T20:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f825fe00640 1 -- 172.21.15.1:0/2241816570 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8264018af0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f825fe00640 1 -- 172.21.15.1:0/2241816570 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264010b40 con 0x55fb40f0c2f0 2024-08-28T20:31:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.314+0000 7f8273400640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82580b4c70 0x7f82580b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 -- 172.21.15.1:0/2241816570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 msgr2=0x55fb412e3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8273400640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82580b4c70 0x7f82580b7180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f826c031a90 tx=0x7f826c031a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3e20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f826400ad00 tx=0x7f826400f790 comp rx=0 tx=0).stop 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 -- 172.21.15.1:0/2241816570 shutdown_connections 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3e20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 --2- 172.21.15.1:0/2241816570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 -- 172.21.15.1:0/2241816570 >> 172.21.15.1:0/2241816570 conn(0x55fb40f29300 msgr2=0x55fb412d6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 -- 172.21.15.1:0/2241816570 shutdown_connections 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 -- 172.21.15.1:0/2241816570 wait complete. 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.316+0000 7f8280897740 1 -- start start 2024-08-28T20:31:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 Processor -- start 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412ece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f144d0 0x55fb412ed550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f351b0 0x55fb412ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fb41176ab0 con 0x55fb40f144d0 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb411e4320 con 0x55fb40f351b0 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb412e5490 con 0x55fb40f0c2f0 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8280897740 10 client.0 _ll_register_callbacks cb 0x55fb411ea6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8272a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8272a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54896/0 (socket says 172.21.15.1:54896) 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8273400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f351b0 0x55fb412ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.317+0000 7f8272a00640 1 -- 172.21.15.1:0/2455394865 learned_addr learned my addr 172.21.15.1:0/2455394865 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272000640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f144d0 0x55fb412ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272a00640 1 -- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f351b0 msgr2=0x55fb412ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272a00640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f351b0 0x55fb412ee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272a00640 1 -- 172.21.15.1:0/2455394865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f144d0 msgr2=0x55fb412ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272a00640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f144d0 0x55fb412ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272a00640 1 -- 172.21.15.1:0/2455394865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb40fa0790 con 0x55fb40f0c2f0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8273400640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f351b0 0x55fb412ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f8272a00640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412ece90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f82640058c0 tx=0x7f8264018670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e622fe6dee5393ff server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.318+0000 7f825cc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f825cc00640 1 -- 172.21.15.1:0/2455394865 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264026020 con 0x55fb40f0c2f0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f825cc00640 1 -- 172.21.15.1:0/2455394865 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8264010880 con 0x55fb40f0c2f0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8264018af0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f825cc00640 1 -- 172.21.15.1:0/2455394865 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f8264031050 con 0x55fb40f0c2f0 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f8280897740 10 client.26164 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55fb41019620 con 0x55fb40f0c2f0 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.319+0000 7f825cc00640 1 -- 172.21.15.1:0/2455394865 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8264018af0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f825cc00640 1 -- 172.21.15.1:0/2455394865 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f82640046c0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8280897740 10 client.26164 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8280897740 10 client.26164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8280897740 20 client.26164 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8280897740 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ef3d80 0x55fb412fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8280897740 4 client.26164 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb4124fec0 con 0x55fb40ef3d80 2024-08-28T20:31:36.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.320+0000 7f8272000640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ef3d80 0x55fb412fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.323+0000 7f825cc00640 10 client.26164 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.323+0000 7f8272000640 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ef3d80 0x55fb412fa2d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e94e6edc93854e2 server_cookie=bc1a2b8fc3e0230 in_seq=0 out_seq=0 2024-08-28T20:31:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.324+0000 7f825cc00640 1 -- 172.21.15.1:0/2455394865 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb4124fec0 con 0x55fb40ef3d80 2024-08-28T20:31:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.324+0000 7f825cc00640 10 client.26164 handle_command_reply: tid=0 2024-08-28T20:31:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.324+0000 7f8280897740 1 client.26164 shutdown 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.324+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 msgr2=0x55fb412ece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.324+0000 7f8280897740 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412ece90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f82640058c0 tx=0x7f8264018670 comp rx=0 tx=0).stop 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 shutdown_connections 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ef3d80 0x55fb412fa2d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f825cc00640 0 client.26164 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f144d0 0x55fb412ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f351b0 0x55fb412ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 --2- 172.21.15.1:0/2455394865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412ece90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 >> 172.21.15.1:0/2455394865 conn(0x55fb40f29300 msgr2=0x55fb412d4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 shutdown_connections 2024-08-28T20:31:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.325+0000 7f8280897740 1 -- 172.21.15.1:0/2455394865 wait complete. 2024-08-28T20:31:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.326+0000 7f8280897740 20 client.26164 trim_cache size 0 max 16384 2024-08-28T20:31:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.348+0000 7f8280897740 1 Processor -- start 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.349+0000 7f8280897740 1 -- start start 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8280897740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8280897740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8280897740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8280897740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8254010d10 con 0x55fb40f351b0 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8280897740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f825400e5e0 con 0x55fb40f144d0 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8280897740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f825400c430 con 0x55fb40f0c2f0 2024-08-28T20:31:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8272a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8272a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54906/0 (socket says 172.21.15.1:54906) 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8272a00640 1 -- 172.21.15.1:0/4274711452 learned_addr learned my addr 172.21.15.1:0/4274711452 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.350+0000 7f8272000640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8272000640 1 -- 172.21.15.1:0/4274711452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 msgr2=0x55fb412e3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8272000640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8272000640 1 -- 172.21.15.1:0/4274711452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 msgr2=0x55fb412f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8273400640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8272000640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8272000640 1 -- 172.21.15.1:0/4274711452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb412ee430 con 0x55fb40f144d0 2024-08-28T20:31:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8272a00640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:31:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.352+0000 7f8273400640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:31:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.353+0000 7f8272000640 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e3c90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f82600e2f40 tx=0x7f82600e7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445792bc91682cb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.353+0000 7f825f400640 1 -- 172.21.15.1:0/4274711452 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82600abe20 con 0x55fb40f144d0 2024-08-28T20:31:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.353+0000 7f825f400640 1 -- 172.21.15.1:0/4274711452 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82600b0690 con 0x55fb40f144d0 2024-08-28T20:31:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.353+0000 7f825f400640 1 -- 172.21.15.1:0/4274711452 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82600b4f10 con 0x55fb40f144d0 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 -- 172.21.15.1:0/4274711452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 msgr2=0x55fb412e3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e3c90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f82600e2f40 tx=0x7f82600e7040 comp rx=0 tx=0).stop 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 -- 172.21.15.1:0/4274711452 shutdown_connections 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f144d0 0x55fb412e3c90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 --2- 172.21.15.1:0/4274711452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f0c2f0 0x55fb412e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.354+0000 7f8280897740 1 -- 172.21.15.1:0/4274711452 >> 172.21.15.1:0/4274711452 conn(0x55fb40f29300 msgr2=0x55fb412e45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.355+0000 7f8280897740 1 -- 172.21.15.1:0/4274711452 shutdown_connections 2024-08-28T20:31:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.355+0000 7f8280897740 1 -- 172.21.15.1:0/4274711452 wait complete. 2024-08-28T20:31:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.355+0000 7f8280897740 1 -- start start 2024-08-28T20:31:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.355+0000 7f8280897740 1 Processor -- start 2024-08-28T20:31:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 0x55fb412f0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f144d0 0x55fb412f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f825400caa0 con 0x55fb40f351b0 2024-08-28T20:31:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f825400df10 con 0x55fb40f0c2f0 2024-08-28T20:31:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f825400d170 con 0x55fb40f144d0 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8280897740 10 client.0 _ll_register_callbacks cb 0x7f826400ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8272a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 0x55fb412f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8272a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 0x55fb412f0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:36058/0 (socket says 172.21.15.1:36058) 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.356+0000 7f8272a00640 1 -- 172.21.15.1:0/3532993892 learned_addr learned my addr 172.21.15.1:0/3532993892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272000640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f144d0 0x55fb412f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8273400640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272a00640 1 -- 172.21.15.1:0/3532993892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f144d0 msgr2=0x55fb412f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272a00640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f144d0 0x55fb412f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272a00640 1 -- 172.21.15.1:0/3532993892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 msgr2=0x55fb412f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272a00640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272a00640 1 -- 172.21.15.1:0/3532993892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb412f4fa0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f8272a00640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 0x55fb412f0590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82640058c0 tx=0x7f8264004890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8aae57c14f3675 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f825cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:31:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.357+0000 7f825cc00640 1 -- 172.21.15.1:0/3532993892 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264026040 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.358+0000 7f825cc00640 1 -- 172.21.15.1:0/3532993892 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8264010560 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.358+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82600b0690 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.358+0000 7f825cc00640 1 -- 172.21.15.1:0/3532993892 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f826401d040 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.358+0000 7f8280897740 10 client.26195 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.358+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55fb412f23c0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.358+0000 7f825cc00640 1 -- 172.21.15.1:0/3532993892 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82600b0690 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f825cc00640 1 -- 172.21.15.1:0/3532993892 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f8264004cd0 con 0x55fb40f0c2f0 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8280897740 10 client.26195 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8280897740 10 client.26195 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8280897740 20 client.26195 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8280897740 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ec91c0 0x55fb41367320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8280897740 4 client.26195 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:31:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb4124b960 con 0x55fb40ec91c0 2024-08-28T20:31:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8272000640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ec91c0 0x55fb41367320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f8272000640 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ec91c0 0x55fb41367320 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea4a10679fd300d server_cookie=7bf429fbc611de3c in_seq=0 out_seq=0 2024-08-28T20:31:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.359+0000 7f825cc00640 10 client.26195 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f825cc00640 1 -- 172.21.15.1:0/3532993892 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb4124b960 con 0x55fb40ec91c0 2024-08-28T20:31:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f825cc00640 10 client.26195 handle_command_reply: tid=0 2024-08-28T20:31:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 client.26195 shutdown 2024-08-28T20:31:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 msgr2=0x55fb412f0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 0x55fb412f0590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82640058c0 tx=0x7f8264004890 comp rx=0 tx=0).stop 2024-08-28T20:31:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 shutdown_connections 2024-08-28T20:31:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55fb40ec91c0 0x55fb41367320 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fb40f351b0 0x55fb412f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb40f144d0 0x55fb412f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 --2- 172.21.15.1:0/3532993892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb40f0c2f0 0x55fb412f0590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 >> 172.21.15.1:0/3532993892 conn(0x55fb40f29300 msgr2=0x55fb412ec9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.372+0000 7f825cc00640 0 client.26195 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.373+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 shutdown_connections 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.373+0000 7f8280897740 1 -- 172.21.15.1:0/3532993892 wait complete. 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.373+0000 7f8280897740 20 client.26195 trim_cache size 0 max 16384 2024-08-28T20:31:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:31:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:31:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:31:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:31:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82580b4c70 msgr2=0x7f82580b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82580b4c70 0x7f82580b7180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f826c031a90 tx=0x7f826c031a20 comp rx=0 tx=0).stop 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 msgr2=0x7f827419c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f827419c300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f826000e9f0 tx=0x7f826000edf0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 shutdown_connections 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f82580b4c70 0x7f82580b7180 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8274106ed0 0x7f827419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8274106530 0x7f827419c300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 --2- 172.21.15.1:0/1572518892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82741054b0 0x7f827419bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 >> 172.21.15.1:0/1572518892 conn(0x7f8274100df0 msgr2=0x7f8274109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 shutdown_connections 2024-08-28T20:31:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:36.374+0000 7f8273e00640 1 -- 172.21.15.1:0/1572518892 wait complete. 2024-08-28T20:31:36.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:36 smithi001 ceph-mon[20984]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 662 op/s 2024-08-28T20:31:36.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:36 smithi121 ceph-mon[25248]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 662 op/s 2024-08-28T20:31:36.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:36 smithi007 ceph-mon[25357]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 662 op/s 2024-08-28T20:31:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:38 smithi001 ceph-mon[20984]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-08-28T20:31:38.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:38 smithi121 ceph-mon[25248]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-08-28T20:31:38.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:38 smithi007 ceph-mon[25357]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-08-28T20:31:38.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 790.0 s, 1238.4 tps, lat 79.448 ms stddev 99.181 2024-08-28T20:31:40.367 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:40 smithi007 ceph-mon[25357]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.4 MiB/s wr, 665 op/s 2024-08-28T20:31:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:40 smithi001 ceph-mon[20984]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.4 MiB/s wr, 665 op/s 2024-08-28T20:31:40.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:40 smithi121 ceph-mon[25248]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.4 MiB/s wr, 665 op/s 2024-08-28T20:31:41.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:41 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:31:41.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:41 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:31:41.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:41 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:31:42.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:42 smithi001 ceph-mon[20984]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.9 MiB/s wr, 628 op/s 2024-08-28T20:31:42.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:42 smithi121 ceph-mon[25248]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.9 MiB/s wr, 628 op/s 2024-08-28T20:31:42.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:42 smithi007 ceph-mon[25357]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.9 MiB/s wr, 628 op/s 2024-08-28T20:31:43.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:31:43.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:31:43.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:31:43.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:31:43.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:31:43.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:31:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:31:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:31:43.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:31:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 795.0 s, 1422.8 tps, lat 70.965 ms stddev 80.654 2024-08-28T20:31:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:44 smithi001 ceph-mon[20984]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.5 MiB/s wr, 584 op/s 2024-08-28T20:31:44.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:44 smithi121 ceph-mon[25248]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.5 MiB/s wr, 584 op/s 2024-08-28T20:31:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:44 smithi007 ceph-mon[25357]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.5 MiB/s wr, 584 op/s 2024-08-28T20:31:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:46 smithi001 ceph-mon[20984]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 645 op/s 2024-08-28T20:31:46.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:46 smithi121 ceph-mon[25248]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 645 op/s 2024-08-28T20:31:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:46 smithi007 ceph-mon[25357]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 645 op/s 2024-08-28T20:31:48.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:48 smithi001 ceph-mon[20984]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.4 MiB/s wr, 596 op/s 2024-08-28T20:31:48.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:48 smithi121 ceph-mon[25248]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.4 MiB/s wr, 596 op/s 2024-08-28T20:31:48.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:48 smithi007 ceph-mon[25357]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.4 MiB/s wr, 596 op/s 2024-08-28T20:31:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 800.0 s, 1615.8 tps, lat 62.162 ms stddev 76.571 2024-08-28T20:31:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 -- 172.21.15.1:0/334845503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 msgr2=0x7fbd901047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 --2- 172.21.15.1:0/334845503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 0x7fbd901047c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009900 tx=0x7fbd7c02a410 comp rx=0 tx=0).stop 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 -- 172.21.15.1:0/334845503 shutdown_connections 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 --2- 172.21.15.1:0/334845503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 0x7fbd9010b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 --2- 172.21.15.1:0/334845503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 0x7fbd901047c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 --2- 172.21.15.1:0/334845503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 0x7fbd901037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 -- 172.21.15.1:0/334845503 >> 172.21.15.1:0/334845503 conn(0x7fbd900fec50 msgr2=0x7fbd90101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 -- 172.21.15.1:0/334845503 shutdown_connections 2024-08-28T20:31:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.684+0000 7fbd95600640 1 -- 172.21.15.1:0/334845503 wait complete. 2024-08-28T20:31:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 Processor -- start 2024-08-28T20:31:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 -- start start 2024-08-28T20:31:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 0x7fbd901a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 0x7fbd901a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 0x7fbd901a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9010ef10 con 0x7fbd90103330 2024-08-28T20:31:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9010ed90 con 0x7fbd901043b0 2024-08-28T20:31:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.686+0000 7fbd95600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9010f090 con 0x7fbd90104d50 2024-08-28T20:31:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.687+0000 7fbd8fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 0x7fbd901a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.687+0000 7fbd94c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 0x7fbd901a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.687+0000 7fbd94c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 0x7fbd901a1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53766/0 (socket says 172.21.15.1:53766) 2024-08-28T20:31:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.687+0000 7fbd94c00640 1 -- 172.21.15.1:0/814809126 learned_addr learned my addr 172.21.15.1:0/814809126 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.688+0000 7fbd8fe00640 1 -- 172.21.15.1:0/814809126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 msgr2=0x7fbd901a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.688+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 0x7fbd901a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.688+0000 7fbd8fe00640 1 -- 172.21.15.1:0/814809126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 msgr2=0x7fbd901a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.688+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 0x7fbd901a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.688+0000 7fbd8fe00640 1 -- 172.21.15.1:0/814809126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd901a1b40 con 0x7fbd90103330 2024-08-28T20:31:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.689+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 0x7fbd901a0100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000d6d0 tx=0x7fbd8000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.690+0000 7fbd8cc00640 1 -- 172.21.15.1:0/814809126 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80017070 con 0x7fbd90103330 2024-08-28T20:31:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.690+0000 7fbd8cc00640 1 -- 172.21.15.1:0/814809126 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd80009820 con 0x7fbd90103330 2024-08-28T20:31:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.690+0000 7fbd8cc00640 1 -- 172.21.15.1:0/814809126 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80004c40 con 0x7fbd90103330 2024-08-28T20:31:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.690+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd901a1e30 con 0x7fbd90103330 2024-08-28T20:31:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.690+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd901a8520 con 0x7fbd90103330 2024-08-28T20:31:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.697+0000 7fbd9dc8c740 1 Processor -- start 2024-08-28T20:31:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 -- start start 2024-08-28T20:31:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83ec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80254d0 0x55dda83ed160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dda835ef70 con 0x55dda80254d0 2024-08-28T20:31:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dda834e500 con 0x55dda80461b0 2024-08-28T20:31:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.701+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dda83524b0 con 0x55dda801d2f0 2024-08-28T20:31:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.702+0000 7fbd94c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.702+0000 7fbd94c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83ebfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:38052/0 (socket says 172.21.15.1:38052) 2024-08-28T20:31:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.702+0000 7fbd94c00640 1 -- 172.21.15.1:0/2949084821 learned_addr learned my addr 172.21.15.1:0/2949084821 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.703+0000 7fbd8f400640 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80254d0 0x55dda83ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.705+0000 7fbd8cc00640 1 -- 172.21.15.1:0/814809126 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fbd80005220 con 0x7fbd90103330 2024-08-28T20:31:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.706+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.706+0000 7fbd8fe00640 1 -- 172.21.15.1:0/2949084821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 msgr2=0x55dda83ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.706+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.706+0000 7fbd8fe00640 1 -- 172.21.15.1:0/2949084821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80254d0 msgr2=0x55dda83ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.706+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80254d0 0x55dda83ed160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.707+0000 7fbd8fe00640 1 -- 172.21.15.1:0/2949084821 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda8308c10 con 0x55dda801d2f0 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.707+0000 7fbd8cc00640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbd740b4ba0 0x7fbd740b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.708+0000 7fbd8cc00640 1 -- 172.21.15.1:0/814809126 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbd800e49a0 con 0x7fbd90103330 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.708+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83ec610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd800e2460 tx=0x7fbd800ed680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3185272d738a51bf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.708+0000 7fbd85200640 1 -- 172.21.15.1:0/2949084821 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80020070 con 0x55dda801d2f0 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.708+0000 7fbd85200640 1 -- 172.21.15.1:0/2949084821 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd800aaed0 con 0x55dda801d2f0 2024-08-28T20:31:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.708+0000 7fbd85200640 1 -- 172.21.15.1:0/2949084821 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80020070 con 0x55dda801d2f0 2024-08-28T20:31:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.709+0000 7fbd94c00640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbd740b4ba0 0x7fbd740b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.709+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2949084821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 msgr2=0x55dda83ec610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.709+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83ec610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd800e2460 tx=0x7fbd800ed680 comp rx=0 tx=0).stop 2024-08-28T20:31:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.710+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2949084821 shutdown_connections 2024-08-28T20:31:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.710+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80254d0 0x55dda83ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.710+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83ec610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.710+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2949084821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.710+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2949084821 >> 172.21.15.1:0/2949084821 conn(0x55dda803a300 msgr2=0x55dda83e7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.711+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2949084821 shutdown_connections 2024-08-28T20:31:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.711+0000 7fbd94c00640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbd740b4ba0 0x7fbd740b70b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbd88005f40 tx=0x7fbd88009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.711+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2949084821 wait complete. 2024-08-28T20:31:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.712+0000 7fbd9dc8c740 1 -- start start 2024-08-28T20:31:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.712+0000 7fbd9dc8c740 1 Processor -- start 2024-08-28T20:31:49.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.715+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda801d2f0 0x55dda83f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dda8287ab0 con 0x55dda80461b0 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dda82f5320 con 0x55dda801d2f0 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dda83edc80 con 0x55dda80254d0 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd9dc8c740 10 client.0 _ll_register_callbacks cb 0x55dda82fb6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53778/0 (socket says 172.21.15.1:53778) 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd8f400640 1 -- 172.21.15.1:0/2186368274 learned_addr learned my addr 172.21.15.1:0/2186368274 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda801d2f0 0x55dda83f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.717+0000 7fbd94c00640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd8f400640 1 -- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda801d2f0 msgr2=0x55dda83f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd8f400640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda801d2f0 0x55dda83f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd8f400640 1 -- 172.21.15.1:0/2186368274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 msgr2=0x55dda83f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd8f400640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd8f400640 1 -- 172.21.15.1:0/2186368274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda80b1790 con 0x55dda80254d0 2024-08-28T20:31:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd8f400640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83f5cd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c031500 tx=0x7fbd7c0317d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8606e5434551e363 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.718+0000 7fbd79600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:31:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.719+0000 7fbd79600640 1 -- 172.21.15.1:0/2186368274 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c035030 con 0x55dda80254d0 2024-08-28T20:31:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.719+0000 7fbd79600640 1 -- 172.21.15.1:0/2186368274 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbd7c004040 con 0x55dda80254d0 2024-08-28T20:31:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.719+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd800aaed0 con 0x55dda80254d0 2024-08-28T20:31:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.720+0000 7fbd79600640 1 -- 172.21.15.1:0/2186368274 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbd7c004240 con 0x55dda80254d0 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.720+0000 7fbd9dc8c740 10 client.26182 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.720+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55dda812a620 con 0x55dda80254d0 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd79600640 1 -- 172.21.15.1:0/2186368274 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd800aaed0 con 0x55dda80254d0 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd79600640 1 -- 172.21.15.1:0/2186368274 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fbd7c04c020 con 0x55dda80254d0 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd9dc8c740 10 client.26182 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd9dc8c740 10 client.26182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd9dc8c740 20 client.26182 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda8004d80 0x55dda8402e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd9dc8c740 4 client.26182 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:31:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.721+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dda8360ec0 con 0x55dda8004d80 2024-08-28T20:31:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.722+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda8004d80 0x55dda8402e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.723+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda8004d80 0x55dda8402e70 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db4150b3cd357f2 server_cookie=70c514acf28e3ced in_seq=0 out_seq=0 2024-08-28T20:31:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.723+0000 7fbd79600640 10 client.26182 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.724+0000 7fbd79600640 1 -- 172.21.15.1:0/2186368274 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dda8360ec0 con 0x55dda8004d80 2024-08-28T20:31:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.724+0000 7fbd79600640 10 client.26182 handle_command_reply: tid=0 2024-08-28T20:31:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.724+0000 7fbd9dc8c740 1 client.26182 shutdown 2024-08-28T20:31:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.724+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 msgr2=0x55dda83f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.724+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83f5cd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c031500 tx=0x7fbd7c0317d0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 shutdown_connections 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda8004d80 0x55dda8402e70 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83f5cd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/2186368274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda801d2f0 0x55dda83f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 >> 172.21.15.1:0/2186368274 conn(0x55dda803a300 msgr2=0x55dda83e5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd79600640 0 client.26182 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.726+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 shutdown_connections 2024-08-28T20:31:49.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.727+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/2186368274 wait complete. 2024-08-28T20:31:49.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.727+0000 7fbd9dc8c740 20 client.26182 trim_cache size 0 max 16384 2024-08-28T20:31:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 Processor -- start 2024-08-28T20:31:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 -- start start 2024-08-28T20:31:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda801d2f0 0x55dda83f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83fd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901b3bd0 con 0x55dda801d2f0 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901b14a0 con 0x55dda80461b0 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.757+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901af2f0 con 0x55dda80254d0 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53782/0 (socket says 172.21.15.1:53782) 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 -- 172.21.15.1:0/3294871663 learned_addr learned my addr 172.21.15.1:0/3294871663 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd94c00640 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda801d2f0 0x55dda83f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 -- 172.21.15.1:0/3294871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 msgr2=0x55dda83e8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83e8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 -- 172.21.15.1:0/3294871663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda801d2f0 msgr2=0x55dda83f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda801d2f0 0x55dda83f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8f400640 1 -- 172.21.15.1:0/3294871663 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda83f6bb0 con 0x55dda80254d0 2024-08-28T20:31:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.758+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda801d2f0 0x55dda83f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:31:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.759+0000 7fbd8f400640 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83fd720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c004b20 tx=0x7fbd7c009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a0d79f02d707a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.759+0000 7fbd7be00640 1 -- 172.21.15.1:0/3294871663 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c035040 con 0x55dda80254d0 2024-08-28T20:31:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.759+0000 7fbd7be00640 1 -- 172.21.15.1:0/3294871663 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd7c0054b0 con 0x55dda80254d0 2024-08-28T20:31:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.759+0000 7fbd7be00640 1 -- 172.21.15.1:0/3294871663 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c003a10 con 0x55dda80254d0 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3294871663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 msgr2=0x55dda83fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83fd720 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c004b20 tx=0x7fbd7c009230 comp rx=0 tx=0).stop 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3294871663 shutdown_connections 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80461b0 0x55dda83e8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda80254d0 0x55dda83fd720 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3294871663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda801d2f0 0x55dda83f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3294871663 >> 172.21.15.1:0/3294871663 conn(0x55dda803a300 msgr2=0x55dda83f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.760+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3294871663 shutdown_connections 2024-08-28T20:31:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.761+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3294871663 wait complete. 2024-08-28T20:31:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.761+0000 7fbd9dc8c740 1 -- start start 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.761+0000 7fbd9dc8c740 1 Processor -- start 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83fd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 0x55dda83fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901af960 con 0x55dda80461b0 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901b0dd0 con 0x55dda80254d0 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901b0030 con 0x55dda801d2f0 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd9dc8c740 10 client.0 _ll_register_callbacks cb 0x7fbd7c005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:31:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 0x55dda83fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd8fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83fd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 0x55dda83fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:38082/0 (socket says 172.21.15.1:38082) 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd8f400640 1 -- 172.21.15.1:0/3854258886 learned_addr learned my addr 172.21.15.1:0/3854258886 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.762+0000 7fbd94c00640 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.763+0000 7fbd8f400640 1 -- 172.21.15.1:0/3854258886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 msgr2=0x55dda83fd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.763+0000 7fbd8f400640 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83fd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.763+0000 7fbd8f400640 1 -- 172.21.15.1:0/3854258886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 msgr2=0x55dda83f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.763+0000 7fbd8f400640 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.763+0000 7fbd8f400640 1 -- 172.21.15.1:0/3854258886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda83f97d0 con 0x55dda80254d0 2024-08-28T20:31:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.765+0000 7fbd8f400640 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 0x55dda83fd6f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0092a0 tx=0x7fbd7c0314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eca4a78ea96d9ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:31:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.765+0000 7fbd79600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.766+0000 7fbd79600640 1 -- 172.21.15.1:0/3854258886 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c05b070 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.766+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c0054b0 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.766+0000 7fbd79600640 1 -- 172.21.15.1:0/3854258886 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fbd7c03b670 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.767+0000 7fbd79600640 1 -- 172.21.15.1:0/3854258886 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbd7c067050 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.767+0000 7fbd9dc8c740 10 client.26210 fetch_fsmap learned FSMap version 50 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.767+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55dda83fadc0 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd79600640 1 -- 172.21.15.1:0/3854258886 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd7c0054b0 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd79600640 1 -- 172.21.15.1:0/3854258886 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fbd7c04c030 con 0x55dda80254d0 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd9dc8c740 10 client.26210 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd9dc8c740 10 client.26210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd9dc8c740 20 client.26210 populate_metadata read hostname 'smithi001' 2024-08-28T20:31:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda7fda1c0 0x55dda8481080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:31:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd9dc8c740 4 client.26210 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:31:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dda835c960 con 0x55dda7fda1c0 2024-08-28T20:31:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.768+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda7fda1c0 0x55dda8481080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:31:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.769+0000 7fbd8fe00640 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda7fda1c0 0x55dda8481080 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6365a52dbee9b5da server_cookie=af9e944de9bd89e1 in_seq=0 out_seq=0 2024-08-28T20:31:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.769+0000 7fbd79600640 10 client.26210 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd79600640 1 -- 172.21.15.1:0/3854258886 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dda835c960 con 0x55dda7fda1c0 2024-08-28T20:31:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd79600640 10 client.26210 handle_command_reply: tid=0 2024-08-28T20:31:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 client.26210 shutdown 2024-08-28T20:31:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 msgr2=0x55dda83fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 0x55dda83fd6f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0092a0 tx=0x7fbd7c0314a0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 shutdown_connections 2024-08-28T20:31:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dda7fda1c0 0x55dda8481080 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dda80461b0 0x55dda83f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dda80254d0 0x55dda83fd6f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 --2- 172.21.15.1:0/3854258886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dda801d2f0 0x55dda83fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd79600640 0 client.26210 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:31:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.780+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 >> 172.21.15.1:0/3854258886 conn(0x55dda803a300 msgr2=0x55dda83f0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.781+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 shutdown_connections 2024-08-28T20:31:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.781+0000 7fbd9dc8c740 1 -- 172.21.15.1:0/3854258886 wait complete. 2024-08-28T20:31:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.781+0000 7fbd9dc8c740 20 client.26210 trim_cache size 0 max 16384 2024-08-28T20:31:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:31:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:31:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:31:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:31:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbd740b4ba0 msgr2=0x7fbd740b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbd740b4ba0 0x7fbd740b70b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbd88005f40 tx=0x7fbd88009680 comp rx=0 tx=0).stop 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 msgr2=0x7fbd901a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 0x7fbd901a0100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000d6d0 tx=0x7fbd8000db90 comp rx=0 tx=0).stop 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 shutdown_connections 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fbd740b4ba0 0x7fbd740b70b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd90104d50 0x7fbd901a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd901043b0 0x7fbd901a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 --2- 172.21.15.1:0/814809126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd90103330 0x7fbd901a0100 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:31:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 >> 172.21.15.1:0/814809126 conn(0x7fbd900fec50 msgr2=0x7fbd901056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:31:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 shutdown_connections 2024-08-28T20:31:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:31:49.782+0000 7fbd95600640 1 -- 172.21.15.1:0/814809126 wait complete. 2024-08-28T20:31:50.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:50 smithi001 ceph-mon[20984]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.9 MiB/s wr, 634 op/s 2024-08-28T20:31:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:50 smithi121 ceph-mon[25248]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.9 MiB/s wr, 634 op/s 2024-08-28T20:31:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:50 smithi007 ceph-mon[25357]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.9 MiB/s wr, 634 op/s 2024-08-28T20:31:52.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:52 smithi001 ceph-mon[20984]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-08-28T20:31:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:52 smithi121 ceph-mon[25248]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-08-28T20:31:52.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:52 smithi007 ceph-mon[25357]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-08-28T20:31:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 805.0 s, 1632.0 tps, lat 60.572 ms stddev 71.300 2024-08-28T20:31:54.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:54 smithi001 ceph-mon[20984]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6.0 MiB/s wr, 620 op/s 2024-08-28T20:31:54.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:54 smithi121 ceph-mon[25248]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6.0 MiB/s wr, 620 op/s 2024-08-28T20:31:54.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:54 smithi007 ceph-mon[25357]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6.0 MiB/s wr, 620 op/s 2024-08-28T20:31:56.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:56 smithi001 ceph-mon[20984]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 654 op/s 2024-08-28T20:31:56.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:56 smithi121 ceph-mon[25248]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 654 op/s 2024-08-28T20:31:56.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:56 smithi007 ceph-mon[25357]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 654 op/s 2024-08-28T20:31:58.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:58 smithi001 ceph-mon[20984]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.3 MiB/s wr, 663 op/s 2024-08-28T20:31:58.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:58 smithi121 ceph-mon[25248]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.3 MiB/s wr, 663 op/s 2024-08-28T20:31:58.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:58 smithi007 ceph-mon[25357]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 6.3 MiB/s wr, 663 op/s 2024-08-28T20:31:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 810.0 s, 1314.4 tps, lat 76.519 ms stddev 89.133 2024-08-28T20:31:59.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:31:59 smithi007 ceph-mon[25357]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-08-28T20:31:59.730 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:31:59 smithi121 ceph-mon[25248]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-08-28T20:31:59.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:31:59 smithi001 ceph-mon[20984]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-08-28T20:32:01.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:01 smithi001 ceph-mon[20984]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.6 MiB/s wr, 622 op/s 2024-08-28T20:32:01.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:01 smithi121 ceph-mon[25248]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.6 MiB/s wr, 622 op/s 2024-08-28T20:32:02.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:01 smithi007 ceph-mon[25357]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.6 MiB/s wr, 622 op/s 2024-08-28T20:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.081+0000 7fe89da00640 1 -- 172.21.15.1:0/799473619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 msgr2=0x7fe898108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.081+0000 7fe89da00640 1 --2- 172.21.15.1:0/799473619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 0x7fe898108870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe884009860 tx=0x7fe88402a340 comp rx=0 tx=0).stop 2024-08-28T20:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 -- 172.21.15.1:0/799473619 shutdown_connections 2024-08-28T20:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 --2- 172.21.15.1:0/799473619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89810b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 --2- 172.21.15.1:0/799473619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 0x7fe898108870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 --2- 172.21.15.1:0/799473619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe89806b620 0x7fe898105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 -- 172.21.15.1:0/799473619 >> 172.21.15.1:0/799473619 conn(0x7fe8980fdab0 msgr2=0x7fe8980fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 -- 172.21.15.1:0/799473619 shutdown_connections 2024-08-28T20:32:03.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.082+0000 7fe89da00640 1 -- 172.21.15.1:0/799473619 wait complete. 2024-08-28T20:32:03.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.083+0000 7fe89da00640 1 Processor -- start 2024-08-28T20:32:03.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 -- start start 2024-08-28T20:32:03.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe89806b620 0x7fe89819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 0x7fe89819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe898102ce0 con 0x7fe89806b620 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe898102b60 con 0x7fe8981063f0 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89da00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe898102e60 con 0x7fe898108fb0 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe897e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe89806b620 0x7fe89819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89819cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44938/0 (socket says 172.21.15.1:44938) 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe89d000640 1 -- 172.21.15.1:0/4064004849 learned_addr learned my addr 172.21.15.1:0/4064004849 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.084+0000 7fe897400640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 0x7fe89819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.085+0000 7fe89d000640 1 -- 172.21.15.1:0/4064004849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 msgr2=0x7fe89819c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.085+0000 7fe89d000640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 0x7fe89819c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.085+0000 7fe89d000640 1 -- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe89806b620 msgr2=0x7fe89819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.085+0000 7fe89d000640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe89806b620 0x7fe89819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.085+0000 7fe89d000640 1 -- 172.21.15.1:0/4064004849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89819d760 con 0x7fe898108fb0 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.085+0000 7fe89d000640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89819cf40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe890009fd0 tx=0x7fe89000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.086+0000 7fe894c00640 1 -- 172.21.15.1:0/4064004849 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890004b20 con 0x7fe898108fb0 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.086+0000 7fe894c00640 1 -- 172.21.15.1:0/4064004849 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe890003e20 con 0x7fe898108fb0 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.086+0000 7fe894c00640 1 -- 172.21.15.1:0/4064004849 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890004820 con 0x7fe898108fb0 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.087+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89819da50 con 0x7fe898108fb0 2024-08-28T20:32:03.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.087+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8981a4140 con 0x7fe898108fb0 2024-08-28T20:32:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.091+0000 7fe894c00640 1 -- 172.21.15.1:0/4064004849 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fe89001d020 con 0x7fe898108fb0 2024-08-28T20:32:03.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.092+0000 7fe8a61bd740 1 Processor -- start 2024-08-28T20:32:03.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.093+0000 7fe8a61bd740 1 -- start start 2024-08-28T20:32:03.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.093+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.093+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031957e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x563031958970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630318c1f70 con 0x5630315a91b0 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5630318b1500 con 0x5630315884d0 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5630318b54b0 con 0x5630315802f0 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe894c00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe87c0b4c20 0x7fe87c0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe897400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe894c00640 1 -- 172.21.15.1:0/4064004849 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe8900e50a0 con 0x7fe898108fb0 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe897e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031957e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe897400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52068/0 (socket says 172.21.15.1:52068) 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe897400640 1 -- 172.21.15.1:0/2774942687 learned_addr learned my addr 172.21.15.1:0/2774942687 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:03.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.094+0000 7fe897e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031957e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44948/0 (socket says 172.21.15.1:44948) 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe89d000640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe87c0b4c20 0x7fe87c0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe897400640 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x563031958970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe897e00640 1 -- 172.21.15.1:0/2774942687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 msgr2=0x563031958970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe897e00640 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x563031958970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe897e00640 1 -- 172.21.15.1:0/2774942687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 msgr2=0x5630319577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe897e00640 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.095+0000 7fe897e00640 1 -- 172.21.15.1:0/2774942687 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303186bc10 con 0x5630315802f0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.096+0000 7fe89d000640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe87c0b4c20 0x7fe87c0b7130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe890012020 tx=0x7fe890004240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.096+0000 7fe897e00640 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031957e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe888009c20 tx=0x7fe888011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b8d80e9e00a748 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.096+0000 7fe88d600640 1 -- 172.21.15.1:0/2774942687 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888004050 con 0x5630315802f0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.096+0000 7fe88d600640 1 -- 172.21.15.1:0/2774942687 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8880054d0 con 0x5630315802f0 2024-08-28T20:32:03.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.096+0000 7fe88d600640 1 -- 172.21.15.1:0/2774942687 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888004c20 con 0x5630315802f0 2024-08-28T20:32:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.097+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2774942687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 msgr2=0x563031957e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.097+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031957e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe888009c20 tx=0x7fe888011810 comp rx=0 tx=0).stop 2024-08-28T20:32:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2774942687 shutdown_connections 2024-08-28T20:32:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x563031958970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031957e20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2774942687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2774942687 >> 172.21.15.1:0/2774942687 conn(0x56303159d300 msgr2=0x563031953240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2774942687 shutdown_connections 2024-08-28T20:32:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.098+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2774942687 wait complete. 2024-08-28T20:32:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.099+0000 7fe8a61bd740 1 -- start start 2024-08-28T20:32:03.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.099+0000 7fe8a61bd740 1 Processor -- start 2024-08-28T20:32:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031960e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315884d0 0x563031961510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315a91b0 0x563031962010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630317eaab0 con 0x5630315884d0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563031858320 con 0x5630315a91b0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563031959490 con 0x5630315802f0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe8a61bd740 10 client.0 _ll_register_callbacks cb 0x56303185e6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031960e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031960e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44954/0 (socket says 172.21.15.1:44954) 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 -- 172.21.15.1:0/3231773343 learned_addr learned my addr 172.21.15.1:0/3231773343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315a91b0 0x563031962010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897e00640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315884d0 0x563031961510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 -- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315a91b0 msgr2=0x563031962010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315a91b0 0x563031962010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 -- 172.21.15.1:0/3231773343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315884d0 msgr2=0x563031961510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315884d0 0x563031961510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.100+0000 7fe897400640 1 -- 172.21.15.1:0/3231773343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563031614790 con 0x5630315802f0 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe897e00640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315884d0 0x563031961510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe897400640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031960e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe884035040 tx=0x7fe884030450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59772628d4f96538 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe882000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe882000640 1 -- 172.21.15.1:0/3231773343 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037040 con 0x5630315802f0 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8880054d0 con 0x5630315802f0 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe882000640 1 -- 172.21.15.1:0/3231773343 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe884004460 con 0x5630315802f0 2024-08-28T20:32:03.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe882000640 1 -- 172.21.15.1:0/3231773343 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe8840327b0 con 0x5630315802f0 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe8a61bd740 10 client.26200 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.101+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56303168d620 con 0x5630315802f0 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe882000640 1 -- 172.21.15.1:0/3231773343 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8880054d0 con 0x5630315802f0 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe882000640 1 -- 172.21.15.1:0/3231773343 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fe88404c020 con 0x5630315802f0 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe8a61bd740 10 client.26200 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe8a61bd740 10 client.26200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe8a61bd740 20 client.26200 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563031567d80 0x56303196e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe8a61bd740 4 client.26200 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:32:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.102+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630318c3ec0 con 0x563031567d80 2024-08-28T20:32:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.103+0000 7fe897e00640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563031567d80 0x56303196e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.106+0000 7fe882000640 10 client.26200 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.106+0000 7fe897e00640 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563031567d80 0x56303196e480 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69647b636231499d server_cookie=13d064eb5de2048d in_seq=0 out_seq=0 2024-08-28T20:32:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe882000640 1 -- 172.21.15.1:0/3231773343 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630318c3ec0 con 0x563031567d80 2024-08-28T20:32:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe882000640 10 client.26200 handle_command_reply: tid=0 2024-08-28T20:32:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 client.26200 shutdown 2024-08-28T20:32:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 msgr2=0x563031960e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031960e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe884035040 tx=0x7fe884030450 comp rx=0 tx=0).stop 2024-08-28T20:32:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 shutdown_connections 2024-08-28T20:32:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563031567d80 0x56303196e480 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315884d0 0x563031961510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315a91b0 0x563031962010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/3231773343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x563031960e50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe882000640 0 client.26200 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 >> 172.21.15.1:0/3231773343 conn(0x56303159d300 msgr2=0x563031948f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.107+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 shutdown_connections 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.108+0000 7fe8a61bd740 1 -- 172.21.15.1:0/3231773343 wait complete. 2024-08-28T20:32:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.108+0000 7fe8a61bd740 20 client.26200 trim_cache size 0 max 16384 2024-08-28T20:32:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.134+0000 7fe8a61bd740 1 Processor -- start 2024-08-28T20:32:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.134+0000 7fe8a61bd740 1 -- start start 2024-08-28T20:32:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x56303195b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x56303195bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x563031960070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981ab3d0 con 0x5630315a91b0 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a8ca0 con 0x5630315884d0 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a6b10 con 0x5630315802f0 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe897400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x56303195b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe897400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x56303195b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44960/0 (socket says 172.21.15.1:44960) 2024-08-28T20:32:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.135+0000 7fe897400640 1 -- 172.21.15.1:0/1690447779 learned_addr learned my addr 172.21.15.1:0/1690447779 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897e00640 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x56303195bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897400640 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x563031960070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897400640 1 -- 172.21.15.1:0/1690447779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 msgr2=0x56303195bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897400640 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x56303195bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897400640 1 -- 172.21.15.1:0/1690447779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 msgr2=0x563031960070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897400640 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x563031960070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.136+0000 7fe897400640 1 -- 172.21.15.1:0/1690447779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630319692b0 con 0x5630315802f0 2024-08-28T20:32:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.137+0000 7fe897400640 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x56303195b870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe884003cf0 tx=0x7fe884030c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82f4a7190c3e35b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.137+0000 7fe88cc00640 1 -- 172.21.15.1:0/1690447779 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037070 con 0x5630315802f0 2024-08-28T20:32:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.137+0000 7fe88cc00640 1 -- 172.21.15.1:0/1690447779 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe884055070 con 0x5630315802f0 2024-08-28T20:32:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.137+0000 7fe88cc00640 1 -- 172.21.15.1:0/1690447779 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884032cd0 con 0x5630315802f0 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.138+0000 7fe8a61bd740 1 -- 172.21.15.1:0/1690447779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 msgr2=0x56303195b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.138+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x56303195b870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe884003cf0 tx=0x7fe884030c10 comp rx=0 tx=0).stop 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.138+0000 7fe8a61bd740 1 -- 172.21.15.1:0/1690447779 shutdown_connections 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.138+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x563031960070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.138+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315884d0 0x56303195bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.138+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/1690447779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315802f0 0x56303195b870 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.139+0000 7fe8a61bd740 1 -- 172.21.15.1:0/1690447779 >> 172.21.15.1:0/1690447779 conn(0x56303159d300 msgr2=0x563031958640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.139+0000 7fe8a61bd740 1 -- 172.21.15.1:0/1690447779 shutdown_connections 2024-08-28T20:32:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.139+0000 7fe8a61bd740 1 -- 172.21.15.1:0/1690447779 wait complete. 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.139+0000 7fe8a61bd740 1 -- start start 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.139+0000 7fe8a61bd740 1 Processor -- start 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 0x5630319660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 0x5630319667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a7160 con 0x5630315a91b0 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a85d0 con 0x5630315802f0 2024-08-28T20:32:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a7830 con 0x5630315884d0 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe8a61bd740 10 client.0 _ll_register_callbacks cb 0x7fe884032440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 0x5630319660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 0x5630319667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 0x5630319660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:32900/0 (socket says 172.21.15.1:32900) 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 0x5630319667b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44966/0 (socket says 172.21.15.1:44966) 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897400640 1 -- 172.21.15.1:0/2515865993 learned_addr learned my addr 172.21.15.1:0/2515865993 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897400640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.140+0000 7fe897e00640 1 -- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 msgr2=0x5630319660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe897e00640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 0x5630319660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe897e00640 1 -- 172.21.15.1:0/2515865993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 msgr2=0x5630319672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe897e00640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe897e00640 1 -- 172.21.15.1:0/2515865993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563031967a30 con 0x5630315884d0 2024-08-28T20:32:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe897400640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 0x5630319660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:32:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe897e00640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 0x5630319667b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe888009bf0 tx=0x7fe888009df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0ce387ca2868a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.141+0000 7fe882000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:32:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.142+0000 7fe882000640 1 -- 172.21.15.1:0/2515865993 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88802f070 con 0x5630315884d0 2024-08-28T20:32:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.142+0000 7fe882000640 1 -- 172.21.15.1:0/2515865993 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe8880042e0 con 0x5630315884d0 2024-08-28T20:32:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.143+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe884055070 con 0x5630315884d0 2024-08-28T20:32:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.143+0000 7fe882000640 1 -- 172.21.15.1:0/2515865993 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe888039050 con 0x5630315884d0 2024-08-28T20:32:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.143+0000 7fe8a61bd740 10 client.26206 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.143+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563031968df0 con 0x5630315884d0 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe882000640 1 -- 172.21.15.1:0/2515865993 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe884055070 con 0x5630315884d0 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe882000640 1 -- 172.21.15.1:0/2515865993 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fe888034440 con 0x5630315884d0 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe8a61bd740 10 client.26206 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe8a61bd740 10 client.26206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe8a61bd740 20 client.26206 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56303153d1c0 0x5630319db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe8a61bd740 4 client.26206 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:32:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.144+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630318bf960 con 0x56303153d1c0 2024-08-28T20:32:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.145+0000 7fe897400640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56303153d1c0 0x5630319db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.145+0000 7fe897400640 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56303153d1c0 0x5630319db2c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced0bca118e04e2b server_cookie=93b25b9f76737da6 in_seq=0 out_seq=0 2024-08-28T20:32:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.145+0000 7fe882000640 10 client.26206 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.158+0000 7fe882000640 1 -- 172.21.15.1:0/2515865993 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630318bf960 con 0x56303153d1c0 2024-08-28T20:32:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.158+0000 7fe882000640 10 client.26206 handle_command_reply: tid=0 2024-08-28T20:32:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.158+0000 7fe8a61bd740 1 client.26206 shutdown 2024-08-28T20:32:03.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 msgr2=0x5630319667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 0x5630319667b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe888009bf0 tx=0x7fe888009df0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 shutdown_connections 2024-08-28T20:32:03.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x56303153d1c0 0x5630319db2c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630315a91b0 0x5630319672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5630315884d0 0x5630319667b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe882000640 0 client.26206 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 --2- 172.21.15.1:0/2515865993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630315802f0 0x5630319660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.160+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 >> 172.21.15.1:0/2515865993 conn(0x56303159d300 msgr2=0x56303195b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.161+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 shutdown_connections 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.161+0000 7fe8a61bd740 1 -- 172.21.15.1:0/2515865993 wait complete. 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.161+0000 7fe8a61bd740 20 client.26206 trim_cache size 0 max 16384 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:32:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe87c0b4c20 msgr2=0x7fe87c0b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe87c0b4c20 0x7fe87c0b7130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe890012020 tx=0x7fe890004240 comp rx=0 tx=0).stop 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 msgr2=0x7fe89819cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89819cf40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe890009fd0 tx=0x7fe89000c800 comp rx=0 tx=0).stop 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 shutdown_connections 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe87c0b4c20 0x7fe87c0b7130 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe898108fb0 0x7fe89819cf40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8981063f0 0x7fe89819c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 --2- 172.21.15.1:0/4064004849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe89806b620 0x7fe89819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 >> 172.21.15.1:0/4064004849 conn(0x7fe8980fdab0 msgr2=0x7fe8981094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.162+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 shutdown_connections 2024-08-28T20:32:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:03.164+0000 7fe89da00640 1 -- 172.21.15.1:0/4064004849 wait complete. 2024-08-28T20:32:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 815.0 s, 1594.6 tps, lat 62.956 ms stddev 71.975 2024-08-28T20:32:03.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:03 smithi001 ceph-mon[20984]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 574 op/s 2024-08-28T20:32:03.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:03 smithi121 ceph-mon[25248]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 574 op/s 2024-08-28T20:32:04.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:03 smithi007 ceph-mon[25357]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 574 op/s 2024-08-28T20:32:05.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:05 smithi001 ceph-mon[20984]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 642 op/s 2024-08-28T20:32:05.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:05 smithi121 ceph-mon[25248]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 642 op/s 2024-08-28T20:32:06.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:05 smithi007 ceph-mon[25357]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 642 op/s 2024-08-28T20:32:07.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:07 smithi001 ceph-mon[20984]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.3 MiB/s wr, 659 op/s 2024-08-28T20:32:07.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:07 smithi121 ceph-mon[25248]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.3 MiB/s wr, 659 op/s 2024-08-28T20:32:08.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:07 smithi007 ceph-mon[25357]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.3 MiB/s wr, 659 op/s 2024-08-28T20:32:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 820.0 s, 1588.4 tps, lat 62.453 ms stddev 74.551 2024-08-28T20:32:09.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:09 smithi001 ceph-mon[20984]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-08-28T20:32:09.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:09 smithi121 ceph-mon[25248]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-08-28T20:32:10.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:09 smithi007 ceph-mon[25357]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2024-08-28T20:32:11.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:11 smithi001 ceph-mon[20984]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-08-28T20:32:11.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:11 smithi121 ceph-mon[25248]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-08-28T20:32:12.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:11 smithi007 ceph-mon[25357]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-08-28T20:32:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 825.0 s, 1964.2 tps, lat 51.230 ms stddev 68.221 2024-08-28T20:32:13.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:13 smithi001 ceph-mon[20984]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.4 MiB/s wr, 642 op/s 2024-08-28T20:32:13.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:13 smithi121 ceph-mon[25248]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.4 MiB/s wr, 642 op/s 2024-08-28T20:32:14.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:13 smithi007 ceph-mon[25357]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.4 MiB/s wr, 642 op/s 2024-08-28T20:32:15.979 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:15 smithi121 ceph-mon[25248]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 669 op/s 2024-08-28T20:32:16.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:15 smithi007 ceph-mon[25357]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 669 op/s 2024-08-28T20:32:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:15 smithi001 ceph-mon[20984]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 669 op/s 2024-08-28T20:32:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 -- 172.21.15.1:0/1958270181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224076e90 msgr2=0x7f8224075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 --2- 172.21.15.1:0/1958270181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224076e90 0x7f8224075550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8218009900 tx=0x7f821802a410 comp rx=0 tx=0).stop 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 -- 172.21.15.1:0/1958270181 shutdown_connections 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 --2- 172.21.15.1:0/1958270181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 0x7f8224111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 --2- 172.21.15.1:0/1958270181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224075a90 0x7f8224075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 --2- 172.21.15.1:0/1958270181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224076e90 0x7f8224075550 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 -- 172.21.15.1:0/1958270181 >> 172.21.15.1:0/1958270181 conn(0x7f82240fed90 msgr2=0x7f8224101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 -- 172.21.15.1:0/1958270181 shutdown_connections 2024-08-28T20:32:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.457+0000 7f822ba00640 1 -- 172.21.15.1:0/1958270181 wait complete. 2024-08-28T20:32:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 Processor -- start 2024-08-28T20:32:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 -- start start 2024-08-28T20:32:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 0x7f82241a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224076e90 0x7f82241a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 0x7f82241a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82241156b0 con 0x7f822410fbd0 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8224115530 con 0x7f8224076e90 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.458+0000 7f822ba00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8224115830 con 0x7f8224075a90 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.459+0000 7f8229000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 0x7f82241a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.459+0000 7f8229a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 0x7f82241a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.459+0000 7f8229000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 0x7f82241a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36710/0 (socket says 172.21.15.1:36710) 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.459+0000 7f8229000640 1 -- 172.21.15.1:0/3276628631 learned_addr learned my addr 172.21.15.1:0/3276628631 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.459+0000 7f8223e00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224076e90 0x7f82241a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8223e00640 1 -- 172.21.15.1:0/3276628631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 msgr2=0x7f82241a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8223e00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 0x7f82241a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8223e00640 1 -- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 msgr2=0x7f82241a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8223e00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 0x7f82241a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8223e00640 1 -- 172.21.15.1:0/3276628631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241a1d10 con 0x7f8224076e90 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8229000640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 0x7f82241a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8229a00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 0x7f82241a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:32:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.460+0000 7f8223e00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224076e90 0x7f82241a0940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f821000e9f0 tx=0x7f821000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.461+0000 7f8221600640 1 -- 172.21.15.1:0/3276628631 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821000ccc0 con 0x7f8224076e90 2024-08-28T20:32:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.461+0000 7f8221600640 1 -- 172.21.15.1:0/3276628631 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82100108e0 con 0x7f8224076e90 2024-08-28T20:32:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.461+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82241a2000 con 0x7f8224076e90 2024-08-28T20:32:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.461+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241a86f0 con 0x7f8224076e90 2024-08-28T20:32:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.462+0000 7f8221600640 1 -- 172.21.15.1:0/3276628631 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210018880 con 0x7f8224076e90 2024-08-28T20:32:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.465+0000 7f8232c42740 1 Processor -- start 2024-08-28T20:32:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.465+0000 7f8232c42740 1 -- start start 2024-08-28T20:32:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8232c42740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c88dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8232c42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c89430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8232c42740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c89f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8232c42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dde3bfbf70 con 0x55dde38ba2f0 2024-08-28T20:32:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8232c42740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dde3beb500 con 0x55dde38c24d0 2024-08-28T20:32:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8232c42740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dde3bef4b0 con 0x55dde38e31b0 2024-08-28T20:32:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8229a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c88dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8229a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c88dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36714/0 (socket says 172.21.15.1:36714) 2024-08-28T20:32:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.466+0000 7f8229a00640 1 -- 172.21.15.1:0/2434975957 learned_addr learned my addr 172.21.15.1:0/2434975957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8229000640 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c89430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8229a00640 1 -- 172.21.15.1:0/2434975957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 msgr2=0x55dde3c89f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:32:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8229a00640 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c89f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8221600640 1 -- 172.21.15.1:0/3276628631 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f8210018a20 con 0x7f8224076e90 2024-08-28T20:32:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8229a00640 1 -- 172.21.15.1:0/2434975957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 msgr2=0x55dde3c89430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8229a00640 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c89430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.467+0000 7f8229a00640 1 -- 172.21.15.1:0/2434975957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dde3ba5c10 con 0x55dde38e31b0 2024-08-28T20:32:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.468+0000 7f8229a00640 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c88dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f821c009fd0 tx=0x7f821c0108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4df1771517bd819e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.468+0000 7f8216000640 1 -- 172.21.15.1:0/2434975957 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c011760 con 0x55dde38e31b0 2024-08-28T20:32:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.468+0000 7f8216000640 1 -- 172.21.15.1:0/2434975957 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c011db0 con 0x55dde38e31b0 2024-08-28T20:32:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.468+0000 7f8216000640 1 -- 172.21.15.1:0/2434975957 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00e3c0 con 0x55dde38e31b0 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8221600640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f820c0b4c80 0x7f820c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8221600640 1 -- 172.21.15.1:0/3276628631 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f82100e5350 con 0x7f8224076e90 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8229000640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f820c0b4c80 0x7f820c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 -- 172.21.15.1:0/2434975957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 msgr2=0x55dde3c88dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c88dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f821c009fd0 tx=0x7f821c0108e0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 -- 172.21.15.1:0/2434975957 shutdown_connections 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c89430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c89f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 --2- 172.21.15.1:0/2434975957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c88dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.469+0000 7f8232c42740 1 -- 172.21.15.1:0/2434975957 >> 172.21.15.1:0/2434975957 conn(0x55dde38d7300 msgr2=0x55dde3c84850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.470+0000 7f8232c42740 1 -- 172.21.15.1:0/2434975957 shutdown_connections 2024-08-28T20:32:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.470+0000 7f8229000640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f820c0b4c80 0x7f820c0b7190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8218005f70 tx=0x7f82180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.470+0000 7f8232c42740 1 -- 172.21.15.1:0/2434975957 wait complete. 2024-08-28T20:32:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.471+0000 7f8232c42740 1 -- start start 2024-08-28T20:32:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.472+0000 7f8232c42740 1 Processor -- start 2024-08-28T20:32:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.473+0000 7f8232c42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c92500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.473+0000 7f8232c42740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c92bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.473+0000 7f8232c42740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8232c42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dde3b24ab0 con 0x55dde38ba2f0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8232c42740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dde3b92320 con 0x55dde38c24d0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8232c42740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dde3c8aaa0 con 0x55dde38e31b0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8232c42740 10 client.0 _ll_register_callbacks cb 0x55dde3b986a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8229000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c92500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8229a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8229000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c92500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46862/0 (socket says 172.21.15.1:46862) 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8223e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c92bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8229000640 1 -- 172.21.15.1:0/100013235 learned_addr learned my addr 172.21.15.1:0/100013235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8223e00640 1 -- 172.21.15.1:0/100013235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 msgr2=0x55dde3c93730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8223e00640 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c93730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8223e00640 1 -- 172.21.15.1:0/100013235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 msgr2=0x55dde3c92500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8223e00640 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c92500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.474+0000 7f8223e00640 1 -- 172.21.15.1:0/100013235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dde394e790 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f8223e00640 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c92bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f82100e2e40 tx=0x7f82100ab880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a74ba4e0114f6c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f820aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f820aa00640 1 -- 172.21.15.1:0/100013235 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100b05e0 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f820aa00640 1 -- 172.21.15.1:0/100013235 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f8210010640 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c011db0 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f820aa00640 1 -- 172.21.15.1:0/100013235 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f82100b5090 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f8232c42740 10 client.26237 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.475+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55dde39c7620 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f820aa00640 1 -- 172.21.15.1:0/100013235 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c011db0 con 0x55dde38c24d0 2024-08-28T20:32:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f820aa00640 1 -- 172.21.15.1:0/100013235 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f8210010a90 con 0x55dde38c24d0 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f8232c42740 10 client.26237 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f8232c42740 10 client.26237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f8232c42740 20 client.26237 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f8232c42740 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38a1d80 0x55dde3c9fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f8232c42740 4 client.26237 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.476+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dde3bfdec0 con 0x55dde38a1d80 2024-08-28T20:32:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.477+0000 7f8229000640 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38a1d80 0x55dde3c9fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.478+0000 7f8229000640 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38a1d80 0x55dde3c9fd00 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a4c76fafafe9b3f server_cookie=58dfe654439733b0 in_seq=0 out_seq=0 2024-08-28T20:32:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.478+0000 7f820aa00640 10 client.26237 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f820aa00640 1 -- 172.21.15.1:0/100013235 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dde3bfdec0 con 0x55dde38a1d80 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f820aa00640 10 client.26237 handle_command_reply: tid=0 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 client.26237 shutdown 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 msgr2=0x55dde3c92bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c92bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f82100e2e40 tx=0x7f82100ab880 comp rx=0 tx=0).stop 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 shutdown_connections 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38a1d80 0x55dde3c9fd00 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38c24d0 0x55dde3c92bc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f820aa00640 0 client.26237 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 --2- 172.21.15.1:0/100013235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38ba2f0 0x55dde3c92500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 >> 172.21.15.1:0/100013235 conn(0x55dde38d7300 msgr2=0x55dde3c82cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 shutdown_connections 2024-08-28T20:32:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.479+0000 7f8232c42740 1 -- 172.21.15.1:0/100013235 wait complete. 2024-08-28T20:32:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.480+0000 7f8232c42740 20 client.26237 trim_cache size 0 max 16384 2024-08-28T20:32:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.502+0000 7f8232c42740 1 Processor -- start 2024-08-28T20:32:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.502+0000 7f8232c42740 1 -- start start 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8232c42740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38ba2f0 0x55dde3c83460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8232c42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c9a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8232c42740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38e31b0 0x55dde3c839a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8232c42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8204010d20 con 0x55dde38c24d0 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8232c42740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f820400e5f0 con 0x55dde38e31b0 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8232c42740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f820400c440 con 0x55dde38ba2f0 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.503+0000 7f8229000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38ba2f0 0x55dde3c83460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.504+0000 7f8229a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38e31b0 0x55dde3c839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.504+0000 7f8223e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c9a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.504+0000 7f8223e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c9a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46878/0 (socket says 172.21.15.1:46878) 2024-08-28T20:32:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.504+0000 7f8223e00640 1 -- 172.21.15.1:0/1885310184 learned_addr learned my addr 172.21.15.1:0/1885310184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.505+0000 7f8223e00640 1 -- 172.21.15.1:0/1885310184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38ba2f0 msgr2=0x55dde3c83460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.505+0000 7f8223e00640 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38ba2f0 0x55dde3c83460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.505+0000 7f8223e00640 1 -- 172.21.15.1:0/1885310184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38e31b0 msgr2=0x55dde3c839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.505+0000 7f8223e00640 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38e31b0 0x55dde3c839a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.505+0000 7f8223e00640 1 -- 172.21.15.1:0/1885310184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dde3c91e10 con 0x55dde38c24d0 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.505+0000 7f8223e00640 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c9a610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f82100e2e90 tx=0x7f82100aaa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9057d3d4ab3d35 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.506+0000 7f8215600640 1 -- 172.21.15.1:0/1885310184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210010640 con 0x55dde38c24d0 2024-08-28T20:32:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.507+0000 7f8215600640 1 -- 172.21.15.1:0/1885310184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82100cee50 con 0x55dde38c24d0 2024-08-28T20:32:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.507+0000 7f8215600640 1 -- 172.21.15.1:0/1885310184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100aac00 con 0x55dde38c24d0 2024-08-28T20:32:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 -- 172.21.15.1:0/1885310184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 msgr2=0x55dde3c9a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c9a610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f82100e2e90 tx=0x7f82100aaa40 comp rx=0 tx=0).stop 2024-08-28T20:32:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 -- 172.21.15.1:0/1885310184 shutdown_connections 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c9a610 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38e31b0 0x55dde3c839a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 --2- 172.21.15.1:0/1885310184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38ba2f0 0x55dde3c83460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 -- 172.21.15.1:0/1885310184 >> 172.21.15.1:0/1885310184 conn(0x55dde38d7300 msgr2=0x55dde3c91700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 -- 172.21.15.1:0/1885310184 shutdown_connections 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.510+0000 7f8232c42740 1 -- 172.21.15.1:0/1885310184 wait complete. 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.511+0000 7f8232c42740 1 -- start start 2024-08-28T20:32:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.511+0000 7f8232c42740 1 Processor -- start 2024-08-28T20:32:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.513+0000 7f8232c42740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38ba2f0 0x55dde3c9a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.513+0000 7f8232c42740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c98900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.513+0000 7f8232c42740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c98e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.513+0000 7f8229000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38ba2f0 0x55dde3c9a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.513+0000 7f8232c42740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f820400cab0 con 0x55dde38c24d0 2024-08-28T20:32:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.513+0000 7f8232c42740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f820400df20 con 0x55dde38ba2f0 2024-08-28T20:32:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.514+0000 7f8229a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c98e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.514+0000 7f8229a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c98e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36752/0 (socket says 172.21.15.1:36752) 2024-08-28T20:32:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.514+0000 7f8229a00640 1 -- 172.21.15.1:0/3141433917 learned_addr learned my addr 172.21.15.1:0/3141433917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.514+0000 7f8223e00640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c98900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.515+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f820400d180 con 0x55dde38e31b0 2024-08-28T20:32:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.515+0000 7f8232c42740 10 client.0 _ll_register_callbacks cb 0x7f82100ab6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.516+0000 7f8229a00640 1 -- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38ba2f0 msgr2=0x55dde3c9a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.517+0000 7f8229a00640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38ba2f0 0x55dde3c9a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.517+0000 7f8229a00640 1 -- 172.21.15.1:0/3141433917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 msgr2=0x55dde3c98900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.517+0000 7f8229a00640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c98900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.517+0000 7f8229a00640 1 -- 172.21.15.1:0/3141433917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dde3c99380 con 0x55dde38e31b0 2024-08-28T20:32:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.518+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82100cee50 con 0x55dde38e31b0 2024-08-28T20:32:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.518+0000 7f8229000640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38ba2f0 0x55dde3c9a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:32:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.518+0000 7f8229a00640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c98e40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f821c009fd0 tx=0x7f821c011790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d6b53724cc4065 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.518+0000 7f8223e00640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c98900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:32:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.518+0000 7f820aa00640 10 client.26221 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:32:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.520+0000 7f820aa00640 1 -- 172.21.15.1:0/3141433917 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c02a060 con 0x55dde38e31b0 2024-08-28T20:32:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.520+0000 7f820aa00640 1 -- 172.21.15.1:0/3141433917 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f821c011d10 con 0x55dde38e31b0 2024-08-28T20:32:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.520+0000 7f820aa00640 1 -- 172.21.15.1:0/3141433917 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f821c005040 con 0x55dde38e31b0 2024-08-28T20:32:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.520+0000 7f8232c42740 10 client.26221 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.520+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=50}) -- 0x55dde3d0b3a0 con 0x55dde38e31b0 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f820aa00640 1 -- 172.21.15.1:0/3141433917 <== mon.1 v2:172.21.15.121:3300/0 4 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f821c0051e0 con 0x55dde38e31b0 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f8232c42740 10 client.26221 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f8232c42740 10 client.26221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f8232c42740 20 client.26221 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f8232c42740 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38771c0 0x55dde3d0d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f8232c42740 4 client.26221 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.521+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dde3bf9960 con 0x55dde38771c0 2024-08-28T20:32:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.522+0000 7f8229000640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38771c0 0x55dde3d0d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.524+0000 7f820aa00640 10 client.26221 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.524+0000 7f8229000640 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38771c0 0x55dde3d0d8c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46628696435af827 server_cookie=9f89522de2c1ba7c in_seq=0 out_seq=0 2024-08-28T20:32:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.565+0000 7f820aa00640 1 -- 172.21.15.1:0/3141433917 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dde3bf9960 con 0x55dde38771c0 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.565+0000 7f820aa00640 10 client.26221 handle_command_reply: tid=0 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.565+0000 7f8232c42740 1 client.26221 shutdown 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 msgr2=0x55dde3c98e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c98e40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f821c009fd0 tx=0x7f821c011790 comp rx=0 tx=0).stop 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 shutdown_connections 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55dde38771c0 0x55dde3d0d8c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dde38c24d0 0x55dde3c98900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dde38e31b0 0x55dde3c98e40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f820aa00640 0 client.26221 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 --2- 172.21.15.1:0/3141433917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dde38ba2f0 0x55dde3c9a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 >> 172.21.15.1:0/3141433917 conn(0x55dde38d7300 msgr2=0x55dde3c91700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.566+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 shutdown_connections 2024-08-28T20:32:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.567+0000 7f8232c42740 1 -- 172.21.15.1:0/3141433917 wait complete. 2024-08-28T20:32:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.567+0000 7f8232c42740 20 client.26221 trim_cache size 0 max 16384 2024-08-28T20:32:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:32:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:32:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:32:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.567+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f820c0b4c80 msgr2=0x7f820c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.567+0000 7f822ba00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f820c0b4c80 0x7f820c0b7190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8218005f70 tx=0x7f82180314a0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.567+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224076e90 msgr2=0x7f82241a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.567+0000 7f822ba00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224076e90 0x7f82241a0940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f821000e9f0 tx=0x7f821000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 shutdown_connections 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f820c0b4c80 0x7f820c0b7190 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f822410fbd0 0x7f82241a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8224076e90 0x7f82241a0940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 --2- 172.21.15.1:0/3276628631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8224075a90 0x7f82241a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 >> 172.21.15.1:0/3276628631 conn(0x7f82240fed90 msgr2=0x7f8224102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 shutdown_connections 2024-08-28T20:32:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:16.568+0000 7f822ba00640 1 -- 172.21.15.1:0/3276628631 wait complete. 2024-08-28T20:32:18.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:17 smithi007 ceph-mon[25357]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.4 MiB/s wr, 661 op/s 2024-08-28T20:32:18.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:17 smithi001 ceph-mon[20984]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.4 MiB/s wr, 661 op/s 2024-08-28T20:32:18.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:17 smithi121 ceph-mon[25248]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.4 MiB/s wr, 661 op/s 2024-08-28T20:32:18.763 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 830.0 s, 1301.6 tps, lat 76.270 ms stddev 88.707 2024-08-28T20:32:20.067 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:19 smithi007 ceph-mon[25357]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.4 MiB/s wr, 662 op/s 2024-08-28T20:32:20.325 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:19 smithi121 ceph-mon[25248]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.4 MiB/s wr, 662 op/s 2024-08-28T20:32:20.325 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:19 smithi001 ceph-mon[20984]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.4 MiB/s wr, 662 op/s 2024-08-28T20:32:22.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:21 smithi007 ceph-mon[25357]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 661 op/s 2024-08-28T20:32:22.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:21 smithi001 ceph-mon[20984]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 661 op/s 2024-08-28T20:32:22.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:21 smithi121 ceph-mon[25248]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 661 op/s 2024-08-28T20:32:23.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 835.0 s, 1508.8 tps, lat 65.749 ms stddev 85.305 2024-08-28T20:32:24.031 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:23 smithi121 ceph-mon[25248]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 646 op/s 2024-08-28T20:32:24.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:23 smithi007 ceph-mon[25357]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 646 op/s 2024-08-28T20:32:24.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:23 smithi001 ceph-mon[20984]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 646 op/s 2024-08-28T20:32:26.068 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:25 smithi007 ceph-mon[25357]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 647 op/s 2024-08-28T20:32:26.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:25 smithi001 ceph-mon[20984]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 647 op/s 2024-08-28T20:32:26.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:25 smithi121 ceph-mon[25248]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 647 op/s 2024-08-28T20:32:28.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:27 smithi007 ceph-mon[25357]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 667 op/s 2024-08-28T20:32:28.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:27 smithi001 ceph-mon[20984]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 667 op/s 2024-08-28T20:32:28.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:27 smithi121 ceph-mon[25248]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 667 op/s 2024-08-28T20:32:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 840.0 s, 1713.4 tps, lat 58.964 ms stddev 75.678 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 -- 172.21.15.1:0/2255741960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae48075a90 msgr2=0x7fae48075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 --2- 172.21.15.1:0/2255741960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae48075a90 0x7fae48075ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009900 tx=0x7fae3c02a410 comp rx=0 tx=0).stop 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 -- 172.21.15.1:0/2255741960 shutdown_connections 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 --2- 172.21.15.1:0/2255741960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae4810fbe0 0x7fae48112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 --2- 172.21.15.1:0/2255741960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae48075a90 0x7fae48075ea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 --2- 172.21.15.1:0/2255741960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae48076e90 0x7fae48075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 -- 172.21.15.1:0/2255741960 >> 172.21.15.1:0/2255741960 conn(0x7fae480feda0 msgr2=0x7fae48101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 -- 172.21.15.1:0/2255741960 shutdown_connections 2024-08-28T20:32:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.868+0000 7fae50000640 1 -- 172.21.15.1:0/2255741960 wait complete. 2024-08-28T20:32:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.870+0000 7fae50000640 1 Processor -- start 2024-08-28T20:32:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.871+0000 7fae50000640 1 -- start start 2024-08-28T20:32:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.872+0000 7fae50000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae48075a90 0x7fae4810c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.872+0000 7fae50000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae48076e90 0x7fae4810cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae4d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae48075a90 0x7fae4810c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae4d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae48075a90 0x7fae4810c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53400/0 (socket says 172.21.15.1:53400) 2024-08-28T20:32:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae4d600640 1 -- 172.21.15.1:0/2449368146 learned_addr learned my addr 172.21.15.1:0/2449368146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4810fbe0 0x7fae4810db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae48115770 con 0x7fae48076e90 2024-08-28T20:32:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae481155f0 con 0x7fae4810fbe0 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.873+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae481158f0 con 0x7fae48075a90 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.874+0000 7fae4e000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4810fbe0 0x7fae4810db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.874+0000 7fae4cc00640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae48076e90 0x7fae4810cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.875+0000 7fae4e000640 1 -- 172.21.15.1:0/2449368146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae48075a90 msgr2=0x7fae4810c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.875+0000 7fae4e000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae48075a90 0x7fae4810c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.875+0000 7fae4e000640 1 -- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae48076e90 msgr2=0x7fae4810cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.875+0000 7fae4e000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae48076e90 0x7fae4810cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.875+0000 7fae4e000640 1 -- 172.21.15.1:0/2449368146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4810e320 con 0x7fae4810fbe0 2024-08-28T20:32:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.879+0000 7fae4e000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4810fbe0 0x7fae4810db00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fae3400d680 tx=0x7fae3400db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.879+0000 7fae46000640 1 -- 172.21.15.1:0/2449368146 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34017070 con 0x7fae4810fbe0 2024-08-28T20:32:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.879+0000 7fae46000640 1 -- 172.21.15.1:0/2449368146 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae34009820 con 0x7fae4810fbe0 2024-08-28T20:32:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.879+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4810e610 con 0x7fae4810fbe0 2024-08-28T20:32:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.880+0000 7fae46000640 1 -- 172.21.15.1:0/2449368146 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34004ce0 con 0x7fae4810fbe0 2024-08-28T20:32:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.880+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4810ed50 con 0x7fae4810fbe0 2024-08-28T20:32:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.884+0000 7fae57006740 1 Processor -- start 2024-08-28T20:32:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.888+0000 7fae46000640 1 -- 172.21.15.1:0/2449368146 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fae340099d0 con 0x7fae4810fbe0 2024-08-28T20:32:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.889+0000 7fae57006740 1 -- start start 2024-08-28T20:32:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae57006740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385365fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae57006740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532912f0 0x5638536601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae57006740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x563853660cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae57006740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5638535d2f70 con 0x5638532912f0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae57006740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638535c2500 con 0x5638532994d0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae57006740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5638535c64b0 con 0x5638532ba1b0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae4cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385365fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae4cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385365fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53404/0 (socket says 172.21.15.1:53404) 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae4cc00640 1 -- 172.21.15.1:0/859619030 learned_addr learned my addr 172.21.15.1:0/859619030 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.890+0000 7fae4cc00640 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x563853660cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.891+0000 7fae46000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae300b4bb0 0x7fae300b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.891+0000 7fae4e000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae300b4bb0 0x7fae300b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.891+0000 7fae4d600640 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532912f0 0x5638536601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4cc00640 1 -- 172.21.15.1:0/859619030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 msgr2=0x563853660cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4cc00640 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x563853660cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4cc00640 1 -- 172.21.15.1:0/859619030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532912f0 msgr2=0x5638536601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4cc00640 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532912f0 0x5638536601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4cc00640 1 -- 172.21.15.1:0/859619030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56385357cc10 con 0x5638532ba1b0 2024-08-28T20:32:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4d600640 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532912f0 0x5638536601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae46000640 1 -- 172.21.15.1:0/2449368146 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fae340e4af0 con 0x7fae4810fbe0 2024-08-28T20:32:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae4cc00640 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385365fb30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae3c005ab0 tx=0x7fae3c009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf99d64f1b8c49 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.892+0000 7fae3a600640 1 -- 172.21.15.1:0/859619030 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c035030 con 0x5638532ba1b0 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.893+0000 7fae3a600640 1 -- 172.21.15.1:0/859619030 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae3c03d480 con 0x5638532ba1b0 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.893+0000 7fae3a600640 1 -- 172.21.15.1:0/859619030 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c03a6a0 con 0x5638532ba1b0 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 -- 172.21.15.1:0/859619030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 msgr2=0x56385365fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae4e000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae300b4bb0 0x7fae300b70c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fae34012f90 tx=0x7fae34009ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385365fb30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae3c005ab0 tx=0x7fae3c009640 comp rx=0 tx=0).stop 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 -- 172.21.15.1:0/859619030 shutdown_connections 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532912f0 0x5638536601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x563853660cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 --2- 172.21.15.1:0/859619030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385365fb30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 -- 172.21.15.1:0/859619030 >> 172.21.15.1:0/859619030 conn(0x5638532ae300 msgr2=0x56385365b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 -- 172.21.15.1:0/859619030 shutdown_connections 2024-08-28T20:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.894+0000 7fae57006740 1 -- 172.21.15.1:0/859619030 wait complete. 2024-08-28T20:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.895+0000 7fae57006740 1 -- start start 2024-08-28T20:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.896+0000 7fae57006740 1 Processor -- start 2024-08-28T20:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 0x56385367a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532994d0 0x56385367a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385367b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5638534fbab0 con 0x5638532994d0 2024-08-28T20:32:29.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563853569320 con 0x5638532912f0 2024-08-28T20:32:29.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5638536617b0 con 0x5638532ba1b0 2024-08-28T20:32:29.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.897+0000 7fae57006740 10 client.0 _ll_register_callbacks cb 0x5638535a2e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 0x56385367a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 0x56385367a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48470/0 (socket says 172.21.15.1:48470) 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 -- 172.21.15.1:0/1180380329 learned_addr learned my addr 172.21.15.1:0/1180380329 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385367b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 -- 172.21.15.1:0/1180380329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 msgr2=0x56385367b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385367b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4cc00640 1 -- 172.21.15.1:0/1180380329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532994d0 msgr2=0x56385367a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.898+0000 7fae4d600640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532994d0 0x56385367a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.899+0000 7fae4cc00640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532994d0 0x56385367a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.899+0000 7fae4cc00640 1 -- 172.21.15.1:0/1180380329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563853325790 con 0x5638532912f0 2024-08-28T20:32:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.899+0000 7fae4d600640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532994d0 0x56385367a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.900+0000 7fae4cc00640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 0x56385367a1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0042b0 tx=0x7fae3c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef5a4516617f7f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.900+0000 7fae2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.900+0000 7fae2ea00640 1 -- 172.21.15.1:0/1180380329 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c035030 con 0x5638532912f0 2024-08-28T20:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.900+0000 7fae2ea00640 1 -- 172.21.15.1:0/1180380329 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fae3c031500 con 0x5638532912f0 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.900+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae3c03d480 con 0x5638532912f0 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.901+0000 7fae2ea00640 1 -- 172.21.15.1:0/1180380329 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fae3c031700 con 0x5638532912f0 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.901+0000 7fae57006740 10 client.26252 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.901+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56385339e620 con 0x5638532912f0 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.901+0000 7fae2ea00640 1 -- 172.21.15.1:0/1180380329 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae3c03d480 con 0x5638532912f0 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae2ea00640 1 -- 172.21.15.1:0/1180380329 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fae3c04a7c0 con 0x5638532912f0 2024-08-28T20:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae57006740 10 client.26252 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae57006740 10 client.26252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae57006740 20 client.26252 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae57006740 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563853278d80 0x563853687440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae57006740 4 client.26252 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638535d4ec0 con 0x563853278d80 2024-08-28T20:32:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.902+0000 7fae4d600640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563853278d80 0x563853687440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.903+0000 7fae4d600640 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563853278d80 0x563853687440 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bc0462a297cc860 server_cookie=c88e5957d0e0f800 in_seq=0 out_seq=0 2024-08-28T20:32:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.903+0000 7fae2ea00640 10 client.26252 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.903+0000 7fae2ea00640 1 -- 172.21.15.1:0/1180380329 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638535d4ec0 con 0x563853278d80 2024-08-28T20:32:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.903+0000 7fae2ea00640 10 client.26252 handle_command_reply: tid=0 2024-08-28T20:32:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 client.26252 shutdown 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 msgr2=0x56385367a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 0x56385367a1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0042b0 tx=0x7fae3c005740 comp rx=0 tx=0).stop 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 shutdown_connections 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x563853278d80 0x563853687440 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532994d0 0x56385367a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532ba1b0 0x56385367b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 --2- 172.21.15.1:0/1180380329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532912f0 0x56385367a1c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae2ea00640 0 client.26252 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.904+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 >> 172.21.15.1:0/1180380329 conn(0x5638532ae300 msgr2=0x563853659b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.905+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 shutdown_connections 2024-08-28T20:32:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.905+0000 7fae57006740 1 -- 172.21.15.1:0/1180380329 wait complete. 2024-08-28T20:32:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.905+0000 7fae57006740 20 client.26252 trim_cache size 0 max 16384 2024-08-28T20:32:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.931+0000 7fae57006740 1 Processor -- start 2024-08-28T20:32:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.931+0000 7fae57006740 1 -- start start 2024-08-28T20:32:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae57006740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853679670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae57006740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x56385365ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae57006740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x56385365b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae57006740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b3c00 con 0x5638532ba1b0 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae57006740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae480749d0 con 0x5638532994d0 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae57006740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae48072820 con 0x5638532912f0 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae4d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x56385365ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae4d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x56385365ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:48476/0 (socket says 172.21.15.1:48476) 2024-08-28T20:32:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae4d600640 1 -- 172.21.15.1:0/2782094450 learned_addr learned my addr 172.21.15.1:0/2782094450 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae4cc00640 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853679670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.932+0000 7fae4cc00640 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x56385365b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.933+0000 7fae4d600640 1 -- 172.21.15.1:0/2782094450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 msgr2=0x563853679670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.933+0000 7fae4d600640 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853679670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.933+0000 7fae4d600640 1 -- 172.21.15.1:0/2782094450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 msgr2=0x56385365b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.933+0000 7fae4d600640 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x56385365b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.933+0000 7fae4d600640 1 -- 172.21.15.1:0/2782094450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56385365b5b0 con 0x5638532994d0 2024-08-28T20:32:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.933+0000 7fae4d600640 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x56385365ab30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x563853687ae0 tx=0x7fae40009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e251aab3360df3e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.934+0000 7fae39c00640 1 -- 172.21.15.1:0/2782094450 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40020070 con 0x5638532994d0 2024-08-28T20:32:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.934+0000 7fae39c00640 1 -- 172.21.15.1:0/2782094450 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae40016d70 con 0x5638532994d0 2024-08-28T20:32:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.934+0000 7fae39c00640 1 -- 172.21.15.1:0/2782094450 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40014de0 con 0x5638532994d0 2024-08-28T20:32:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 -- 172.21.15.1:0/2782094450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 msgr2=0x56385365ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x56385365ab30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x563853687ae0 tx=0x7fae40009e40 comp rx=0 tx=0).stop 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 -- 172.21.15.1:0/2782094450 shutdown_connections 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x56385365b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638532994d0 0x56385365ab30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 --2- 172.21.15.1:0/2782094450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853679670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 -- 172.21.15.1:0/2782094450 >> 172.21.15.1:0/2782094450 conn(0x5638532ae300 msgr2=0x563853664230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 -- 172.21.15.1:0/2782094450 shutdown_connections 2024-08-28T20:32:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.936+0000 7fae57006740 1 -- 172.21.15.1:0/2782094450 wait complete. 2024-08-28T20:32:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 -- start start 2024-08-28T20:32:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 Processor -- start 2024-08-28T20:32:29.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853681b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x5638536803b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56385324e1c0 0x5638536809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae48072e90 con 0x5638532ba1b0 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae48074300 con 0x56385324e1c0 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.937+0000 7fae57006740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae48073560 con 0x5638532912f0 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.938+0000 7fae57006740 10 client.0 _ll_register_callbacks cb 0x7fae3c004400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.938+0000 7fae4cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853681b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.938+0000 7fae4cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853681b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53434/0 (socket says 172.21.15.1:53434) 2024-08-28T20:32:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.938+0000 7fae4cc00640 1 -- 172.21.15.1:0/4203925197 learned_addr learned my addr 172.21.15.1:0/4203925197 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.938+0000 7fae4cc00640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56385324e1c0 0x5638536809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.939+0000 7fae4d600640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x5638536803b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.940+0000 7fae4cc00640 1 -- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56385324e1c0 msgr2=0x5638536809b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.940+0000 7fae4cc00640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56385324e1c0 0x5638536809b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.940+0000 7fae4cc00640 1 -- 172.21.15.1:0/4203925197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 msgr2=0x5638536803b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.940+0000 7fae4cc00640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x5638536803b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.940+0000 7fae4cc00640 1 -- 172.21.15.1:0/4203925197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563853681110 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae4cc00640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853681b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae3c031460 tx=0x7fae3c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd26b324fade86e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae2ea00640 1 -- 172.21.15.1:0/4203925197 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c035070 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae2ea00640 1 -- 172.21.15.1:0/4203925197 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fae3c003e50 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae40016d70 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae2ea00640 1 -- 172.21.15.1:0/4203925197 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fae3c05d040 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae57006740 10 client.26239 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.941+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5638536f2d20 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae2ea00640 1 -- 172.21.15.1:0/4203925197 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae40016d70 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae2ea00640 1 -- 172.21.15.1:0/4203925197 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fae3c063040 con 0x5638532912f0 2024-08-28T20:32:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae57006740 10 client.26239 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae57006740 10 client.26239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae57006740 20 client.26239 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae57006740 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5638536f3570 0x5638536f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae57006740 4 client.26239 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:32:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.942+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638535d0960 con 0x5638536f3570 2024-08-28T20:32:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.943+0000 7fae4d600640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5638536f3570 0x5638536f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.943+0000 7fae4d600640 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5638536f3570 0x5638536f5990 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cdd75482b0a6ce8 server_cookie=8d5df2c170638cfc in_seq=0 out_seq=0 2024-08-28T20:32:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.943+0000 7fae2ea00640 10 client.26239 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae2ea00640 1 -- 172.21.15.1:0/4203925197 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5638535d0960 con 0x5638536f3570 2024-08-28T20:32:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae2ea00640 10 client.26239 handle_command_reply: tid=0 2024-08-28T20:32:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 client.26239 shutdown 2024-08-28T20:32:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 msgr2=0x563853681b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853681b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae3c031460 tx=0x7fae3c02a410 comp rx=0 tx=0).stop 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 shutdown_connections 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x5638536f3570 0x5638536f5990 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638532ba1b0 0x5638536803b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56385324e1c0 0x5638536809b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 --2- 172.21.15.1:0/4203925197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638532912f0 0x563853681b20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 >> 172.21.15.1:0/4203925197 conn(0x5638532ae300 msgr2=0x563853659b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae2ea00640 0 client.26239 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.956+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 shutdown_connections 2024-08-28T20:32:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.957+0000 7fae57006740 1 -- 172.21.15.1:0/4203925197 wait complete. 2024-08-28T20:32:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.957+0000 7fae57006740 20 client.26239 trim_cache size 0 max 16384 2024-08-28T20:32:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:32:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:32:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:32:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.957+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae300b4bb0 msgr2=0x7fae300b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.957+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae300b4bb0 0x7fae300b70c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fae34012f90 tx=0x7fae34009ec0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.957+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4810fbe0 msgr2=0x7fae4810db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.957+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4810fbe0 0x7fae4810db00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fae3400d680 tx=0x7fae3400db40 comp rx=0 tx=0).stop 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.958+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 shutdown_connections 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.958+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae300b4bb0 0x7fae300b70c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.958+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae48076e90 0x7fae4810cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.958+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4810fbe0 0x7fae4810db00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.958+0000 7fae50000640 1 --2- 172.21.15.1:0/2449368146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae48075a90 0x7fae4810c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.958+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 >> 172.21.15.1:0/2449368146 conn(0x7fae480feda0 msgr2=0x7fae48102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.959+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 shutdown_connections 2024-08-28T20:32:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:29.959+0000 7fae50000640 1 -- 172.21.15.1:0/2449368146 wait complete. 2024-08-28T20:32:30.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:29 smithi007 ceph-mon[25357]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 644 op/s 2024-08-28T20:32:30.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:29 smithi001 ceph-mon[20984]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 644 op/s 2024-08-28T20:32:30.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:29 smithi121 ceph-mon[25248]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 644 op/s 2024-08-28T20:32:32.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:31 smithi007 ceph-mon[25357]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-08-28T20:32:32.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:31 smithi001 ceph-mon[20984]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-08-28T20:32:32.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:31 smithi121 ceph-mon[25248]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 618 op/s 2024-08-28T20:32:33.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 845.0 s, 1657.0 tps, lat 59.374 ms stddev 72.842 2024-08-28T20:32:34.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:33 smithi007 ceph-mon[25357]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.3 MiB/s wr, 584 op/s 2024-08-28T20:32:34.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:33 smithi001 ceph-mon[20984]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.3 MiB/s wr, 584 op/s 2024-08-28T20:32:34.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:33 smithi121 ceph-mon[25248]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.3 MiB/s wr, 584 op/s 2024-08-28T20:32:36.065 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:35 smithi007 ceph-mon[25357]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 MiB/s wr, 666 op/s 2024-08-28T20:32:36.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:35 smithi001 ceph-mon[20984]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 MiB/s wr, 666 op/s 2024-08-28T20:32:36.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:35 smithi121 ceph-mon[25248]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 MiB/s wr, 666 op/s 2024-08-28T20:32:38.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:37 smithi001 ceph-mon[20984]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.7 MiB/s wr, 627 op/s 2024-08-28T20:32:38.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:37 smithi121 ceph-mon[25248]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.7 MiB/s wr, 627 op/s 2024-08-28T20:32:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:37 smithi007 ceph-mon[25357]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.7 MiB/s wr, 627 op/s 2024-08-28T20:32:38.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 850.0 s, 1416.0 tps, lat 71.964 ms stddev 86.026 2024-08-28T20:32:40.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:39 smithi001 ceph-mon[20984]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.5 MiB/s wr, 615 op/s 2024-08-28T20:32:40.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:39 smithi121 ceph-mon[25248]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.5 MiB/s wr, 615 op/s 2024-08-28T20:32:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:39 smithi007 ceph-mon[25357]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.5 MiB/s wr, 615 op/s 2024-08-28T20:32:42.116 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:41 smithi007 ceph-mon[25357]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 634 op/s 2024-08-28T20:32:42.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:41 smithi121 ceph-mon[25248]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 634 op/s 2024-08-28T20:32:42.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:41 smithi001 ceph-mon[20984]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.5 MiB/s wr, 634 op/s 2024-08-28T20:32:43.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:42 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:32:43.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:42 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 -- 172.21.15.1:0/2027523973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 msgr2=0x7fc16410b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 --2- 172.21.15.1:0/2027523973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16410b830 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ca0 tx=0x7fc15c02a8b0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 -- 172.21.15.1:0/2027523973 shutdown_connections 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 --2- 172.21.15.1:0/2027523973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1641044f0 0x7fc164104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 --2- 172.21.15.1:0/2027523973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16410b830 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 --2- 172.21.15.1:0/2027523973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc164103470 0x7fc1641038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 -- 172.21.15.1:0/2027523973 >> 172.21.15.1:0/2027523973 conn(0x7fc1640fedd0 msgr2=0x7fc164101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 -- 172.21.15.1:0/2027523973 shutdown_connections 2024-08-28T20:32:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.248+0000 7fc169400640 1 -- 172.21.15.1:0/2027523973 wait complete. 2024-08-28T20:32:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.251+0000 7fc169400640 1 Processor -- start 2024-08-28T20:32:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.251+0000 7fc169400640 1 -- start start 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.252+0000 7fc169400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc164103470 0x7fc16419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.252+0000 7fc169400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1641044f0 0x7fc16419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.252+0000 7fc169400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.252+0000 7fc169400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc16410f100 con 0x7fc164103470 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.252+0000 7fc169400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc16410ef80 con 0x7fc1641044f0 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.252+0000 7fc169400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc16410f280 con 0x7fc164104e90 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.253+0000 7fc161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1641044f0 0x7fc16419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.254+0000 7fc163200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.254+0000 7fc163200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16419d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:50578/0 (socket says 172.21.15.1:50578) 2024-08-28T20:32:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.254+0000 7fc163200640 1 -- 172.21.15.1:0/3457454878 learned_addr learned my addr 172.21.15.1:0/3457454878 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.259+0000 7fc161e00640 1 -- 172.21.15.1:0/3457454878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 msgr2=0x7fc16419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.259+0000 7fc161e00640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.259+0000 7fc161e00640 1 -- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc164103470 msgr2=0x7fc16419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.259+0000 7fc161e00640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc164103470 0x7fc16419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.259+0000 7fc161e00640 1 -- 172.21.15.1:0/3457454878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16419d8f0 con 0x7fc1641044f0 2024-08-28T20:32:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.262+0000 7fc161e00640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1641044f0 0x7fc16419c520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc15000e9f0 tx=0x7fc15000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.263+0000 7fc15b400640 1 -- 172.21.15.1:0/3457454878 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15000ccc0 con 0x7fc1641044f0 2024-08-28T20:32:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.264+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16419dbe0 con 0x7fc1641044f0 2024-08-28T20:32:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.264+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1641059e0 con 0x7fc1641044f0 2024-08-28T20:32:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.265+0000 7fc15b400640 1 -- 172.21.15.1:0/3457454878 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1500108e0 con 0x7fc1641044f0 2024-08-28T20:32:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.265+0000 7fc15b400640 1 -- 172.21.15.1:0/3457454878 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1500188e0 con 0x7fc1641044f0 2024-08-28T20:32:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.272+0000 7fc17047d740 1 Processor -- start 2024-08-28T20:32:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.273+0000 7fc17047d740 1 -- start start 2024-08-28T20:32:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.274+0000 7fc17047d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e2f1b0 0x55a0051d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.274+0000 7fc17047d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.274+0000 7fc17047d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051d5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.274+0000 7fc17047d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a005147f70 con 0x55a004e2f1b0 2024-08-28T20:32:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.274+0000 7fc17047d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a005137500 con 0x55a004e062f0 2024-08-28T20:32:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.274+0000 7fc17047d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a00513b4b0 con 0x55a004e0e4d0 2024-08-28T20:32:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc15b400640 1 -- 172.21.15.1:0/3457454878 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fc150010430 con 0x7fc1641044f0 2024-08-28T20:32:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57334/0 (socket says 172.21.15.1:57334) 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 -- 172.21.15.1:0/4091215704 learned_addr learned my addr 172.21.15.1:0/4091215704 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc161e00640 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051d5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 -- 172.21.15.1:0/4091215704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 msgr2=0x55a0051d5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051d5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 -- 172.21.15.1:0/4091215704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e2f1b0 msgr2=0x55a0051d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e2f1b0 0x55a0051d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.276+0000 7fc162800640 1 -- 172.21.15.1:0/4091215704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0050f1c10 con 0x55a004e062f0 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.277+0000 7fc162800640 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d5430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc15400bb10 tx=0x7fc15400d2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=496cf3997a2748c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.277+0000 7fc14f400640 1 -- 172.21.15.1:0/4091215704 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154016070 con 0x55a004e062f0 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.278+0000 7fc14f400640 1 -- 172.21.15.1:0/4091215704 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc15400dce0 con 0x55a004e062f0 2024-08-28T20:32:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.278+0000 7fc14f400640 1 -- 172.21.15.1:0/4091215704 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154010460 con 0x55a004e062f0 2024-08-28T20:32:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.279+0000 7fc17047d740 1 -- 172.21.15.1:0/4091215704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 msgr2=0x55a0051d5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.279+0000 7fc17047d740 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d5430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc15400bb10 tx=0x7fc15400d2e0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.281+0000 7fc17047d740 1 -- 172.21.15.1:0/4091215704 shutdown_connections 2024-08-28T20:32:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.281+0000 7fc17047d740 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051d5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.281+0000 7fc17047d740 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d5430 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.281+0000 7fc17047d740 1 --2- 172.21.15.1:0/4091215704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e2f1b0 0x55a0051d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.281+0000 7fc17047d740 1 -- 172.21.15.1:0/4091215704 >> 172.21.15.1:0/4091215704 conn(0x55a004e23300 msgr2=0x55a0051d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.281+0000 7fc17047d740 1 -- 172.21.15.1:0/4091215704 shutdown_connections 2024-08-28T20:32:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.283+0000 7fc17047d740 1 -- 172.21.15.1:0/4091215704 wait complete. 2024-08-28T20:32:43.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.283+0000 7fc17047d740 1 -- start start 2024-08-28T20:32:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 Processor -- start 2024-08-28T20:32:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e062f0 0x55a0051de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051deba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e2f1b0 0x55a0051df710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a005070ab0 con 0x55a004e062f0 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0050de320 con 0x55a004e2f1b0 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.286+0000 7fc17047d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a0051d6aa0 con 0x55a004e0e4d0 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc17047d740 10 client.0 _ll_register_callbacks cb 0x55a0050e46a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc162800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc162800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051deba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:50606/0 (socket says 172.21.15.1:50606) 2024-08-28T20:32:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc162800640 1 -- 172.21.15.1:0/4082500504 learned_addr learned my addr 172.21.15.1:0/4082500504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc161e00640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e2f1b0 0x55a0051df710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc162800640 1 -- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e2f1b0 msgr2=0x55a0051df710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc162800640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e2f1b0 0x55a0051df710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.287+0000 7fc162800640 1 -- 172.21.15.1:0/4082500504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e062f0 msgr2=0x55a0051de4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:32:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.288+0000 7fc163200640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e062f0 0x55a0051de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.288+0000 7fc162800640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e062f0 0x55a0051de4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.288+0000 7fc162800640 1 -- 172.21.15.1:0/4082500504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a004e9a790 con 0x55a004e0e4d0 2024-08-28T20:32:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.288+0000 7fc163200640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e062f0 0x55a0051de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:43.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.288+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc15400dce0 con 0x55a004e0e4d0 2024-08-28T20:32:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.291+0000 7fc162800640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051deba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc1540049d0 tx=0x7fc15400b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=479c421aa8fffb36 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.291+0000 7fc143e00640 10 client.26251 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:32:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.291+0000 7fc15b400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc1480b4ac0 0x7fc1480b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.291+0000 7fc15b400640 1 -- 172.21.15.1:0/3457454878 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc1500e54e0 con 0x7fc1641044f0 2024-08-28T20:32:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.292+0000 7fc163200640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc1480b4ac0 0x7fc1480b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.292+0000 7fc143e00640 1 -- 172.21.15.1:0/4082500504 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154016070 con 0x55a004e0e4d0 2024-08-28T20:32:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.292+0000 7fc143e00640 1 -- 172.21.15.1:0/4082500504 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc154004ea0 con 0x55a004e0e4d0 2024-08-28T20:32:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.292+0000 7fc143e00640 1 -- 172.21.15.1:0/4082500504 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc1540050e0 con 0x55a004e0e4d0 2024-08-28T20:32:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.294+0000 7fc17047d740 10 client.26251 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.294+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=50}) -- 0x55a004f13620 con 0x55a004e0e4d0 2024-08-28T20:32:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.294+0000 7fc143e00640 1 -- 172.21.15.1:0/4082500504 <== mon.1 v2:172.21.15.121:3300/0 4 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fc154005280 con 0x55a004e0e4d0 2024-08-28T20:32:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc17047d740 10 client.26251 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc17047d740 10 client.26251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc17047d740 20 client.26251 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc17047d740 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dedd80 0x55a0051eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc17047d740 4 client.26251 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a005149ec0 con 0x55a004dedd80 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc163200640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc1480b4ac0 0x7fc1480b6fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0096c0 tx=0x7fc15c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.295+0000 7fc161e00640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dedd80 0x55a0051eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.296+0000 7fc161e00640 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dedd80 0x55a0051eb8d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9935b23fc3beaf33 server_cookie=c96376421c475424 in_seq=0 out_seq=0 2024-08-28T20:32:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.296+0000 7fc143e00640 10 client.26251 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.298+0000 7fc143e00640 1 -- 172.21.15.1:0/4082500504 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a005149ec0 con 0x55a004dedd80 2024-08-28T20:32:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.298+0000 7fc143e00640 10 client.26251 handle_command_reply: tid=0 2024-08-28T20:32:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.298+0000 7fc17047d740 1 client.26251 shutdown 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.298+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 msgr2=0x55a0051deba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.298+0000 7fc17047d740 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051deba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc1540049d0 tx=0x7fc15400b800 comp rx=0 tx=0).stop 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 shutdown_connections 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc17047d740 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dedd80 0x55a0051eb8d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc17047d740 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e2f1b0 0x55a0051df710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc17047d740 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e0e4d0 0x55a0051deba0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc143e00640 0 client.26251 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc17047d740 1 --2- 172.21.15.1:0/4082500504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e062f0 0x55a0051de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.299+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 >> 172.21.15.1:0/4082500504 conn(0x55a004e23300 msgr2=0x55a0051cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.300+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 shutdown_connections 2024-08-28T20:32:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.300+0000 7fc17047d740 1 -- 172.21.15.1:0/4082500504 wait complete. 2024-08-28T20:32:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.301+0000 7fc17047d740 20 client.26251 trim_cache size 0 max 16384 2024-08-28T20:32:43.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:42 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:32:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.356+0000 7fc17047d740 1 Processor -- start 2024-08-28T20:32:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 -- start start 2024-08-28T20:32:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051d97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051d5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc144010ce0 con 0x55a004e0e4d0 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc14400e5b0 con 0x55a004e062f0 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.357+0000 7fc17047d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc14400c400 con 0x55a004e2f1b0 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57356/0 (socket says 172.21.15.1:57356) 2024-08-28T20:32:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 -- 172.21.15.1:0/231565366 learned_addr learned my addr 172.21.15.1:0/231565366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 -- 172.21.15.1:0/231565366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 msgr2=0x55a0051d5c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051d5c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 -- 172.21.15.1:0/231565366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 msgr2=0x55a0051d97a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051d97a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.358+0000 7fc162800640 1 -- 172.21.15.1:0/231565366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0051d0f80 con 0x55a004e062f0 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.359+0000 7fc162800640 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d0470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc15400bb10 tx=0x7fc15401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb8ef6baffd4e96 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.359+0000 7fc14ea00640 1 -- 172.21.15.1:0/231565366 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154004b70 con 0x55a004e062f0 2024-08-28T20:32:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.360+0000 7fc14ea00640 1 -- 172.21.15.1:0/231565366 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc15400dce0 con 0x55a004e062f0 2024-08-28T20:32:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.360+0000 7fc14ea00640 1 -- 172.21.15.1:0/231565366 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15402e890 con 0x55a004e062f0 2024-08-28T20:32:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 -- 172.21.15.1:0/231565366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 msgr2=0x55a0051d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d0470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc15400bb10 tx=0x7fc15401d000 comp rx=0 tx=0).stop 2024-08-28T20:32:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 -- 172.21.15.1:0/231565366 shutdown_connections 2024-08-28T20:32:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051d97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051d5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 --2- 172.21.15.1:0/231565366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a0051d0470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.365+0000 7fc17047d740 1 -- 172.21.15.1:0/231565366 >> 172.21.15.1:0/231565366 conn(0x55a004e23300 msgr2=0x55a0051cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.366+0000 7fc17047d740 1 -- 172.21.15.1:0/231565366 shutdown_connections 2024-08-28T20:32:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.366+0000 7fc17047d740 1 -- 172.21.15.1:0/231565366 wait complete. 2024-08-28T20:32:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.367+0000 7fc17047d740 1 -- start start 2024-08-28T20:32:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.367+0000 7fc17047d740 1 Processor -- start 2024-08-28T20:32:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.369+0000 7fc17047d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a005253ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.369+0000 7fc17047d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.369+0000 7fc162800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a005253ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.369+0000 7fc17047d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc17047d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc14400ca70 con 0x55a004e0e4d0 2024-08-28T20:32:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc163200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc163200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051e4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:50634/0 (socket says 172.21.15.1:50634) 2024-08-28T20:32:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc163200640 1 -- 172.21.15.1:0/2702873141 learned_addr learned my addr 172.21.15.1:0/2702873141 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc14400dee0 con 0x55a004e062f0 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc14400d140 con 0x55a004e2f1b0 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.370+0000 7fc17047d740 10 client.0 _ll_register_callbacks cb 0x7fc15400b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.371+0000 7fc163200640 1 -- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 msgr2=0x55a005253ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.372+0000 7fc161e00640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.372+0000 7fc163200640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a005253ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.372+0000 7fc163200640 1 -- 172.21.15.1:0/2702873141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 msgr2=0x55a0051e4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.372+0000 7fc163200640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051e4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.372+0000 7fc163200640 1 -- 172.21.15.1:0/2702873141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0051e5660 con 0x55a004e2f1b0 2024-08-28T20:32:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.372+0000 7fc162800640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a005253ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.373+0000 7fc161e00640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.375+0000 7fc163200640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051e4ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc15c030d30 tx=0x7fc15c02a8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fbfbb92ea6a2c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.375+0000 7fc143e00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:32:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.376+0000 7fc143e00640 1 -- 172.21.15.1:0/2702873141 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004450 con 0x55a004e2f1b0 2024-08-28T20:32:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.376+0000 7fc143e00640 1 -- 172.21.15.1:0/2702873141 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc15c0045f0 con 0x55a004e2f1b0 2024-08-28T20:32:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.376+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc15400dce0 con 0x55a004e2f1b0 2024-08-28T20:32:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.378+0000 7fc143e00640 1 -- 172.21.15.1:0/2702873141 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc15c0047f0 con 0x55a004e2f1b0 2024-08-28T20:32:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.378+0000 7fc17047d740 10 client.26254 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.378+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a0052675f0 con 0x55a004e2f1b0 2024-08-28T20:32:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.379+0000 7fc143e00640 1 -- 172.21.15.1:0/2702873141 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc15400dce0 con 0x55a004e2f1b0 2024-08-28T20:32:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.382+0000 7fc143e00640 1 -- 172.21.15.1:0/2702873141 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fc15c04e070 con 0x55a004e2f1b0 2024-08-28T20:32:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc17047d740 10 client.26254 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc17047d740 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc17047d740 20 client.26254 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc17047d740 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dc31c0 0x55a00526a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc17047d740 4 client.26254 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:32:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a005145960 con 0x55a004dc31c0 2024-08-28T20:32:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.383+0000 7fc162800640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dc31c0 0x55a00526a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.386+0000 7fc143e00640 10 client.26254 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.386+0000 7fc162800640 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dc31c0 0x55a00526a060 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2bb126fe4866f7e server_cookie=db38b0ad60d21e3 in_seq=0 out_seq=0 2024-08-28T20:32:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.442+0000 7fc143e00640 1 -- 172.21.15.1:0/2702873141 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a005145960 con 0x55a004dc31c0 2024-08-28T20:32:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.442+0000 7fc143e00640 10 client.26254 handle_command_reply: tid=0 2024-08-28T20:32:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 client.26254 shutdown 2024-08-28T20:32:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 msgr2=0x55a0051e4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051e4ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc15c030d30 tx=0x7fc15c02a8b0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 shutdown_connections 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55a004dc31c0 0x55a00526a060 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a004e0e4d0 0x55a0051e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a004e2f1b0 0x55a0051e4ed0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 --2- 172.21.15.1:0/2702873141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a004e062f0 0x55a005253ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc143e00640 0 client.26254 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.443+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 >> 172.21.15.1:0/2702873141 conn(0x55a004e23300 msgr2=0x55a0051dd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.444+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 shutdown_connections 2024-08-28T20:32:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.444+0000 7fc17047d740 1 -- 172.21.15.1:0/2702873141 wait complete. 2024-08-28T20:32:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.444+0000 7fc17047d740 20 client.26254 trim_cache size 0 max 16384 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc1480b4ac0 msgr2=0x7fc1480b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc1480b4ac0 0x7fc1480b6fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0096c0 tx=0x7fc15c005da0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1641044f0 msgr2=0x7fc16419c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1641044f0 0x7fc16419c520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc15000e9f0 tx=0x7fc15000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 shutdown_connections 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc1480b4ac0 0x7fc1480b6fd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc164104e90 0x7fc16419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1641044f0 0x7fc16419c520 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 --2- 172.21.15.1:0/3457454878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc164103470 0x7fc16419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 >> 172.21.15.1:0/3457454878 conn(0x7fc1640fedd0 msgr2=0x7fc164075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 shutdown_connections 2024-08-28T20:32:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:43.445+0000 7fc169400640 1 -- 172.21.15.1:0/3457454878 wait complete. 2024-08-28T20:32:43.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 855.0 s, 1431.6 tps, lat 69.864 ms stddev 83.402 2024-08-28T20:32:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:43 smithi001 ceph-mon[20984]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 5.9 MiB/s wr, 602 op/s 2024-08-28T20:32:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:32:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:32:44.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:43 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:32:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:43 smithi121 ceph-mon[25248]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 5.9 MiB/s wr, 602 op/s 2024-08-28T20:32:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:32:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:32:44.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:43 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:32:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:43 smithi007 ceph-mon[25357]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 5.9 MiB/s wr, 602 op/s 2024-08-28T20:32:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:32:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:32:44.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:43 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:32:46.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:45 smithi001 ceph-mon[20984]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 MiB/s wr, 681 op/s 2024-08-28T20:32:46.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:45 smithi121 ceph-mon[25248]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 MiB/s wr, 681 op/s 2024-08-28T20:32:46.317 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:45 smithi007 ceph-mon[25357]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 MiB/s wr, 681 op/s 2024-08-28T20:32:48.154 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:47 smithi001 ceph-mon[20984]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-08-28T20:32:48.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:47 smithi121 ceph-mon[25248]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-08-28T20:32:48.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:47 smithi007 ceph-mon[25357]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-08-28T20:32:48.766 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 860.0 s, 1554.0 tps, lat 63.967 ms stddev 76.676 2024-08-28T20:32:50.158 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:49 smithi001 ceph-mon[20984]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 625 op/s 2024-08-28T20:32:50.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:49 smithi121 ceph-mon[25248]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 625 op/s 2024-08-28T20:32:50.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:49 smithi007 ceph-mon[25357]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 625 op/s 2024-08-28T20:32:52.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:51 smithi001 ceph-mon[20984]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.8 MiB/s wr, 626 op/s 2024-08-28T20:32:52.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:51 smithi121 ceph-mon[25248]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.8 MiB/s wr, 626 op/s 2024-08-28T20:32:52.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:51 smithi007 ceph-mon[25357]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.8 MiB/s wr, 626 op/s 2024-08-28T20:32:53.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 865.0 s, 1834.6 tps, lat 54.716 ms stddev 66.403 2024-08-28T20:32:54.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:53 smithi001 ceph-mon[20984]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.7 MiB/s wr, 607 op/s 2024-08-28T20:32:54.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:53 smithi121 ceph-mon[25248]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.7 MiB/s wr, 607 op/s 2024-08-28T20:32:54.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:53 smithi007 ceph-mon[25357]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 5.7 MiB/s wr, 607 op/s 2024-08-28T20:32:56.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:55 smithi001 ceph-mon[20984]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.8 MiB/s wr, 701 op/s 2024-08-28T20:32:56.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:55 smithi121 ceph-mon[25248]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.8 MiB/s wr, 701 op/s 2024-08-28T20:32:56.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:55 smithi007 ceph-mon[25357]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.8 MiB/s wr, 701 op/s 2024-08-28T20:32:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 -- 172.21.15.1:0/2446220353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f810b290 msgr2=0x7f42f810d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 --2- 172.21.15.1:0/2446220353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f810b290 0x7f42f810d6d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009900 tx=0x7f42e802a400 comp rx=0 tx=0).stop 2024-08-28T20:32:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 -- 172.21.15.1:0/2446220353 shutdown_connections 2024-08-28T20:32:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 --2- 172.21.15.1:0/2446220353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42f8075a10 0x7f42f8075e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 --2- 172.21.15.1:0/2446220353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f810b290 0x7f42f810d6d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 --2- 172.21.15.1:0/2446220353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42f8076e10 0x7f42f80754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 -- 172.21.15.1:0/2446220353 >> 172.21.15.1:0/2446220353 conn(0x7f42f80febe0 msgr2=0x7f42f8101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.758+0000 7f42fdc00640 1 -- 172.21.15.1:0/2446220353 shutdown_connections 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.759+0000 7f42fdc00640 1 -- 172.21.15.1:0/2446220353 wait complete. 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.760+0000 7f42fdc00640 1 Processor -- start 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 -- start start 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42f8075a10 0x7f42f81a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 0x7f42f81a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42f810b290 0x7f42f81a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81110f0 con 0x7f42f8075a10 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8110f70 con 0x7f42f810b290 2024-08-28T20:32:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.761+0000 7f42fdc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8111270 con 0x7f42f8076e10 2024-08-28T20:32:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.762+0000 7f42f7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 0x7f42f81a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.762+0000 7f42f7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 0x7f42f81a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39998/0 (socket says 172.21.15.1:39998) 2024-08-28T20:32:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.762+0000 7f42f7400640 1 -- 172.21.15.1:0/1025213581 learned_addr learned my addr 172.21.15.1:0/1025213581 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.762+0000 7f42fd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42f810b290 0x7f42f81a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.762+0000 7f42f7e00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42f8075a10 0x7f42f81a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.762+0000 7f42f7400640 1 -- 172.21.15.1:0/1025213581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42f810b290 msgr2=0x7f42f81a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.763+0000 7f42f7400640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42f810b290 0x7f42f81a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.763+0000 7f42f7400640 1 -- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42f8075a10 msgr2=0x7f42f81a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.763+0000 7f42f7400640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42f8075a10 0x7f42f81a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.763+0000 7f42f7400640 1 -- 172.21.15.1:0/1025213581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f81a1b10 con 0x7f42f8076e10 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.763+0000 7f42f7400640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 0x7f42f81a0740 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42e000cce0 tx=0x7f42e000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.764+0000 7f42f4c00640 1 -- 172.21.15.1:0/1025213581 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0004b20 con 0x7f42f8076e10 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.764+0000 7f42f4c00640 1 -- 172.21.15.1:0/1025213581 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e0004cc0 con 0x7f42f8076e10 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.764+0000 7f42f4c00640 1 -- 172.21.15.1:0/1025213581 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e000f6b0 con 0x7f42f8076e10 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.764+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f81a1e00 con 0x7f42f8076e10 2024-08-28T20:32:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.764+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f81a84f0 con 0x7f42f8076e10 2024-08-28T20:32:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.769+0000 7f430626b740 1 Processor -- start 2024-08-28T20:32:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.769+0000 7f430626b740 1 -- start start 2024-08-28T20:32:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f430626b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6eed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f430626b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f430626b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d6eff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f430626b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cd3d661f70 con 0x55cd3d3202f0 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f430626b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cd3d651500 con 0x55cd3d3284d0 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f430626b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cd3d6554b0 con 0x55cd3d3491b0 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f42f4c00640 1 -- 172.21.15.1:0/1025213581 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f42e000f850 con 0x7f42f8076e10 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f42f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d6eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f42f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d6eff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:57340/0 (socket says 172.21.15.1:57340) 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.770+0000 7f42f7400640 1 -- 172.21.15.1:0/68807321 learned_addr learned my addr 172.21.15.1:0/68807321 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7e00640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42fd200640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7400640 1 -- 172.21.15.1:0/68807321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 msgr2=0x55cd3d6eed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7400640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6eed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7400640 1 -- 172.21.15.1:0/68807321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 msgr2=0x55cd3d6ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7400640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7400640 1 -- 172.21.15.1:0/68807321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3d60bc10 con 0x55cd3d3284d0 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7e00640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42fd200640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.771+0000 7f42f7400640 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d6eff00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f42e00ed210 tx=0x7f42e00ed6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9077ba1106d4dba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.772+0000 7f42ed600640 1 -- 172.21.15.1:0/68807321 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00e8050 con 0x55cd3d3284d0 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.772+0000 7f42ed600640 1 -- 172.21.15.1:0/68807321 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e00e7630 con 0x55cd3d3284d0 2024-08-28T20:32:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.772+0000 7f42ed600640 1 -- 172.21.15.1:0/68807321 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00e57a0 con 0x55cd3d3284d0 2024-08-28T20:32:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f42f4c00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f42dc0b4cf0 0x7f42dc0b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f42f4c00640 1 -- 172.21.15.1:0/1025213581 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f42e00e5110 con 0x7f42f8076e10 2024-08-28T20:32:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 -- 172.21.15.1:0/68807321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 msgr2=0x55cd3d6eff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d6eff00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f42e00ed210 tx=0x7f42e00ed6d0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f42fd200640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f42dc0b4cf0 0x7f42dc0b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 -- 172.21.15.1:0/68807321 shutdown_connections 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d6eff00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 --2- 172.21.15.1:0/68807321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 -- 172.21.15.1:0/68807321 >> 172.21.15.1:0/68807321 conn(0x55cd3d33d300 msgr2=0x55cd3d6ea7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 -- 172.21.15.1:0/68807321 shutdown_connections 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.773+0000 7f430626b740 1 -- 172.21.15.1:0/68807321 wait complete. 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.774+0000 7f42fd200640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f42dc0b4cf0 0x7f42dc0b7200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42e8004770 tx=0x7f42e80314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.774+0000 7f430626b740 1 -- start start 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.774+0000 7f430626b740 1 Processor -- start 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 0x55cd3d6f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cd3d58aab0 con 0x55cd3d3491b0 2024-08-28T20:32:56.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cd3d5f8320 con 0x55cd3d3202f0 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cd3d6f0a20 con 0x55cd3d3284d0 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f430626b740 10 client.0 _ll_register_callbacks cb 0x55cd3d631e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f42f7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 0x55cd3d6f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f42f7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 0x55cd3d6f8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:40012/0 (socket says 172.21.15.1:40012) 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.775+0000 7f42f7400640 1 -- 172.21.15.1:0/2524486139 learned_addr learned my addr 172.21.15.1:0/2524486139 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.776+0000 7f42fd200640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.776+0000 7f42f7e00640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.777+0000 7f42f7e00640 1 -- 172.21.15.1:0/2524486139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 msgr2=0x55cd3d6f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.777+0000 7f42f7e00640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 0x55cd3d6f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.777+0000 7f42f7e00640 1 -- 172.21.15.1:0/2524486139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 msgr2=0x55cd3d6f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.777+0000 7f42f7e00640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.777+0000 7f42f7e00640 1 -- 172.21.15.1:0/2524486139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3d3b4790 con 0x55cd3d3202f0 2024-08-28T20:32:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.777+0000 7f42f7400640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 0x55cd3d6f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:32:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.778+0000 7f42f7e00640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f8350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42f0012700 tx=0x7f42f0012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c192d51e97838d5d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.778+0000 7f42e6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:32:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.778+0000 7f42e6000640 1 -- 172.21.15.1:0/2524486139 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0004460 con 0x55cd3d3202f0 2024-08-28T20:32:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.778+0000 7f42e6000640 1 -- 172.21.15.1:0/2524486139 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f42f00109b0 con 0x55cd3d3202f0 2024-08-28T20:32:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.778+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42e00e7630 con 0x55cd3d3202f0 2024-08-28T20:32:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.779+0000 7f42e6000640 1 -- 172.21.15.1:0/2524486139 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f42f0010bb0 con 0x55cd3d3202f0 2024-08-28T20:32:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.779+0000 7f430626b740 10 client.26285 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.779+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55cd3d42d620 con 0x55cd3d3202f0 2024-08-28T20:32:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.780+0000 7f42e6000640 1 -- 172.21.15.1:0/2524486139 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e00e7630 con 0x55cd3d3202f0 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.780+0000 7f42e6000640 1 -- 172.21.15.1:0/2524486139 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f42f0024050 con 0x55cd3d3202f0 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.780+0000 7f430626b740 10 client.26285 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f430626b740 10 client.26285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f430626b740 20 client.26285 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f430626b740 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d307d80 0x55cd3d7059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f430626b740 4 client.26285 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd3d663ec0 con 0x55cd3d307d80 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f42f7400640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d307d80 0x55cd3d7059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f42f7400640 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d307d80 0x55cd3d7059d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1bc240b46e7ccf server_cookie=3e2f6837bc098b46 in_seq=0 out_seq=0 2024-08-28T20:32:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.781+0000 7f42e6000640 10 client.26285 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.782+0000 7f42e6000640 1 -- 172.21.15.1:0/2524486139 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd3d663ec0 con 0x55cd3d307d80 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.782+0000 7f42e6000640 10 client.26285 handle_command_reply: tid=0 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.782+0000 7f430626b740 1 client.26285 shutdown 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3202f0 msgr2=0x55cd3d6f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f8350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42f0012700 tx=0x7f42f0012bc0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 shutdown_connections 2024-08-28T20:32:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d307d80 0x55cd3d7059d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3284d0 0x55cd3d6f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 --2- 172.21.15.1:0/2524486139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f8350 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 >> 172.21.15.1:0/2524486139 conn(0x55cd3d33d300 msgr2=0x55cd3d6e8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.783+0000 7f42e6000640 0 client.26285 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.784+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 shutdown_connections 2024-08-28T20:32:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.784+0000 7f430626b740 1 -- 172.21.15.1:0/2524486139 wait complete. 2024-08-28T20:32:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.784+0000 7f430626b740 20 client.26285 trim_cache size 0 max 16384 2024-08-28T20:32:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.812+0000 7f430626b740 1 Processor -- start 2024-08-28T20:32:56.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.812+0000 7f430626b740 1 -- start start 2024-08-28T20:32:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.813+0000 7f430626b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.813+0000 7f430626b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.813+0000 7f430626b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.813+0000 7f430626b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81b3a20 con 0x55cd3d3202f0 2024-08-28T20:32:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.813+0000 7f430626b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81b12f0 con 0x55cd3d3284d0 2024-08-28T20:32:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.813+0000 7f430626b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81af140 con 0x55cd3d3491b0 2024-08-28T20:32:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.814+0000 7f42fd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.814+0000 7f42f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.814+0000 7f42fd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49098/0 (socket says 172.21.15.1:49098) 2024-08-28T20:32:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.814+0000 7f42fd200640 1 -- 172.21.15.1:0/1985949487 learned_addr learned my addr 172.21.15.1:0/1985949487 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.814+0000 7f42f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52824/0 (socket says 172.21.15.1:52824) 2024-08-28T20:32:56.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.816+0000 7f42f7e00640 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.816+0000 7f42f7400640 1 -- 172.21.15.1:0/1985949487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 msgr2=0x55cd3d6f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.816+0000 7f42f7400640 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.816+0000 7f42f7400640 1 -- 172.21.15.1:0/1985949487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 msgr2=0x55cd3d6f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.817+0000 7f42f7400640 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.817+0000 7f42f7400640 1 -- 172.21.15.1:0/1985949487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3d6e5fa0 con 0x55cd3d3284d0 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.817+0000 7f42f7400640 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f42e00aba60 tx=0x7f42e00e8ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f05ffa6998e627b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.818+0000 7f42ecc00640 1 -- 172.21.15.1:0/1985949487 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e001d070 con 0x55cd3d3284d0 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.818+0000 7f42ecc00640 1 -- 172.21.15.1:0/1985949487 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e00e8d40 con 0x55cd3d3284d0 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.818+0000 7f42ecc00640 1 -- 172.21.15.1:0/1985949487 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00ac1d0 con 0x55cd3d3284d0 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.819+0000 7f430626b740 1 -- 172.21.15.1:0/1985949487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 msgr2=0x55cd3d700460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.819+0000 7f430626b740 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f42e00aba60 tx=0x7f42e00e8ad0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.820+0000 7f430626b740 1 -- 172.21.15.1:0/1985949487 shutdown_connections 2024-08-28T20:32:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.821+0000 7f430626b740 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3491b0 0x55cd3d6f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.821+0000 7f430626b740 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.821+0000 7f430626b740 1 --2- 172.21.15.1:0/1985949487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3202f0 0x55cd3d6f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.821+0000 7f430626b740 1 -- 172.21.15.1:0/1985949487 >> 172.21.15.1:0/1985949487 conn(0x55cd3d33d300 msgr2=0x55cd3d6f2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.822+0000 7f430626b740 1 -- 172.21.15.1:0/1985949487 shutdown_connections 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.822+0000 7f430626b740 1 -- 172.21.15.1:0/1985949487 wait complete. 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.822+0000 7f430626b740 1 -- start start 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.823+0000 7f430626b740 1 Processor -- start 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.827+0000 7f430626b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.827+0000 7f430626b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.827+0000 7f430626b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.827+0000 7f430626b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81af7b0 con 0x55cd3d3491b0 2024-08-28T20:32:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.827+0000 7f430626b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81b0c20 con 0x55cd3d3284d0 2024-08-28T20:32:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.827+0000 7f430626b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81afe80 con 0x55cd3d3202f0 2024-08-28T20:32:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.828+0000 7f430626b740 10 client.0 _ll_register_callbacks cb 0x7f42f0009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:32:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.828+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.828+0000 7f42f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.829+0000 7f42fd200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.829+0000 7f42f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:52836/0 (socket says 172.21.15.1:52836) 2024-08-28T20:32:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.829+0000 7f42f7400640 1 -- 172.21.15.1:0/332866209 learned_addr learned my addr 172.21.15.1:0/332866209 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:32:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.830+0000 7f42fd200640 1 -- 172.21.15.1:0/332866209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3202f0 msgr2=0x55cd3d6ffcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.830+0000 7f42fd200640 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ffcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.830+0000 7f42fd200640 1 -- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 msgr2=0x55cd3d700390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:32:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.830+0000 7f42fd200640 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.830+0000 7f42fd200640 1 -- 172.21.15.1:0/332866209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3d6ff210 con 0x55cd3d3491b0 2024-08-28T20:32:56.835 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.830+0000 7f42f7400640 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:32:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.833+0000 7f42fd200640 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6feaa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f42f80764b0 tx=0x7f42e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b43f744c9454b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:32:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.833+0000 7f42e6000640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-08-28T20:32:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.834+0000 7f42e6000640 1 -- 172.21.15.1:0/332866209 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8031930 con 0x55cd3d3491b0 2024-08-28T20:32:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.834+0000 7f42e6000640 1 -- 172.21.15.1:0/332866209 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f42e8031ad0 con 0x55cd3d3491b0 2024-08-28T20:32:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.834+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42e00e8d40 con 0x55cd3d3491b0 2024-08-28T20:32:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.834+0000 7f42e6000640 1 -- 172.21.15.1:0/332866209 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f42e8031cd0 con 0x55cd3d3491b0 2024-08-28T20:32:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.834+0000 7f430626b740 10 client.15915 fetch_fsmap learned FSMap version 50 2024-08-28T20:32:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.834+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55cd3d6fe0e0 con 0x55cd3d3491b0 2024-08-28T20:32:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.835+0000 7f42e6000640 1 -- 172.21.15.1:0/332866209 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e00e8d40 con 0x55cd3d3491b0 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f42e6000640 1 -- 172.21.15.1:0/332866209 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7f42e805e050 con 0x55cd3d3491b0 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f430626b740 10 client.15915 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f430626b740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f430626b740 20 client.15915 populate_metadata read hostname 'smithi001' 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f430626b740 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d2dd1c0 0x55cd3d772970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f430626b740 4 client.15915 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.838+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd3d65f960 con 0x55cd3d2dd1c0 2024-08-28T20:32:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.840+0000 7f42f7e00640 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d2dd1c0 0x55cd3d772970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:32:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.841+0000 7f42e6000640 10 client.15915 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.841+0000 7f42f7e00640 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d2dd1c0 0x55cd3d772970 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ab3673765d2b84 server_cookie=1ff16e3b4732b21e in_seq=0 out_seq=0 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.876+0000 7f42e6000640 1 -- 172.21.15.1:0/332866209 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd3d65f960 con 0x55cd3d2dd1c0 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.876+0000 7f42e6000640 10 client.15915 handle_command_reply: tid=0 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.876+0000 7f430626b740 1 client.15915 shutdown 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.876+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 msgr2=0x55cd3d6feaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.876+0000 7f430626b740 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6feaa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f42f80764b0 tx=0x7f42e8009260 comp rx=0 tx=0).stop 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 shutdown_connections 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x55cd3d2dd1c0 0x55cd3d772970 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd3d3491b0 0x55cd3d6feaa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd3d3284d0 0x55cd3d700390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 --2- 172.21.15.1:0/332866209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd3d3202f0 0x55cd3d6ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 >> 172.21.15.1:0/332866209 conn(0x55cd3d33d300 msgr2=0x55cd3d6eb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f42e6000640 0 client.15915 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 shutdown_connections 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 1 -- 172.21.15.1:0/332866209 wait complete. 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.877+0000 7f430626b740 20 client.15915 trim_cache size 0 max 16384 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:32:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:32:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f42dc0b4cf0 msgr2=0x7f42dc0b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f42dc0b4cf0 0x7f42dc0b7200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42e8004770 tx=0x7f42e80314c0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 msgr2=0x7f42f81a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:32:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 0x7f42f81a0740 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42e000cce0 tx=0x7f42e000a620 comp rx=0 tx=0).stop 2024-08-28T20:32:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 shutdown_connections 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f42dc0b4cf0 0x7f42dc0b7200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42f810b290 0x7f42f81a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f8076e10 0x7f42f81a0740 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 --2- 172.21.15.1:0/1025213581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42f8075a10 0x7f42f81a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.878+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 >> 172.21.15.1:0/1025213581 conn(0x7f42f80febe0 msgr2=0x7f42f8101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.879+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 shutdown_connections 2024-08-28T20:32:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:32:56.879+0000 7f42fdc00640 1 -- 172.21.15.1:0/1025213581 wait complete. 2024-08-28T20:32:58.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:57 smithi001 ceph-mon[20984]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-08-28T20:32:58.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:57 smithi121 ceph-mon[25248]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-08-28T20:32:58.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:57 smithi007 ceph-mon[25357]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 674 op/s 2024-08-28T20:32:58.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 870.0 s, 1944.0 tps, lat 51.278 ms stddev 58.820 2024-08-28T20:33:00.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:32:59 smithi001 ceph-mon[20984]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 654 op/s 2024-08-28T20:33:00.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:32:59 smithi121 ceph-mon[25248]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 654 op/s 2024-08-28T20:33:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:32:59 smithi007 ceph-mon[25357]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 654 op/s 2024-08-28T20:33:02.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:01 smithi001 ceph-mon[20984]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-08-28T20:33:02.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:01 smithi121 ceph-mon[25248]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-08-28T20:33:02.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:01 smithi007 ceph-mon[25357]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-08-28T20:33:03.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 875.0 s, 1071.6 tps, lat 93.334 ms stddev 116.647 2024-08-28T20:33:04.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:03 smithi001 ceph-mon[20984]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.2 MiB/s wr, 648 op/s 2024-08-28T20:33:04.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:03 smithi121 ceph-mon[25248]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.2 MiB/s wr, 648 op/s 2024-08-28T20:33:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:03 smithi007 ceph-mon[25357]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.2 MiB/s wr, 648 op/s 2024-08-28T20:33:06.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:05 smithi001 ceph-mon[20984]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 MiB/s wr, 632 op/s 2024-08-28T20:33:06.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:05 smithi121 ceph-mon[25248]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 MiB/s wr, 632 op/s 2024-08-28T20:33:06.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:05 smithi007 ceph-mon[25357]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 MiB/s wr, 632 op/s 2024-08-28T20:33:08.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:07 smithi001 ceph-mon[20984]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.4 MiB/s wr, 604 op/s 2024-08-28T20:33:08.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:07 smithi121 ceph-mon[25248]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.4 MiB/s wr, 604 op/s 2024-08-28T20:33:08.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:07 smithi007 ceph-mon[25357]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.4 MiB/s wr, 604 op/s 2024-08-28T20:33:08.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 880.0 s, 1323.4 tps, lat 75.271 ms stddev 93.634 2024-08-28T20:33:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 -- 172.21.15.1:0/3939679485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4401043b0 msgr2=0x7ff4401047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 --2- 172.21.15.1:0/3939679485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4401043b0 0x7ff4401047c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009900 tx=0x7ff42c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 -- 172.21.15.1:0/3939679485 shutdown_connections 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 --2- 172.21.15.1:0/3939679485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440104d50 0x7ff44010b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 --2- 172.21.15.1:0/3939679485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4401043b0 0x7ff4401047c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 --2- 172.21.15.1:0/3939679485 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff440103330 0x7ff4401037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 -- 172.21.15.1:0/3939679485 >> 172.21.15.1:0/3939679485 conn(0x7ff4400fec50 msgr2=0x7ff440101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 -- 172.21.15.1:0/3939679485 shutdown_connections 2024-08-28T20:33:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.156+0000 7ff43fe00640 1 -- 172.21.15.1:0/3939679485 wait complete. 2024-08-28T20:33:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.157+0000 7ff43fe00640 1 Processor -- start 2024-08-28T20:33:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 -- start start 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440103330 0x7ff440199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4401043b0 0x7ff44019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 0x7ff44019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff44010ef60 con 0x7ff4401043b0 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff44010ede0 con 0x7ff440103330 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff44010f0e0 con 0x7ff440104d50 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 0x7ff44019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440103330 0x7ff440199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43e000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4401043b0 0x7ff44019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440103330 0x7ff440199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51420/0 (socket says 172.21.15.1:51420) 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 0x7ff44019ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54032/0 (socket says 172.21.15.1:54032) 2024-08-28T20:33:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.158+0000 7ff43ea00640 1 -- 172.21.15.1:0/2122941723 learned_addr learned my addr 172.21.15.1:0/2122941723 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.159+0000 7ff43f400640 1 -- 172.21.15.1:0/2122941723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440103330 msgr2=0x7ff440199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.159+0000 7ff43f400640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440103330 0x7ff440199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.159+0000 7ff43f400640 1 -- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4401043b0 msgr2=0x7ff44019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.159+0000 7ff43f400640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4401043b0 0x7ff44019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.159+0000 7ff43f400640 1 -- 172.21.15.1:0/2122941723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44019b550 con 0x7ff440104d50 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.159+0000 7ff43f400640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 0x7ff44019ad30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff438009fd0 tx=0x7ff43800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.160+0000 7ff444a00640 1 -- 172.21.15.1:0/2122941723 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43800ce20 con 0x7ff440104d50 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.160+0000 7ff444a00640 1 -- 172.21.15.1:0/2122941723 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff438005020 con 0x7ff440104d50 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.160+0000 7ff444a00640 1 -- 172.21.15.1:0/2122941723 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438010690 con 0x7ff440104d50 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.160+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44019b840 con 0x7ff440104d50 2024-08-28T20:33:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.160+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4401a1f30 con 0x7ff440104d50 2024-08-28T20:33:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.164+0000 7ff44ce6f740 1 Processor -- start 2024-08-28T20:33:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.166+0000 7ff444a00640 1 -- 172.21.15.1:0/2122941723 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ff4380054d0 con 0x7ff440104d50 2024-08-28T20:33:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.166+0000 7ff44ce6f740 1 -- start start 2024-08-28T20:33:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19015150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c190157c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19016310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562c18f83f70 con 0x562c18c4a4d0 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c18f73500 con 0x562c18c6b1b0 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562c18f774b0 con 0x562c18c422f0 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff43e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19015150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff43e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19015150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51428/0 (socket says 172.21.15.1:51428) 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff43e000640 1 -- 172.21.15.1:0/3318259877 learned_addr learned my addr 172.21.15.1:0/3318259877 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff43ea00640 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c190157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.167+0000 7ff43e000640 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19016310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.168+0000 7ff444a00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff4240b4bf0 0x7ff4240b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff43e000640 1 -- 172.21.15.1:0/3318259877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 msgr2=0x562c190157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff43e000640 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c190157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff43e000640 1 -- 172.21.15.1:0/3318259877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 msgr2=0x562c19015150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff43e000640 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19015150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff43e000640 1 -- 172.21.15.1:0/3318259877 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c18f2dc10 con 0x562c18c4a4d0 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff444a00640 1 -- 172.21.15.1:0/2122941723 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff4380e5760 con 0x7ff440104d50 2024-08-28T20:33:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.169+0000 7ff43f400640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff4240b4bf0 0x7ff4240b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.170+0000 7ff43f400640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff4240b4bf0 0x7ff4240b7100 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff4380a93f0 tx=0x7ff4380057c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.173+0000 7ff43e000640 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19016310 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009230 tx=0x7ff42c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a3e17087bd6d8c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.173+0000 7ff42be00640 1 -- 172.21.15.1:0/3318259877 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c041030 con 0x562c18c4a4d0 2024-08-28T20:33:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.174+0000 7ff42be00640 1 -- 172.21.15.1:0/3318259877 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff42c003c30 con 0x562c18c4a4d0 2024-08-28T20:33:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.174+0000 7ff42be00640 1 -- 172.21.15.1:0/3318259877 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c035070 con 0x562c18c4a4d0 2024-08-28T20:33:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.176+0000 7ff44ce6f740 1 -- 172.21.15.1:0/3318259877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 msgr2=0x562c19016310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.176+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19016310 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009230 tx=0x7ff42c000bc0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.179+0000 7ff44ce6f740 1 -- 172.21.15.1:0/3318259877 shutdown_connections 2024-08-28T20:33:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.179+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19016310 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.179+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c190157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.179+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/3318259877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19015150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.179+0000 7ff44ce6f740 1 -- 172.21.15.1:0/3318259877 >> 172.21.15.1:0/3318259877 conn(0x562c18c5f300 msgr2=0x562c1900c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.182+0000 7ff44ce6f740 1 -- 172.21.15.1:0/3318259877 shutdown_connections 2024-08-28T20:33:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.182+0000 7ff44ce6f740 1 -- 172.21.15.1:0/3318259877 wait complete. 2024-08-28T20:33:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.183+0000 7ff44ce6f740 1 -- start start 2024-08-28T20:33:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.183+0000 7ff44ce6f740 1 Processor -- start 2024-08-28T20:33:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c1901c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 0x562c1901b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c6b1b0 0x562c1901ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562c18eacab0 con 0x562c18c6b1b0 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c18f1a320 con 0x562c18c4a4d0 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562c19016dd0 con 0x562c18c422f0 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff44ce6f740 10 client.0 _ll_register_callbacks cb 0x562c18f53e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff43ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 0x562c1901b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff43ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 0x562c1901b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:51434/0 (socket says 172.21.15.1:51434) 2024-08-28T20:33:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.184+0000 7ff43ea00640 1 -- 172.21.15.1:0/2524963563 learned_addr learned my addr 172.21.15.1:0/2524963563 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.185+0000 7ff43e000640 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c1901c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff43ea00640 1 -- 172.21.15.1:0/2524963563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 msgr2=0x562c1901c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff43ea00640 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c1901c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff43ea00640 1 -- 172.21.15.1:0/2524963563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c6b1b0 msgr2=0x562c1901ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff43ea00640 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c6b1b0 0x562c1901ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff43ea00640 1 -- 172.21.15.1:0/2524963563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c18cd6790 con 0x562c18c4a4d0 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff43ea00640 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 0x562c1901b500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff430012740 tx=0x7ff430012c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d303b065e262571 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.186+0000 7ff428c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:33:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.187+0000 7ff428c00640 1 -- 172.21.15.1:0/2524963563 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43000f920 con 0x562c18c4a4d0 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.187+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff42c003c30 con 0x562c18c4a4d0 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.187+0000 7ff428c00640 1 -- 172.21.15.1:0/2524963563 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff43000fac0 con 0x562c18c4a4d0 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.187+0000 7ff428c00640 1 -- 172.21.15.1:0/2524963563 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff43000fd00 con 0x562c18c4a4d0 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.187+0000 7ff44ce6f740 10 client.26303 fetch_fsmap learned FSMap version 50 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.187+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562c18d4f620 con 0x562c18c4a4d0 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.188+0000 7ff428c00640 1 -- 172.21.15.1:0/2524963563 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff42c003c30 con 0x562c18c4a4d0 2024-08-28T20:33:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.188+0000 7ff428c00640 1 -- 172.21.15.1:0/2524963563 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ff430025420 con 0x562c18c4a4d0 2024-08-28T20:33:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff44ce6f740 10 client.26303 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:33:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff44ce6f740 10 client.26303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:33:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff44ce6f740 20 client.26303 populate_metadata read hostname 'smithi001' 2024-08-28T20:33:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18c29d80 0x562c19030490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff44ce6f740 4 client.26303 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:33:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c18f85ec0 con 0x562c18c29d80 2024-08-28T20:33:10.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.191+0000 7ff43e000640 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18c29d80 0x562c19030490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.192+0000 7ff43e000640 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18c29d80 0x562c19030490 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef139f0726105464 server_cookie=eebda9d010bc4d26 in_seq=0 out_seq=0 2024-08-28T20:33:10.194 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.192+0000 7ff428c00640 10 client.26303 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:10.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.195+0000 7ff428c00640 1 -- 172.21.15.1:0/2524963563 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c18f85ec0 con 0x562c18c29d80 2024-08-28T20:33:10.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.195+0000 7ff428c00640 10 client.26303 handle_command_reply: tid=0 2024-08-28T20:33:10.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.195+0000 7ff44ce6f740 1 client.26303 shutdown 2024-08-28T20:33:10.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 msgr2=0x562c1901b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 0x562c1901b500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff430012740 tx=0x7ff430012c00 comp rx=0 tx=0).stop 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 shutdown_connections 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18c29d80 0x562c19030490 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c6b1b0 0x562c1901ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c4a4d0 0x562c1901b500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2524963563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c1901c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 >> 172.21.15.1:0/2524963563 conn(0x562c18c5f300 msgr2=0x562c1900ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:10.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.197+0000 7ff428c00640 0 client.26303 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.199+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 shutdown_connections 2024-08-28T20:33:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.199+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2524963563 wait complete. 2024-08-28T20:33:10.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.199+0000 7ff44ce6f740 20 client.26303 trim_cache size 0 max 16384 2024-08-28T20:33:10.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:09 smithi001 ceph-mon[20984]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-08-28T20:33:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:09 smithi121 ceph-mon[25248]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-08-28T20:33:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.241+0000 7ff44ce6f740 1 Processor -- start 2024-08-28T20:33:10.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 -- start start 2024-08-28T20:33:10.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c19015800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19013d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401ab210 con 0x562c18c4a4d0 2024-08-28T20:33:10.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401a8ae0 con 0x562c18c6b1b0 2024-08-28T20:33:10.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401a6930 con 0x562c18c422f0 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff43e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c19015800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff43e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c19015800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54050/0 (socket says 172.21.15.1:54050) 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.242+0000 7ff43e000640 1 -- 172.21.15.1:0/610998002 learned_addr learned my addr 172.21.15.1:0/610998002 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.243+0000 7ff43e000640 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.243+0000 7ff43e000640 1 -- 172.21.15.1:0/610998002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 msgr2=0x562c19014270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.243+0000 7ff43e000640 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19014270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.243+0000 7ff43e000640 1 -- 172.21.15.1:0/610998002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 msgr2=0x562c19013d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.243+0000 7ff43e000640 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19013d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.243+0000 7ff43e000640 1 -- 172.21.15.1:0/610998002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c190185c0 con 0x562c18c422f0 2024-08-28T20:33:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.245+0000 7ff43e000640 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c19015800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff42c004300 tx=0x7ff42c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a9ad227aa4bf6fa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.245+0000 7ff42b400640 1 -- 172.21.15.1:0/610998002 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c035040 con 0x562c18c422f0 2024-08-28T20:33:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.245+0000 7ff42b400640 1 -- 172.21.15.1:0/610998002 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff42c003be0 con 0x562c18c422f0 2024-08-28T20:33:10.248 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.246+0000 7ff42b400640 1 -- 172.21.15.1:0/610998002 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c041040 con 0x562c18c422f0 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 -- 172.21.15.1:0/610998002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 msgr2=0x562c19015800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c19015800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff42c004300 tx=0x7ff42c005fd0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 -- 172.21.15.1:0/610998002 shutdown_connections 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c4a4d0 0x562c19013d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c19014270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/610998002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c422f0 0x562c19015800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.247+0000 7ff44ce6f740 1 -- 172.21.15.1:0/610998002 >> 172.21.15.1:0/610998002 conn(0x562c18c5f300 msgr2=0x562c190150f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.248+0000 7ff44ce6f740 1 -- 172.21.15.1:0/610998002 shutdown_connections 2024-08-28T20:33:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.248+0000 7ff44ce6f740 1 -- 172.21.15.1:0/610998002 wait complete. 2024-08-28T20:33:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.248+0000 7ff44ce6f740 1 -- start start 2024-08-28T20:33:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 Processor -- start 2024-08-28T20:33:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c422f0 0x562c1902b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 0x562c19029ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c1902a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401a6fa0 con 0x562c18c422f0 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401a8410 con 0x562c18c6b1b0 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401a7670 con 0x562c18c4a4d0 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.249+0000 7ff44ce6f740 10 client.0 _ll_register_callbacks cb 0x7ff430009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.250+0000 7ff43ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 0x562c19029ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.250+0000 7ff43ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 0x562c19029ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:54066/0 (socket says 172.21.15.1:54066) 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.250+0000 7ff43ea00640 1 -- 172.21.15.1:0/2710602546 learned_addr learned my addr 172.21.15.1:0/2710602546 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.250+0000 7ff43e000640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c1902a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.250+0000 7ff43e000640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c422f0 0x562c1902b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.251+0000 7ff43ea00640 1 -- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 msgr2=0x562c1902a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.251+0000 7ff43ea00640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c1902a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.251+0000 7ff43ea00640 1 -- 172.21.15.1:0/2710602546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c422f0 msgr2=0x562c1902b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.251+0000 7ff43ea00640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c422f0 0x562c1902b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.251+0000 7ff43ea00640 1 -- 172.21.15.1:0/2710602546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1902aa10 con 0x562c18c4a4d0 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.251+0000 7ff43e000640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c422f0 0x562c1902b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.252+0000 7ff43ea00640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 0x562c19029ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff43000a000 tx=0x7ff430026e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eed1df966e310a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.252+0000 7ff428c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.252+0000 7ff428c00640 1 -- 172.21.15.1:0/2710602546 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430025630 con 0x562c18c4a4d0 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.252+0000 7ff428c00640 1 -- 172.21.15.1:0/2710602546 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ff430018040 con 0x562c18c4a4d0 2024-08-28T20:33:10.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.252+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff42c003be0 con 0x562c18c4a4d0 2024-08-28T20:33:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.253+0000 7ff428c00640 1 -- 172.21.15.1:0/2710602546 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff43000f920 con 0x562c18c4a4d0 2024-08-28T20:33:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.253+0000 7ff44ce6f740 10 client.26287 fetch_fsmap learned FSMap version 50 2024-08-28T20:33:10.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.253+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562c19029890 con 0x562c18c4a4d0 2024-08-28T20:33:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff428c00640 1 -- 172.21.15.1:0/2710602546 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff42c003be0 con 0x562c18c4a4d0 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff428c00640 1 -- 172.21.15.1:0/2710602546 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ff4300039a0 con 0x562c18c4a4d0 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff44ce6f740 10 client.26287 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff44ce6f740 10 client.26287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff44ce6f740 20 client.26287 populate_metadata read hostname 'smithi001' 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18bff1c0 0x562c1909d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff44ce6f740 4 client.26287 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.255+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c18f81960 con 0x562c18bff1c0 2024-08-28T20:33:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.256+0000 7ff43e000640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18bff1c0 0x562c1909d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.257+0000 7ff43e000640 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18bff1c0 0x562c1909d6b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a06e6da4e21497b server_cookie=f8e3bcdffb7f0a2f in_seq=0 out_seq=0 2024-08-28T20:33:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.257+0000 7ff428c00640 10 client.26287 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.279+0000 7ff428c00640 1 -- 172.21.15.1:0/2710602546 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c18f81960 con 0x562c18bff1c0 2024-08-28T20:33:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff428c00640 10 client.26287 handle_command_reply: tid=0 2024-08-28T20:33:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 client.26287 shutdown 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 msgr2=0x562c19029ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 0x562c19029ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff43000a000 tx=0x7ff430026e70 comp rx=0 tx=0).stop 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 shutdown_connections 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562c18bff1c0 0x562c1909d6b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c18c6b1b0 0x562c1902a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff428c00640 0 client.26287 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c18c4a4d0 0x562c19029ec0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 --2- 172.21.15.1:0/2710602546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562c18c422f0 0x562c1902b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.280+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 >> 172.21.15.1:0/2710602546 conn(0x562c18c5f300 msgr2=0x562c19012940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.281+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 shutdown_connections 2024-08-28T20:33:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.281+0000 7ff44ce6f740 1 -- 172.21.15.1:0/2710602546 wait complete. 2024-08-28T20:33:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff44ce6f740 20 client.26287 trim_cache size 0 max 16384 2024-08-28T20:33:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:33:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:33:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:33:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff4240b4bf0 msgr2=0x7ff4240b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff4240b4bf0 0x7ff4240b7100 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff4380a93f0 tx=0x7ff4380057c0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 msgr2=0x7ff44019ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 0x7ff44019ad30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff438009fd0 tx=0x7ff43800ef10 comp rx=0 tx=0).stop 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 shutdown_connections 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ff4240b4bf0 0x7ff4240b7100 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4401043b0 0x7ff44019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff440104d50 0x7ff44019ad30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 --2- 172.21.15.1:0/2122941723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff440103330 0x7ff440199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.282+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 >> 172.21.15.1:0/2122941723 conn(0x7ff4400fec50 msgr2=0x7ff4401076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.283+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 shutdown_connections 2024-08-28T20:33:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:10.283+0000 7ff43fe00640 1 -- 172.21.15.1:0/2122941723 wait complete. 2024-08-28T20:33:10.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:09 smithi007 ceph-mon[25357]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-08-28T20:33:12.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:11 smithi001 ceph-mon[20984]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.9 MiB/s wr, 632 op/s 2024-08-28T20:33:12.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:11 smithi121 ceph-mon[25248]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.9 MiB/s wr, 632 op/s 2024-08-28T20:33:12.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:11 smithi007 ceph-mon[25357]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.9 MiB/s wr, 632 op/s 2024-08-28T20:33:13.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 885.0 s, 1351.4 tps, lat 73.693 ms stddev 81.954 2024-08-28T20:33:14.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:13 smithi001 ceph-mon[20984]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-08-28T20:33:14.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:13 smithi121 ceph-mon[25248]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-08-28T20:33:14.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:13 smithi007 ceph-mon[25357]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-08-28T20:33:16.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:15 smithi001 ceph-mon[20984]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 MiB/s wr, 592 op/s 2024-08-28T20:33:16.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:15 smithi121 ceph-mon[25248]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 MiB/s wr, 592 op/s 2024-08-28T20:33:16.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:15 smithi007 ceph-mon[25357]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 MiB/s wr, 592 op/s 2024-08-28T20:33:18.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:17 smithi007 ceph-mon[25357]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.1 MiB/s wr, 632 op/s 2024-08-28T20:33:18.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:17 smithi001 ceph-mon[20984]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.1 MiB/s wr, 632 op/s 2024-08-28T20:33:18.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:17 smithi121 ceph-mon[25248]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.1 MiB/s wr, 632 op/s 2024-08-28T20:33:18.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 890.0 s, 1197.4 tps, lat 82.780 ms stddev 95.422 2024-08-28T20:33:20.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:19 smithi007 ceph-mon[25357]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.5 MiB/s wr, 585 op/s 2024-08-28T20:33:20.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:19 smithi001 ceph-mon[20984]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.5 MiB/s wr, 585 op/s 2024-08-28T20:33:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:19 smithi121 ceph-mon[25248]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.5 MiB/s wr, 585 op/s 2024-08-28T20:33:22.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:21 smithi007 ceph-mon[25357]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 654 op/s 2024-08-28T20:33:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:21 smithi001 ceph-mon[20984]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 654 op/s 2024-08-28T20:33:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:21 smithi121 ceph-mon[25248]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 654 op/s 2024-08-28T20:33:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.569+0000 7fb7f8a00640 1 -- 172.21.15.1:0/729988529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 msgr2=0x7fb7f4104730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.569+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/729988529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 0x7fb7f4104730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009900 tx=0x7fb7e402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 -- 172.21.15.1:0/729988529 shutdown_connections 2024-08-28T20:33:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/729988529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7f4104cc0 0x7fb7f410b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/729988529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 0x7fb7f4104730 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/729988529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f4103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 -- 172.21.15.1:0/729988529 >> 172.21.15.1:0/729988529 conn(0x7fb7f40febc0 msgr2=0x7fb7f4101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 -- 172.21.15.1:0/729988529 shutdown_connections 2024-08-28T20:33:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.572+0000 7fb7f8a00640 1 -- 172.21.15.1:0/729988529 wait complete. 2024-08-28T20:33:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.573+0000 7fb7f8a00640 1 Processor -- start 2024-08-28T20:33:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 -- start start 2024-08-28T20:33:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 0x7fb7f419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7f4104cc0 0x7fb7f419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f4111170 con 0x7fb7f4104cc0 2024-08-28T20:33:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f4110ff0 con 0x7fb7f41032a0 2024-08-28T20:33:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.574+0000 7fb7f8a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f41112f0 con 0x7fb7f4104320 2024-08-28T20:33:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.575+0000 7fb7f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.575+0000 7fb7f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47198/0 (socket says 172.21.15.1:47198) 2024-08-28T20:33:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.575+0000 7fb7f3400640 1 -- 172.21.15.1:0/2833912898 learned_addr learned my addr 172.21.15.1:0/2833912898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.575+0000 7fb7f3400640 1 -- 172.21.15.1:0/2833912898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 msgr2=0x7fb7f419c3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-28T20:33:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.575+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 0x7fb7f419c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.575+0000 7fb7f3400640 1 -- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7f4104cc0 msgr2=0x7fb7f419cf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-28T20:33:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.576+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7f4104cc0 0x7fb7f419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.576+0000 7fb7f3400640 1 -- 172.21.15.1:0/2833912898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f419d790 con 0x7fb7f41032a0 2024-08-28T20:33:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.576+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f419bd50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00cce0 tx=0x7fb7ec00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.578+0000 7fb7ebe00640 1 -- 172.21.15.1:0/2833912898 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec004b20 con 0x7fb7f41032a0 2024-08-28T20:33:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.578+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f419da80 con 0x7fb7f41032a0 2024-08-28T20:33:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.578+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f41a4170 con 0x7fb7f41032a0 2024-08-28T20:33:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.579+0000 7fb7ebe00640 1 -- 172.21.15.1:0/2833912898 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7ec004cc0 con 0x7fb7f41032a0 2024-08-28T20:33:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.579+0000 7fb7ebe00640 1 -- 172.21.15.1:0/2833912898 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00f7c0 con 0x7fb7f41032a0 2024-08-28T20:33:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.586+0000 7fb800fd2740 1 Processor -- start 2024-08-28T20:33:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.586+0000 7fb800fd2740 1 -- start start 2024-08-28T20:33:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.586+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.586+0000 7fb7ebe00640 1 -- 172.21.15.1:0/2833912898 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fb7ec00f960 con 0x7fb7f41032a0 2024-08-28T20:33:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.587+0000 7fb7f3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.587+0000 7fb7f3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:50986/0 (socket says 172.21.15.1:50986) 2024-08-28T20:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.587+0000 7fb7f3e00640 1 -- 172.21.15.1:0/917289407 learned_addr learned my addr 172.21.15.1:0/917289407 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.588+0000 7fb800fd2740 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dd42f0 0x562f3a1abe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.589+0000 7fb7f3400640 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dd42f0 0x562f3a1abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.589+0000 7fb800fd2740 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39ddc4d0 0x562f3a1ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.589+0000 7fb7ebe00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb7d80b4bf0 0x7fb7d80b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.590+0000 7fb7ebe00640 1 -- 172.21.15.1:0/2833912898 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb7ec0e51d0 con 0x7fb7f41032a0 2024-08-28T20:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.590+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f3a115f70 con 0x562f39ddc4d0 2024-08-28T20:33:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.590+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f3a105500 con 0x562f39dd42f0 2024-08-28T20:33:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.590+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f3a1094b0 con 0x562f39dfd1b0 2024-08-28T20:33:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.592+0000 7fb7f3e00640 1 -- 172.21.15.1:0/917289407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dd42f0 msgr2=0x562f3a1abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.593+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dd42f0 0x562f3a1abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.593+0000 7fb7f3e00640 1 -- 172.21.15.1:0/917289407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39ddc4d0 msgr2=0x562f3a1ac970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T20:33:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.594+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39ddc4d0 0x562f3a1ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.594+0000 7fb7f3e00640 1 -- 172.21.15.1:0/917289407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a0bfc10 con 0x562f39dfd1b0 2024-08-28T20:33:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.594+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb7d80b4bf0 0x7fb7d80b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.595+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1ab7b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009d60 tx=0x7fb7e0010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2be127dc667c0b8c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.597+0000 7fb7dfe00640 1 -- 172.21.15.1:0/917289407 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0012b40 con 0x562f39dfd1b0 2024-08-28T20:33:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.598+0000 7fb7dfe00640 1 -- 172.21.15.1:0/917289407 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7e0012ce0 con 0x562f39dfd1b0 2024-08-28T20:33:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.598+0000 7fb7dfe00640 1 -- 172.21.15.1:0/917289407 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00113e0 con 0x562f39dfd1b0 2024-08-28T20:33:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.598+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb7d80b4bf0 0x7fb7d80b7100 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb7e001e000 tx=0x7fb7e001f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.599+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 msgr2=0x562f3a1ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.599+0000 7fb800fd2740 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1ab7b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009d60 tx=0x7fb7e0010740 comp rx=0 tx=0).stop 2024-08-28T20:33:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 shutdown_connections 2024-08-28T20:33:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39ddc4d0 0x562f3a1ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dd42f0 0x562f3a1abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 --2- 172.21.15.1:0/917289407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1ab7b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 >> 172.21.15.1:0/917289407 conn(0x562f39df1300 msgr2=0x562f3a19ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 shutdown_connections 2024-08-28T20:33:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.600+0000 7fb800fd2740 1 -- 172.21.15.1:0/917289407 wait complete. 2024-08-28T20:33:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.601+0000 7fb800fd2740 1 -- start start 2024-08-28T20:33:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.602+0000 7fb800fd2740 1 Processor -- start 2024-08-28T20:33:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.603+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.603+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39ddc4d0 0x562f3a1b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.603+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 0x562f3a1b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb800fd2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562f3a03eab0 con 0x562f39dd42f0 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb800fd2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f3a0ac320 con 0x562f39dfd1b0 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb800fd2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f3a1ad490 con 0x562f39ddc4d0 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb7f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 0x562f3a1b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb7f2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39ddc4d0 0x562f3a1b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb7f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 0x562f3a1b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:47206/0 (socket says 172.21.15.1:47206) 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb7f3e00640 1 -- 172.21.15.1:0/834714095 learned_addr learned my addr 172.21.15.1:0/834714095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb800fd2740 10 client.0 _ll_register_callbacks cb 0x562f3a0b26a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:33:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.604+0000 7fb7f3400640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f3e00640 1 -- 172.21.15.1:0/834714095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39ddc4d0 msgr2=0x562f3a1b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39ddc4d0 0x562f3a1b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f3e00640 1 -- 172.21.15.1:0/834714095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 msgr2=0x562f3a1b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f3e00640 1 -- 172.21.15.1:0/834714095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f39e68790 con 0x562f39dfd1b0 2024-08-28T20:33:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f2a00640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39ddc4d0 0x562f3a1b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 0x562f3a1b6100 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005fd0 tx=0x7fb7e001aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a65e50ee5b71c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.605+0000 7fb7dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.606+0000 7fb7dcc00640 1 -- 172.21.15.1:0/834714095 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0012b40 con 0x562f39dfd1b0 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.606+0000 7fb7dcc00640 1 -- 172.21.15.1:0/834714095 <== mon.2 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb7e0011910 con 0x562f39dfd1b0 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.606+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7e0012ce0 con 0x562f39dfd1b0 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.606+0000 7fb7dcc00640 1 -- 172.21.15.1:0/834714095 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb7e0011b10 con 0x562f39dfd1b0 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb800fd2740 10 client.26318 fetch_fsmap learned FSMap version 50 2024-08-28T20:33:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562f39ee1620 con 0x562f39dfd1b0 2024-08-28T20:33:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb7dcc00640 1 -- 172.21.15.1:0/834714095 <== mon.2 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7e0012ce0 con 0x562f39dfd1b0 2024-08-28T20:33:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb7dcc00640 1 -- 172.21.15.1:0/834714095 <== mon.2 v2:172.21.15.7:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fb7e002e070 con 0x562f39dfd1b0 2024-08-28T20:33:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb800fd2740 10 client.26318 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:33:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb800fd2740 10 client.26318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:33:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.607+0000 7fb800fd2740 20 client.26318 populate_metadata read hostname 'smithi001' 2024-08-28T20:33:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.608+0000 7fb800fd2740 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39dbbd80 0x562f3a1c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.608+0000 7fb800fd2740 4 client.26318 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:33:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.608+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f3a117ec0 con 0x562f39dbbd80 2024-08-28T20:33:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.608+0000 7fb7f3400640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39dbbd80 0x562f3a1c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.609+0000 7fb7f3400640 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39dbbd80 0x562f3a1c2320 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d03f1696facf32bf server_cookie=1013c3e642f5e646 in_seq=0 out_seq=0 2024-08-28T20:33:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.609+0000 7fb7dcc00640 10 client.26318 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.610+0000 7fb7dcc00640 1 -- 172.21.15.1:0/834714095 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f3a117ec0 con 0x562f39dbbd80 2024-08-28T20:33:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.610+0000 7fb7dcc00640 10 client.26318 handle_command_reply: tid=0 2024-08-28T20:33:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.611+0000 7fb800fd2740 1 client.26318 shutdown 2024-08-28T20:33:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.611+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 msgr2=0x562f3a1b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.611+0000 7fb800fd2740 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 0x562f3a1b6100 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005fd0 tx=0x7fb7e001aaf0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 shutdown_connections 2024-08-28T20:33:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39dbbd80 0x562f3a1c2320 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39dfd1b0 0x562f3a1b6100 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39ddc4d0 0x562f3a1b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 --2- 172.21.15.1:0/834714095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 >> 172.21.15.1:0/834714095 conn(0x562f39df1300 msgr2=0x562f3a19cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb7dcc00640 0 client.26318 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.612+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 shutdown_connections 2024-08-28T20:33:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.613+0000 7fb800fd2740 1 -- 172.21.15.1:0/834714095 wait complete. 2024-08-28T20:33:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.615+0000 7fb800fd2740 20 client.26318 trim_cache size 0 max 16384 2024-08-28T20:33:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.640+0000 7fb800fd2740 1 Processor -- start 2024-08-28T20:33:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.640+0000 7fb800fd2740 1 -- start start 2024-08-28T20:33:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 0x562f3a1af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dfd1b0 0x562f3a1b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb800fd2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4010d70 con 0x562f39dfd1b0 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb7f3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 0x562f3a1af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb7f2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb7f3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 0x562f3a1af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51016/0 (socket says 172.21.15.1:51016) 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb800fd2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d400e640 con 0x562f39ddc4d0 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb7f3400640 1 -- 172.21.15.1:0/1869043907 learned_addr learned my addr 172.21.15.1:0/1869043907 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb800fd2740 1 -- 172.21.15.1:0/1869043907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d400c490 con 0x562f39dd42f0 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.641+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dfd1b0 0x562f3a1b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7f3400640 1 -- 172.21.15.1:0/1869043907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 msgr2=0x562f3a1afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7f3400640 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7f3400640 1 -- 172.21.15.1:0/1869043907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dfd1b0 msgr2=0x562f3a1b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7f3400640 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dfd1b0 0x562f3a1b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7f3400640 1 -- 172.21.15.1:0/1869043907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a19e160 con 0x562f39dd42f0 2024-08-28T20:33:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7f3400640 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 0x562f3a1af900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0ac900 tx=0x7fb7ec0e2b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fcb75b6ee0d6039 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7df400640 1 -- 172.21.15.1:0/1869043907 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0bcf90 con 0x562f39dd42f0 2024-08-28T20:33:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7df400640 1 -- 172.21.15.1:0/1869043907 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7ec0e4040 con 0x562f39dd42f0 2024-08-28T20:33:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.642+0000 7fb7df400640 1 -- 172.21.15.1:0/1869043907 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec01d040 con 0x562f39dd42f0 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 -- 172.21.15.1:0/1869043907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 msgr2=0x562f3a1af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 0x562f3a1af900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0ac900 tx=0x7fb7ec0e2b90 comp rx=0 tx=0).stop 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 -- 172.21.15.1:0/1869043907 shutdown_connections 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dfd1b0 0x562f3a1b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 --2- 172.21.15.1:0/1869043907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dd42f0 0x562f3a1af900 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 -- 172.21.15.1:0/1869043907 >> 172.21.15.1:0/1869043907 conn(0x562f39df1300 msgr2=0x562f3a199660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 -- 172.21.15.1:0/1869043907 shutdown_connections 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.644+0000 7fb800fd2740 1 -- 172.21.15.1:0/1869043907 wait complete. 2024-08-28T20:33:23.646 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 -- start start 2024-08-28T20:33:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 Processor -- start 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1bc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1bac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d400cb00 con 0x562f39dd42f0 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d400df70 con 0x562f39ddc4d0 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.645+0000 7fb800fd2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d400d1d0 con 0x562f39dfd1b0 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.646+0000 7fb800fd2740 10 client.0 _ll_register_callbacks cb 0x7fb7e001a9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.646+0000 7fb7f3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1bac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.646+0000 7fb7f3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1bac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51026/0 (socket says 172.21.15.1:51026) 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.646+0000 7fb7f3e00640 1 -- 172.21.15.1:0/2024924112 learned_addr learned my addr 172.21.15.1:0/2024924112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.646+0000 7fb7f2a00640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.646+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.647+0000 7fb7f3e00640 1 -- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 msgr2=0x562f3a1bc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.647+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1bc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.647+0000 7fb7f3e00640 1 -- 172.21.15.1:0/2024924112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 msgr2=0x562f3a1bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.647+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1bc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.647+0000 7fb7f3e00640 1 -- 172.21.15.1:0/2024924112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3a1bb180 con 0x562f39dfd1b0 2024-08-28T20:33:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.648+0000 7fb7f2a00640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1bc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:33:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.648+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:33:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.649+0000 7fb7f3e00640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1bac40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000a010 tx=0x7fb7e003bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982ed5e274ff229e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.649+0000 7fb7dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:33:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.649+0000 7fb7dcc00640 1 -- 172.21.15.1:0/2024924112 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00096c0 con 0x562f39dfd1b0 2024-08-28T20:33:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.649+0000 7fb7dcc00640 1 -- 172.21.15.1:0/2024924112 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fb7e0011910 con 0x562f39dfd1b0 2024-08-28T20:33:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.650+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7ec0e4040 con 0x562f39dfd1b0 2024-08-28T20:33:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.650+0000 7fb7dcc00640 1 -- 172.21.15.1:0/2024924112 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb7e004b050 con 0x562f39dfd1b0 2024-08-28T20:33:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.650+0000 7fb800fd2740 10 client.26302 fetch_fsmap learned FSMap version 50 2024-08-28T20:33:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.650+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562f3a22d3f0 con 0x562f39dfd1b0 2024-08-28T20:33:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb7dcc00640 1 -- 172.21.15.1:0/2024924112 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7ec0e4040 con 0x562f39dfd1b0 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb7dcc00640 1 -- 172.21.15.1:0/2024924112 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7fb7e002e040 con 0x562f39dfd1b0 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb800fd2740 10 client.26302 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb800fd2740 10 client.26302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb800fd2740 20 client.26302 populate_metadata read hostname 'smithi001' 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb800fd2740 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39d911c0 0x562f3a22fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb800fd2740 4 client.26302 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.651+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f3a113960 con 0x562f39d911c0 2024-08-28T20:33:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.652+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39d911c0 0x562f3a22fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.652+0000 7fb7dcc00640 10 client.26302 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.652+0000 7fb7f3400640 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39d911c0 0x562f3a22fe10 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13396aebf051cd3 server_cookie=5ea727b165a2b57f in_seq=0 out_seq=0 2024-08-28T20:33:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.664+0000 7fb7dcc00640 1 -- 172.21.15.1:0/2024924112 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f3a113960 con 0x562f39d911c0 2024-08-28T20:33:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.664+0000 7fb7dcc00640 10 client.26302 handle_command_reply: tid=0 2024-08-28T20:33:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.665+0000 7fb800fd2740 1 client.26302 shutdown 2024-08-28T20:33:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.665+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 msgr2=0x562f3a1bac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.665+0000 7fb800fd2740 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1bac40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000a010 tx=0x7fb7e003bf00 comp rx=0 tx=0).stop 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 shutdown_connections 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x562f39d911c0 0x562f3a22fe10 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f39dfd1b0 0x562f3a1bac40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f39ddc4d0 0x562f3a1bc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 --2- 172.21.15.1:0/2024924112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562f39dd42f0 0x562f3a1bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb7dcc00640 0 client.26302 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 >> 172.21.15.1:0/2024924112 conn(0x562f39df1300 msgr2=0x562f3a1af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 shutdown_connections 2024-08-28T20:33:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.666+0000 7fb800fd2740 1 -- 172.21.15.1:0/2024924112 wait complete. 2024-08-28T20:33:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb800fd2740 20 client.26302 trim_cache size 0 max 16384 2024-08-28T20:33:23.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:33:23.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:33:23.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:33:23.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb7d80b4bf0 msgr2=0x7fb7d80b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb7d80b4bf0 0x7fb7d80b7100 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb7e001e000 tx=0x7fb7e001f000 comp rx=0 tx=0).stop 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 msgr2=0x7fb7f419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f419bd50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00cce0 tx=0x7fb7ec00a620 comp rx=0 tx=0).stop 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 shutdown_connections 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fb7d80b4bf0 0x7fb7d80b7100 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7f4104cc0 0x7fb7f419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7f4104320 0x7fb7f419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.667+0000 7fb7f8a00640 1 --2- 172.21.15.1:0/2833912898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7f41032a0 0x7fb7f419bd50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.668+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 >> 172.21.15.1:0/2833912898 conn(0x7fb7f40febc0 msgr2=0x7fb7f4107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.668+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 shutdown_connections 2024-08-28T20:33:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:23.668+0000 7fb7f8a00640 1 -- 172.21.15.1:0/2833912898 wait complete. 2024-08-28T20:33:23.764 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 895.0 s, 1140.6 tps, lat 89.542 ms stddev 94.723 2024-08-28T20:33:24.281 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:24 smithi121 ceph-mon[25248]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-08-28T20:33:24.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:24 smithi007 ceph-mon[25357]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-08-28T20:33:24.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:24 smithi001 ceph-mon[20984]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-08-28T20:33:26.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:26 smithi007 ceph-mon[25357]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 634 op/s 2024-08-28T20:33:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:26 smithi001 ceph-mon[20984]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 634 op/s 2024-08-28T20:33:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:26 smithi121 ceph-mon[25248]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 634 op/s 2024-08-28T20:33:28.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:28 smithi007 ceph-mon[25357]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-08-28T20:33:28.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:28 smithi001 ceph-mon[20984]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-08-28T20:33:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:28 smithi121 ceph-mon[25248]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-08-28T20:33:28.762 INFO:teuthology.orchestra.run.smithi001.stderr:progress: 900.0 s, 1703.6 tps, lat 57.883 ms stddev 69.588 2024-08-28T20:33:29.047 INFO:teuthology.orchestra.run.smithi001.stdout:transaction type: 2024-08-28T20:33:29.047 INFO:teuthology.orchestra.run.smithi001.stdout:scaling factor: 32 2024-08-28T20:33:29.048 INFO:teuthology.orchestra.run.smithi001.stdout:query mode: simple 2024-08-28T20:33:29.048 INFO:teuthology.orchestra.run.smithi001.stdout:number of clients: 100 2024-08-28T20:33:29.048 INFO:teuthology.orchestra.run.smithi001.stdout:number of threads: 4 2024-08-28T20:33:29.048 INFO:teuthology.orchestra.run.smithi001.stdout:duration: 900 s 2024-08-28T20:33:29.048 INFO:teuthology.orchestra.run.smithi001.stdout:number of transactions actually processed: 2025685 2024-08-28T20:33:29.048 INFO:teuthology.orchestra.run.smithi001.stdout:latency average = 44.407 ms 2024-08-28T20:33:29.049 INFO:teuthology.orchestra.run.smithi001.stdout:latency stddev = 90.918 ms 2024-08-28T20:33:29.049 INFO:teuthology.orchestra.run.smithi001.stdout:tps = 2250.049953 (including connections establishing) 2024-08-28T20:33:29.049 INFO:teuthology.orchestra.run.smithi001.stdout:tps = 2250.065414 (excluding connections establishing) 2024-08-28T20:33:29.055 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-08-28T20:33:30.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:30 smithi007 ceph-mon[25357]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-08-28T20:33:30.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:30 smithi001 ceph-mon[20984]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-08-28T20:33:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:30 smithi121 ceph-mon[25248]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-08-28T20:33:32.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:32 smithi007 ceph-mon[25357]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 604 op/s 2024-08-28T20:33:32.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:32 smithi001 ceph-mon[20984]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 604 op/s 2024-08-28T20:33:32.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:32 smithi121 ceph-mon[25248]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 604 op/s 2024-08-28T20:33:34.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:34 smithi007 ceph-mon[25357]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-08-28T20:33:34.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:34 smithi001 ceph-mon[20984]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-08-28T20:33:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:34 smithi121 ceph-mon[25248]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-08-28T20:33:36.228 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:36 smithi001 ceph-mon[20984]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.0 MiB/s wr, 760 op/s 2024-08-28T20:33:36.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:36 smithi007 ceph-mon[25357]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.0 MiB/s wr, 760 op/s 2024-08-28T20:33:36.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:36 smithi121 ceph-mon[25248]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.0 MiB/s wr, 760 op/s 2024-08-28T20:33:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.951+0000 7ffab3c00640 1 -- 172.21.15.1:0/1305306226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac103450 msgr2=0x7ffaac1038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.951+0000 7ffab3c00640 1 --2- 172.21.15.1:0/1305306226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac103450 0x7ffaac1038c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009900 tx=0x7ffaa002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 -- 172.21.15.1:0/1305306226 shutdown_connections 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 --2- 172.21.15.1:0/1305306226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac1044d0 0x7ffaac1048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 --2- 172.21.15.1:0/1305306226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaac104e70 0x7ffaac10b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 --2- 172.21.15.1:0/1305306226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac103450 0x7ffaac1038c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 -- 172.21.15.1:0/1305306226 >> 172.21.15.1:0/1305306226 conn(0x7ffaac0fed90 msgr2=0x7ffaac101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 -- 172.21.15.1:0/1305306226 shutdown_connections 2024-08-28T20:33:36.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.952+0000 7ffab3c00640 1 -- 172.21.15.1:0/1305306226 wait complete. 2024-08-28T20:33:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.953+0000 7ffab3c00640 1 Processor -- start 2024-08-28T20:33:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.953+0000 7ffab3c00640 1 -- start start 2024-08-28T20:33:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.953+0000 7ffab3c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaac103450 0x7ffaac19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.953+0000 7ffab3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 0x7ffaac19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab3c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac104e70 0x7ffaac19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab3c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10f0c0 con 0x7ffaac104e70 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab3c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10ef40 con 0x7ffaac1044d0 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab3c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10f240 con 0x7ffaac103450 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 0x7ffaac19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab1200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaac103450 0x7ffaac19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 0x7ffaac19c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55126/0 (socket says 172.21.15.1:55126) 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 -- 172.21.15.1:0/4040358095 learned_addr learned my addr 172.21.15.1:0/4040358095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab1c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac104e70 0x7ffaac19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 -- 172.21.15.1:0/4040358095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaac103450 msgr2=0x7ffaac19bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaac103450 0x7ffaac19bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 -- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac104e70 msgr2=0x7ffaac19d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac104e70 0x7ffaac19d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffaabe00640 1 -- 172.21.15.1:0/4040358095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac19d920 con 0x7ffaac1044d0 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.954+0000 7ffab1c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac104e70 0x7ffaac19d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.955+0000 7ffaabe00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 0x7ffaac19c550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800e9f0 tx=0x7ffa9800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.955+0000 7ffaa9600640 1 -- 172.21.15.1:0/4040358095 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800cd80 con 0x7ffaac1044d0 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.955+0000 7ffaa9600640 1 -- 172.21.15.1:0/4040358095 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa980108e0 con 0x7ffaac1044d0 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.955+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac19dc10 con 0x7ffaac1044d0 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.955+0000 7ffaa9600640 1 -- 172.21.15.1:0/4040358095 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98018980 con 0x7ffaac1044d0 2024-08-28T20:33:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.955+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac1a4300 con 0x7ffaac1044d0 2024-08-28T20:33:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.959+0000 7ffabac20740 1 Processor -- start 2024-08-28T20:33:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.959+0000 7ffaa9600640 1 -- 172.21.15.1:0/4040358095 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7ffa98010430 con 0x7ffaac1044d0 2024-08-28T20:33:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.959+0000 7ffabac20740 1 -- start start 2024-08-28T20:33:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffabac20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee8731b0 0x558eeec21340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffabac20740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee84a2f0 0x558eeec219b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffabac20740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec22500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffabac20740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558eeeb8bf70 con 0x558eee84a2f0 2024-08-28T20:33:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffabac20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558eeeb7b500 con 0x558eee8731b0 2024-08-28T20:33:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffabac20740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558eeeb7f4b0 con 0x558eee8524d0 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec22500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec22500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49668/0 (socket says 172.21.15.1:49668) 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.960+0000 7ffaabe00640 1 -- 172.21.15.1:0/34692987 learned_addr learned my addr 172.21.15.1:0/34692987 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffab1c00640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee8731b0 0x558eeec21340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffab1200640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee84a2f0 0x558eeec219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffaabe00640 1 -- 172.21.15.1:0/34692987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee8731b0 msgr2=0x558eeec21340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffaabe00640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee8731b0 0x558eeec21340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffaabe00640 1 -- 172.21.15.1:0/34692987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee84a2f0 msgr2=0x558eeec219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffaabe00640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee84a2f0 0x558eeec219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffaabe00640 1 -- 172.21.15.1:0/34692987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eeeb35c10 con 0x558eee8524d0 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffab1200640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee84a2f0 0x558eeec219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffab1c00640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee8731b0 0x558eeec21340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.961+0000 7ffaabe00640 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec22500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa980ed5b0 tx=0x7ffa980eda70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81f71a1303ffbc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.962+0000 7ffa9e000640 1 -- 172.21.15.1:0/34692987 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980f9070 con 0x558eee8524d0 2024-08-28T20:33:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.962+0000 7ffa9e000640 1 -- 172.21.15.1:0/34692987 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa980e7580 con 0x558eee8524d0 2024-08-28T20:33:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.962+0000 7ffa9e000640 1 -- 172.21.15.1:0/34692987 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980eba20 con 0x558eee8524d0 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.962+0000 7ffaa9600640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffa940b4bb0 0x7ffa940b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.962+0000 7ffaa9600640 1 -- 172.21.15.1:0/4040358095 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ffa980e5490 con 0x7ffaac1044d0 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.962+0000 7ffab1c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffa940b4bb0 0x7ffa940b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 -- 172.21.15.1:0/34692987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 msgr2=0x558eeec22500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec22500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa980ed5b0 tx=0x7ffa980eda70 comp rx=0 tx=0).stop 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffab1c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffa940b4bb0 0x7ffa940b70c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4005fd0 tx=0x7ffaa4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 -- 172.21.15.1:0/34692987 shutdown_connections 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee84a2f0 0x558eeec219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec22500 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 --2- 172.21.15.1:0/34692987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee8731b0 0x558eeec21340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 -- 172.21.15.1:0/34692987 >> 172.21.15.1:0/34692987 conn(0x558eee867300 msgr2=0x558eeec145c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.963+0000 7ffabac20740 1 -- 172.21.15.1:0/34692987 shutdown_connections 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.964+0000 7ffabac20740 1 -- 172.21.15.1:0/34692987 wait complete. 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.964+0000 7ffabac20740 1 -- start start 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 Processor -- start 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec2aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec2b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec2bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558eeeab4ab0 con 0x558eee8731b0 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558eeeb22320 con 0x558eee84a2f0 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558eeec23020 con 0x558eee8524d0 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffabac20740 10 client.0 _ll_register_callbacks cb 0x558eeeb5be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.965+0000 7ffab1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec2aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffab1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec2aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55146/0 (socket says 172.21.15.1:55146) 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffab1200640 1 -- 172.21.15.1:0/3859401591 learned_addr learned my addr 172.21.15.1:0/3859401591 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec2b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffab1c00640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec2bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 -- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 msgr2=0x558eeec2aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec2aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 -- 172.21.15.1:0/3859401591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 msgr2=0x558eeec2bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec2bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 -- 172.21.15.1:0/3859401591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eee8de790 con 0x558eee8524d0 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffab1c00640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec2bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffaabe00640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec2b150 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffa980a7ed0 tx=0x7ffa980e8a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7212e22723311187 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.966+0000 7ffa92a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffa92a00640 1 -- 172.21.15.1:0/3859401591 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980a7d10 con 0x558eee8524d0 2024-08-28T20:33:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffa92a00640 1 -- 172.21.15.1:0/3859401591 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ffa98010a90 con 0x558eee8524d0 2024-08-28T20:33:36.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa980e7580 con 0x558eee8524d0 2024-08-28T20:33:36.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffa92a00640 1 -- 172.21.15.1:0/3859401591 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ffa980ab5c0 con 0x558eee8524d0 2024-08-28T20:33:36.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffabac20740 10 client.26314 fetch_fsmap learned FSMap version 50 2024-08-28T20:33:36.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558eee957620 con 0x558eee8524d0 2024-08-28T20:33:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.967+0000 7ffa92a00640 1 -- 172.21.15.1:0/3859401591 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa980ae070 con 0x558eee8524d0 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffa92a00640 1 -- 172.21.15.1:0/3859401591 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ffa980b0320 con 0x558eee8524d0 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffabac20740 10 client.26314 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffabac20740 10 client.26314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffabac20740 20 client.26314 populate_metadata read hostname 'smithi001' 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffabac20740 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee831d80 0x558eeec37ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffabac20740 4 client.26314 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eeeb8dec0 con 0x558eee831d80 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.968+0000 7ffab1200640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee831d80 0x558eeec37ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.969+0000 7ffab1200640 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee831d80 0x558eeec37ca0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68cf1242c2350279 server_cookie=c332f1b3fe6c52bf in_seq=0 out_seq=0 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.969+0000 7ffa92a00640 10 client.26314 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffa92a00640 1 -- 172.21.15.1:0/3859401591 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558eeeb8dec0 con 0x558eee831d80 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffa92a00640 10 client.26314 handle_command_reply: tid=0 2024-08-28T20:33:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 client.26314 shutdown 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 msgr2=0x558eeec2b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec2b150 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffa980a7ed0 tx=0x7ffa980e8a20 comp rx=0 tx=0).stop 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 shutdown_connections 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee831d80 0x558eeec37ca0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec2bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec2b150 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 --2- 172.21.15.1:0/3859401591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec2aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 >> 172.21.15.1:0/3859401591 conn(0x558eee867300 msgr2=0x558eeec151c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffa92a00640 0 client.26314 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 shutdown_connections 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 1 -- 172.21.15.1:0/3859401591 wait complete. 2024-08-28T20:33:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.970+0000 7ffabac20740 20 client.26314 trim_cache size 0 max 16384 2024-08-28T20:33:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 Processor -- start 2024-08-28T20:33:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 -- start start 2024-08-28T20:33:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec25df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec28180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec32b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1ab4a0 con 0x558eee8731b0 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1a8d70 con 0x558eee84a2f0 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.986+0000 7ffabac20740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1a6be0 con 0x558eee8524d0 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec25df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec28180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec25df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55152/0 (socket says 172.21.15.1:55152) 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 -- 172.21.15.1:0/2086988930 learned_addr learned my addr 172.21.15.1:0/2086988930 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1c00640 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec32b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 -- 172.21.15.1:0/2086988930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 msgr2=0x558eeec28180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec28180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 -- 172.21.15.1:0/2086988930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 msgr2=0x558eeec32b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec32b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 -- 172.21.15.1:0/2086988930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eeec2aec0 con 0x558eee84a2f0 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffab1200640 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec25df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffaa002a910 tx=0x7ffaa00314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f83861b69a84c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.987+0000 7ffa9d600640 1 -- 172.21.15.1:0/2086988930 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0035030 con 0x558eee84a2f0 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffa9d600640 1 -- 172.21.15.1:0/2086988930 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa0049030 con 0x558eee84a2f0 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffa9d600640 1 -- 172.21.15.1:0/2086988930 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0031b40 con 0x558eee84a2f0 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 -- 172.21.15.1:0/2086988930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 msgr2=0x558eeec25df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec25df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffaa002a910 tx=0x7ffaa00314a0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 -- 172.21.15.1:0/2086988930 shutdown_connections 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec32b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec28180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 --2- 172.21.15.1:0/2086988930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec25df0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.988+0000 7ffabac20740 1 -- 172.21.15.1:0/2086988930 >> 172.21.15.1:0/2086988930 conn(0x558eee867300 msgr2=0x558eeec14e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.989+0000 7ffabac20740 1 -- 172.21.15.1:0/2086988930 shutdown_connections 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.989+0000 7ffabac20740 1 -- 172.21.15.1:0/2086988930 wait complete. 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.989+0000 7ffabac20740 1 -- start start 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.989+0000 7ffabac20740 1 Processor -- start 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec32970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec31630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec31cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1a7230 con 0x558eee8731b0 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1a86a0 con 0x558eee84a2f0 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1a7900 con 0x558eee8524d0 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffabac20740 10 client.0 _ll_register_callbacks cb 0x7ffa980f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffab1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec32970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec31630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffab1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec32970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55166/0 (socket says 172.21.15.1:55166) 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffab1200640 1 -- 172.21.15.1:0/1295580496 learned_addr learned my addr 172.21.15.1:0/1295580496 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffab1c00640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec31cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffaabe00640 1 -- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 msgr2=0x558eeec32970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffaabe00640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec32970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffaabe00640 1 -- 172.21.15.1:0/1295580496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 msgr2=0x558eeec31cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffaabe00640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec31cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffaabe00640 1 -- 172.21.15.1:0/1295580496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eeec32460 con 0x558eee8524d0 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffab1c00640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec31cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.990+0000 7ffab1200640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec32970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffaabe00640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec31630 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffa980edf70 tx=0x7ffa98000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4f4a6d16056326 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffa92a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffa92a00640 1 -- 172.21.15.1:0/1295580496 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980ab7a0 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa0049030 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffa92a00640 1 -- 172.21.15.1:0/1295580496 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7ffa980ac0b0 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffa92a00640 1 -- 172.21.15.1:0/1295580496 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ffa980abc20 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffabac20740 10 client.26320 fetch_fsmap learned FSMap version 50 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558eeeca2560 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.991+0000 7ffa92a00640 1 -- 172.21.15.1:0/1295580496 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa0049030 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffa92a00640 1 -- 172.21.15.1:0/1295580496 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8346+0+0 (secure 0 0 0) 0x7ffa980b4ce0 con 0x558eee8524d0 2024-08-28T20:33:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffabac20740 10 client.26320 fetch_fsmap finished waiting for FSMap version 50 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffabac20740 10 client.26320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffabac20740 20 client.26320 populate_metadata read hostname 'smithi001' 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffabac20740 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee8071c0 0x558eeeca4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffabac20740 4 client.26320 mds_command: new command op to 24701 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 --> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558eeeb89960 con 0x558eee8071c0 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffab1200640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee8071c0 0x558eeeca4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffab1200640 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee8071c0 0x558eeeca4ea0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82ac3379e45a53c server_cookie=2f5481886cb6fece in_seq=0 out_seq=0 2024-08-28T20:33:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:36.992+0000 7ffa92a00640 10 client.26320 ms_handle_connect on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffa92a00640 1 -- 172.21.15.1:0/1295580496 <== mds.0 v2:172.21.15.7:6838/1672375051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558eeeb89960 con 0x558eee8071c0 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffa92a00640 10 client.26320 handle_command_reply: tid=0 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 client.26320 shutdown 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 msgr2=0x558eeec31630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec31630 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffa980edf70 tx=0x7ffa98000bc0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 shutdown_connections 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:6838/1672375051,v1:172.21.15.7:6839/1672375051] conn(0x558eee8071c0 0x558eeeca4ea0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558eee8731b0 0x558eeec31cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558eee8524d0 0x558eeec31630 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffa92a00640 0 client.26320 ms_handle_reset on v2:172.21.15.7:6838/1672375051 2024-08-28T20:33:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 --2- 172.21.15.1:0/1295580496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558eee84a2f0 0x558eeec32970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 >> 172.21.15.1:0/1295580496 conn(0x558eee867300 msgr2=0x558eeec294b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 shutdown_connections 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 1 -- 172.21.15.1:0/1295580496 wait complete. 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.002+0000 7ffabac20740 20 client.26320 trim_cache size 0 max 16384 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-08-28T20:33:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffa940b4bb0 msgr2=0x7ffa940b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffa940b4bb0 0x7ffa940b70c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4005fd0 tx=0x7ffaa4009500 comp rx=0 tx=0).stop 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 msgr2=0x7ffaac19c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 0x7ffaac19c550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800e9f0 tx=0x7ffa9800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 shutdown_connections 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7ffa940b4bb0 0x7ffa940b70c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffaac104e70 0x7ffaac19d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaac1044d0 0x7ffaac19c550 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 --2- 172.21.15.1:0/4040358095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaac103450 0x7ffaac19bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 >> 172.21.15.1:0/4040358095 conn(0x7ffaac0fed90 msgr2=0x7ffaac075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 shutdown_connections 2024-08-28T20:33:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-08-28T20:33:37.003+0000 7ffab3c00640 1 -- 172.21.15.1:0/4040358095 wait complete. 2024-08-28T20:33:38.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:38 smithi007 ceph-mon[25357]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 967 op/s 2024-08-28T20:33:38.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:38 smithi001 ceph-mon[20984]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 967 op/s 2024-08-28T20:33:38.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:38 smithi121 ceph-mon[25248]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 967 op/s 2024-08-28T20:33:40.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:40 smithi007 ceph-mon[25357]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2024-08-28T20:33:40.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:40 smithi001 ceph-mon[20984]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2024-08-28T20:33:40.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:40 smithi121 ceph-mon[25248]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2024-08-28T20:33:42.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:42 smithi007 ceph-mon[25357]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 1.32k op/s 2024-08-28T20:33:42.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:42 smithi001 ceph-mon[20984]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 1.32k op/s 2024-08-28T20:33:42.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:42 smithi121 ceph-mon[25248]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 1.32k op/s 2024-08-28T20:33:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:44 smithi001 ceph-mon[20984]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.76k op/s 2024-08-28T20:33:44.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:44 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:33:44.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:44 smithi121 ceph-mon[25248]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.76k op/s 2024-08-28T20:33:44.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:44 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:33:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:44 smithi007 ceph-mon[25357]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.76k op/s 2024-08-28T20:33:44.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:44 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T20:33:44.778 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-08-28T20:33:44.917 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/: 2024-08-28T20:33:44.917 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:44.917 INFO:teuthology.orchestra.run.smithi001.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:33:44.917 INFO:teuthology.orchestra.run.smithi001.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 .. 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 data 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data: 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:total 36 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 . 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 .. 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 28 20:18 base 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Aug 28 20:18 current_logfiles 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Aug 28 20:18 global 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 log 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_commit_ts 2024-08-28T20:33:44.918 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_dynshmem 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Aug 28 20:18 pg_hba.conf 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 28 20:18 pg_ident.conf 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:33 pg_logical 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 pg_multixact 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_notify 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_replslot 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_serial 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_snapshots 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:33 pg_stat 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:33 pg_stat_tmp 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:33 pg_subtrans 2024-08-28T20:33:44.919 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_tblspc 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pg_twophase 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Aug 28 20:33 pg_wal 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:24 pg_xact 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 28 20:18 postgresql.auto.conf 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Aug 28 20:18 postgresql.conf 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Aug 28 20:18 postmaster.opts 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base: 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 28 20:18 . 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:44.920 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 1 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 13493 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Aug 28 20:21 13494 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 pgsql_tmp 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/1: 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:total 7777 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 . 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 28 20:18 .. 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 112 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 113 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 1247 2024-08-28T20:33:44.921 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1247_fsm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1247_vm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 28 20:18 1249 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1249_fsm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1249_vm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 28 20:18 1255 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1255_fsm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1255_vm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 28 20:18 1259 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1259_fsm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1259_vm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 28 20:18 13344 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13344_fsm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13344_vm 2024-08-28T20:33:44.922 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13346 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13348 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13349_fsm 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349_vm 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13351 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13353 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13354_fsm 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354_vm 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13356 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13358 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359 2024-08-28T20:33:44.923 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13359_fsm 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359_vm 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13361 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13363 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1417 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1418 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 174 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 175 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2187 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2224 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2328 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2336 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2337 2024-08-28T20:33:44.924 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2579 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2600 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2600_fsm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2600_vm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2601_fsm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601_vm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2602 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2602_fsm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2602_vm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2603 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2603_fsm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2603_vm 2024-08-28T20:33:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2604 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2605 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2605_fsm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2605_vm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2606_fsm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606_vm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2607 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2607_fsm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2607_vm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 28 20:18 2608 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2608_fsm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2608_vm 2024-08-28T20:33:44.926 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 28 20:18 2609 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2609_fsm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2609_vm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2610 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2610_fsm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2610_vm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2611 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2612_fsm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612_vm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2613 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2615_fsm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615_vm 2024-08-28T20:33:44.927 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2616 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2616_fsm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2616_vm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 28 20:18 2617 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2617_fsm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2617_vm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 28 20:18 2618 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2618_fsm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2618_vm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 28 20:18 2619 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2619_fsm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2619_vm 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2620 2024-08-28T20:33:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2650 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2651 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2652 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2653 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2654 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2655 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2656 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2657 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 28 20:18 2658 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 2659 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2660 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2661 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2662 2024-08-28T20:33:44.929 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2663 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2664 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2665 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2666 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2667 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2668 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2669 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2670 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 28 20:18 2673 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 28 20:18 2674 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 28 20:18 2675 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2678 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2679 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2680 2024-08-28T20:33:44.930 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2681 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2682 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2683 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2684 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2685 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2686 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2687 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2688 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2689 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 28 20:18 2690 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 28 20:18 2691 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2692 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2693 2024-08-28T20:33:44.931 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2696 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2699 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2701 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2702 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2703 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2704 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2753 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2753_fsm 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2753_vm 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2754 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2755 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2756 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2757 2024-08-28T20:33:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2830 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2831 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2832 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2833 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2834 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2835 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2836 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2837 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 28 20:18 2838 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2838_fsm 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2838_vm 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2839 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840 2024-08-28T20:33:44.933 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840_fsm 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2840_vm 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2841 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2995 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2996 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3079_fsm 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079_vm 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3080 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3081 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3085 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3118 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3119 2024-08-28T20:33:44.934 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:18 3164 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3256 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3257 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3258 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3350 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3351 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3379 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3380 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3381 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3394 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3394_fsm 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3394_vm 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3395 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3429 2024-08-28T20:33:44.935 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3430 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3431 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3433 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3439 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3440 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3455 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 28 20:18 3456 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3456_fsm 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3456_vm 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3466 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3467 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3468 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3501 2024-08-28T20:33:44.936 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3502 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3503 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3534 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3541_fsm 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541_vm 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3542 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3574 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3575 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3576 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3596 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3597 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3598 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3599 2024-08-28T20:33:44.937 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3600_fsm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600_vm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3601_fsm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601_vm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3602_fsm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602_vm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603_fsm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3603_vm 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3604 2024-08-28T20:33:44.938 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3605 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3606 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3607 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3608 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 3609 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3712 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3764_fsm 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764_vm 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3766 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3767 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3997 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4143 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4144 2024-08-28T20:33:44.939 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4145 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4146 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4147 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4148 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4149 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4150 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4151 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4152 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4153 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4154 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4155 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4156 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4157 2024-08-28T20:33:44.940 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4158 2024-08-28T20:33:44.941 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4159 2024-08-28T20:33:44.941 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4160 2024-08-28T20:33:44.941 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4161 2024-08-28T20:33:44.941 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4162 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4163 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4164 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4165 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4166 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4167 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4168 2024-08-28T20:33:44.946 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4169 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4170 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4171 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4172 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4173 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4174 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 5002 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 548 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 549 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6102 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6104 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6106 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6110 2024-08-28T20:33:44.947 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6111 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6112 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6113 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6117 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 826 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 827 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 828 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:total 7777 2024-08-28T20:33:44.948 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 28 20:18 . 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 28 20:18 .. 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 112 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 113 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 1247 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1247_fsm 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1247_vm 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 28 20:18 1249 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1249_fsm 2024-08-28T20:33:44.949 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1249_vm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 28 20:18 1255 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1255_fsm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1255_vm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 28 20:18 1259 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1259_fsm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1259_vm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 28 20:18 13344 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13344_fsm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13344_vm 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13346 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13348 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349 2024-08-28T20:33:44.950 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13349_fsm 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349_vm 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13351 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13353 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13354_fsm 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354_vm 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13356 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13358 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13359_fsm 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359_vm 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13361 2024-08-28T20:33:44.951 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13363 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1417 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1418 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 174 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 175 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2187 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2224 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2328 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2336 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2337 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2579 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2600 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2600_fsm 2024-08-28T20:33:44.952 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2600_vm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2601_fsm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601_vm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2602 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2602_fsm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2602_vm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2603 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2603_fsm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2603_vm 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2604 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2605 2024-08-28T20:33:44.953 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2605_fsm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2605_vm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2606_fsm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606_vm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2607 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2607_fsm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2607_vm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 28 20:18 2608 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2608_fsm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2608_vm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 28 20:18 2609 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2609_fsm 2024-08-28T20:33:44.954 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2609_vm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2610 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2610_fsm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2610_vm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2611 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2612_fsm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612_vm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2613 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2615_fsm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615_vm 2024-08-28T20:33:44.955 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2616 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2616_fsm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2616_vm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 28 20:18 2617 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2617_fsm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2617_vm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 28 20:18 2618 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2618_fsm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2618_vm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 28 20:18 2619 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2619_fsm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2619_vm 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2620 2024-08-28T20:33:44.956 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2650 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2651 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2652 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2653 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2654 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2655 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2656 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2657 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 28 20:18 2658 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 2659 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2660 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2661 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2662 2024-08-28T20:33:44.957 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2663 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2664 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2665 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2666 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2667 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2668 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2669 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2670 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 28 20:18 2673 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 28 20:18 2674 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 28 20:18 2675 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2678 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2679 2024-08-28T20:33:44.958 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2680 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2681 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2682 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2683 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2684 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2685 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2686 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2687 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2688 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2689 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 28 20:18 2690 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 28 20:18 2691 2024-08-28T20:33:44.959 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2692 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2693 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2696 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2699 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2701 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2702 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2703 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2704 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2753 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2753_fsm 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2753_vm 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2754 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2755 2024-08-28T20:33:44.960 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2756 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2757 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2830 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2831 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2832 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2833 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2834 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2835 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2836 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2837 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 28 20:18 2838 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2838_fsm 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2838_vm 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2839 2024-08-28T20:33:44.961 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840_fsm 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2840_vm 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2841 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2995 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2996 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3079_fsm 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079_vm 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3080 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3081 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3085 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3118 2024-08-28T20:33:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3119 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:18 3164 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3256 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3257 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3258 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3350 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3351 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3379 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3380 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3381 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3394 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3394_fsm 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3394_vm 2024-08-28T20:33:44.963 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3395 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3429 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3430 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3431 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3433 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3439 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3440 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3455 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 28 20:18 3456 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3456_fsm 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3456_vm 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3466 2024-08-28T20:33:44.964 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3467 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3468 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3501 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3502 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3503 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3534 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3541_fsm 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541_vm 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3542 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3574 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3575 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3576 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3596 2024-08-28T20:33:44.965 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3597 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3598 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3599 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3600_fsm 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600_vm 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3601_fsm 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601_vm 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3602_fsm 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602_vm 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603 2024-08-28T20:33:44.966 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603_fsm 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3603_vm 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3604 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3605 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3606 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3607 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3608 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 3609 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3712 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3764_fsm 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764_vm 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3766 2024-08-28T20:33:44.967 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3767 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3997 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4143 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4144 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4145 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4146 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4147 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4148 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4149 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4150 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4151 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4152 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4153 2024-08-28T20:33:44.968 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4154 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4155 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4156 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4157 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4158 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4159 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4160 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4161 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4162 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4163 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4164 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4165 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4166 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4167 2024-08-28T20:33:44.969 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4168 2024-08-28T20:33:44.970 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4169 2024-08-28T20:33:44.970 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4170 2024-08-28T20:33:44.970 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4171 2024-08-28T20:33:44.970 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4172 2024-08-28T20:33:44.984 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4173 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4174 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 5002 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 548 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 549 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6102 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6104 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6106 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6110 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6111 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6112 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6113 2024-08-28T20:33:44.985 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6117 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 826 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 827 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 828 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:total 619638 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Aug 28 20:21 . 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 28 20:18 .. 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 112 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 113 2024-08-28T20:33:44.986 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 1247 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1247_fsm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1247_vm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 28 20:18 1249 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1249_fsm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1249_vm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 28 20:18 1255 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1255_fsm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1255_vm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 28 20:33 1259 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1259_fsm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1259_vm 2024-08-28T20:33:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 28 20:18 13344 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13344_fsm 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13344_vm 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13346 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13348 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13349_fsm 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13349_vm 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13351 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13353 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13354_fsm 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13354_vm 2024-08-28T20:33:44.988 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13356 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13358 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 13359_fsm 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13359_vm 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 13361 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 13363 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1417 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 1418 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 445145088 Aug 28 20:33 16396 2024-08-28T20:33:44.989 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 28 20:33 16396_fsm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:21 16396_vm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 819200 Aug 28 20:33 16397 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:33 16397_fsm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:33 16397_vm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1908736 Aug 28 20:33 16399 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:33 16399_fsm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:33 16399_vm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:33 16400 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:33 16402 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Aug 28 20:33 16404 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106242048 Aug 28 20:33 16406 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:33 16406_fsm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:31 16406_vm 2024-08-28T20:33:44.990 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 174 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 175 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2187 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2224 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2328 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2336 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2337 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2579 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2600 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2600_fsm 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2600_vm 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601 2024-08-28T20:33:44.991 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2601_fsm 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2601_vm 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2602 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2602_fsm 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2602_vm 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2603 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2603_fsm 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2603_vm 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2604 2024-08-28T20:33:44.992 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2605 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2605_fsm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2605_vm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2606_fsm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2606_vm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2607 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2607_fsm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2607_vm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 28 20:18 2608 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2608_fsm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2608_vm 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 28 20:18 2609 2024-08-28T20:33:44.993 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2609_fsm 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2609_vm 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2610 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2610_fsm 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2610_vm 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2611 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2612_fsm 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2612_vm 2024-08-28T20:33:44.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2613 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2615_fsm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2615_vm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2616 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2616_fsm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2616_vm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 28 20:18 2617 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2617_fsm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2617_vm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 28 20:18 2618 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2618_fsm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2618_vm 2024-08-28T20:33:44.995 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Aug 28 20:33 2619 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:29 2619_fsm 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:31 2619_vm 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2620 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2650 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2651 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2652 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2653 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2654 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2655 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2656 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2657 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 28 20:18 2658 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 28 20:18 2659 2024-08-28T20:33:44.996 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2660 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2661 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2662 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2663 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2664 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2665 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2666 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2667 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2668 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2669 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2670 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 28 20:18 2673 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 28 20:18 2674 2024-08-28T20:33:44.997 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 28 20:18 2675 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2678 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2679 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2680 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2681 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2682 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2683 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2684 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2685 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2686 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2687 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2688 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 28 20:18 2689 2024-08-28T20:33:44.998 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 28 20:18 2690 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 28 20:18 2691 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2692 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2693 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:31 2696 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2699 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2701 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2702 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2703 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 2704 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2753 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2753_fsm 2024-08-28T20:33:44.999 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2753_vm 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2754 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2755 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2756 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 2757 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2830 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2831 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2832 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2833 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2834 2024-08-28T20:33:45.000 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2835 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2836 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2837 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 28 20:18 2838 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2838_fsm 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2838_vm 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2839 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2840_fsm 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2840_vm 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2841 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2995 2024-08-28T20:33:45.001 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2996 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3079_fsm 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3079_vm 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3080 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3081 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3085 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3118 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3119 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 28 20:18 3164 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3256 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3257 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3258 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3350 2024-08-28T20:33:45.002 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3351 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3379 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3380 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3381 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3394 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3394_fsm 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3394_vm 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3395 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3429 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3430 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3431 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3433 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3439 2024-08-28T20:33:45.003 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3440 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 28 20:18 3455 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 28 20:18 3456 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3456_fsm 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3456_vm 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3466 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3467 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3468 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3501 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3502 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3503 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3534 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541 2024-08-28T20:33:45.004 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3541_fsm 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3541_vm 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3542 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3574 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3575 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3576 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3596 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3597 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3598 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3599 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3600_fsm 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3600_vm 2024-08-28T20:33:45.005 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3601_fsm 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3601_vm 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3602_fsm 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3602_vm 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3603_fsm 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3603_vm 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3604 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3605 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3606 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3607 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3608 2024-08-28T20:33:45.006 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 28 20:18 3609 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3712 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 3764_fsm 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3764_vm 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3766 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 3767 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3997 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4143 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4144 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4145 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4146 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4147 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4148 2024-08-28T20:33:45.007 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4149 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4150 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4151 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4152 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4153 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4154 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4155 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4156 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4157 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4158 2024-08-28T20:33:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4159 2024-08-28T20:33:45.010 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4160 2024-08-28T20:33:45.010 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4161 2024-08-28T20:33:45.010 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4162 2024-08-28T20:33:45.010 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4163 2024-08-28T20:33:45.010 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4164 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4165 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4166 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4167 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4168 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4169 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4170 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4171 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4172 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4173 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4174 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 5002 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 548 2024-08-28T20:33:45.011 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 549 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6102 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6104 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6106 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6110 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6111 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6112 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6113 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6117 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 826 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 827 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 828 2024-08-28T20:33:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Aug 28 20:18 pg_internal.init 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:18 PG_VERSION 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 28 20:18 .. 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/global: 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:total 560 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Aug 28 20:18 . 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.013 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1213 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1213_fsm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1213_vm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1214 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1214_fsm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1214_vm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 1232 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 1233 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1260 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1260_fsm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1260_vm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1261 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1261_fsm 2024-08-28T20:33:45.014 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1261_vm 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1262 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 1262_fsm 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 1262_vm 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2396 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 28 20:18 2396_fsm 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2396_vm 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2397 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2671 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2672 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2676 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2677 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2694 2024-08-28T20:33:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2695 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2697 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 28 20:18 2698 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2846 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2847 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2964 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2965 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 2966 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 2967 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 3592 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 3593 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4060 2024-08-28T20:33:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4061 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4175 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4176 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4177 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4178 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4181 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4182 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4183 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4184 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 4185 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 4186 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6000 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6001 2024-08-28T20:33:45.017 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6002 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 6100 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6114 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 6115 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:33 pg_control 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 28 20:18 pg_filenode.map 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Aug 28 20:18 pg_internal.init 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/log: 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:total 2 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1466 Aug 28 20:33 postgresql-Wed.log 2024-08-28T20:33:45.018 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:total 1 2024-08-28T20:33:45.019 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:33 . 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 mappings 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 28 20:33 replorigin_checkpoint 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 snapshots 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:33 .. 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.020 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:33 .. 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 . 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 members 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 offsets 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:total 8 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 .. 2024-08-28T20:33:45.021 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:18 0000 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:total 8 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:18 . 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:18 .. 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 28 20:21 0000 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.022 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.023 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:total 15 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 28 20:33 . 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Aug 28 20:33 db_0.stat 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Aug 28 20:33 db_13494.stat 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Aug 28 20:33 global.stat 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:33 . 2024-08-28T20:33:45.024 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:total 240 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 28 20:33 . 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 245760 Aug 28 20:33 001E 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-08-28T20:33:45.025 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:total 1048576 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Aug 28 20:33 . 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:33 0000000100000000000000A7 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000A8 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000A9 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000AA 2024-08-28T20:33:45.026 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000AB 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000AC 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000AD 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000AE 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000AF 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000B0 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000B1 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000B2 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000B3 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000B4 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000B5 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000B6 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000B7 2024-08-28T20:33:45.027 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000B8 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:27 0000000100000000000000B9 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:25 0000000100000000000000BA 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:27 0000000100000000000000BB 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:27 0000000100000000000000BC 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:26 0000000100000000000000BD 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:24 0000000100000000000000BE 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000BF 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000C0 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000C1 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:33 0000000100000000000000C2 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:31 0000000100000000000000C3 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000C4 2024-08-28T20:33:45.028 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:30 0000000100000000000000C5 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:31 0000000100000000000000C6 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000C7 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000C8 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000C9 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000CA 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:32 0000000100000000000000CB 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000CC 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000CD 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000CE 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:30 0000000100000000000000CF 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:31 0000000100000000000000D0 2024-08-28T20:33:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:32 0000000100000000000000D1 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000D2 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000D3 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000D4 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:30 0000000100000000000000D5 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000D6 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:30 0000000100000000000000D7 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000D8 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:32 0000000100000000000000D9 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000DA 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000DB 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000DC 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000DD 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000DE 2024-08-28T20:33:45.030 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:30 0000000100000000000000DF 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:28 0000000100000000000000E0 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:30 0000000100000000000000E1 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:31 0000000100000000000000E2 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000E3 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000E4 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000E5 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 28 20:29 0000000100000000000000E6 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 archive_status 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:total 0 2024-08-28T20:33:45.031 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 28 20:18 . 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Aug 28 20:33 .. 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:total 496 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 28 20:24 . 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 28 20:33 .. 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Aug 28 20:24 0000 2024-08-28T20:33:45.032 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 245760 Aug 28 20:33 0001 2024-08-28T20:33:45.032 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-28T20:33:45.045 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:33:45.056 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-28T20:33:45.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-28T20:33:45.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 -- 172.21.15.1:0/939657801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c103290 msgr2=0x7f283c103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 --2- 172.21.15.1:0/939657801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c103290 0x7f283c103700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f282c009900 tx=0x7f282c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 -- 172.21.15.1:0/939657801 shutdown_connections 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 --2- 172.21.15.1:0/939657801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f283c104310 0x7f283c104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 --2- 172.21.15.1:0/939657801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c104cb0 0x7f283c10b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 --2- 172.21.15.1:0/939657801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c103290 0x7f283c103700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 -- 172.21.15.1:0/939657801 >> 172.21.15.1:0/939657801 conn(0x7f283c0febd0 msgr2=0x7f283c101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 -- 172.21.15.1:0/939657801 shutdown_connections 2024-08-28T20:33:45.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.321+0000 7f283be00640 1 -- 172.21.15.1:0/939657801 wait complete. 2024-08-28T20:33:45.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 Processor -- start 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 -- start start 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c103290 0x7f283c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f283c104310 0x7f283c19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 0x7f283c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f283c10ef60 con 0x7f283c104310 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f283c10ede0 con 0x7f283c103290 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.322+0000 7f283be00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f283c10f0e0 con 0x7f283c104cb0 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 0x7f283c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c103290 0x7f283c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283a000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f283c104310 0x7f283c19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c103290 0x7f283c19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55178/0 (socket says 172.21.15.1:55178) 2024-08-28T20:33:45.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283aa00640 1 -- 172.21.15.1:0/4222963839 learned_addr learned my addr 172.21.15.1:0/4222963839 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 0x7f283c19cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49718/0 (socket says 172.21.15.1:49718) 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 -- 172.21.15.1:0/4222963839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c103290 msgr2=0x7f283c19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c103290 0x7f283c19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 -- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f283c104310 msgr2=0x7f283c19c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f283c104310 0x7f283c19c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.323+0000 7f283b400640 1 -- 172.21.15.1:0/4222963839 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c19d710 con 0x7f283c104cb0 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.324+0000 7f283b400640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 0x7f283c19cef0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2834009fd0 tx=0x7f283400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.324+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283400ce20 con 0x7f283c104cb0 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.324+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2834005020 con 0x7f283c104cb0 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.324+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c19da00 con 0x7f283c104cb0 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.324+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834010690 con 0x7f283c104cb0 2024-08-28T20:33:45.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.324+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c1a40f0 con 0x7f283c104cb0 2024-08-28T20:33:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.325+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283c1a42c0 con 0x7f283c104cb0 2024-08-28T20:33:45.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.327+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f28340054d0 con 0x7f283c104cb0 2024-08-28T20:33:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.329+0000 7f2833400640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f28200b4b30 0x7f28200b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.329+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f28340e5820 con 0x7f283c104cb0 2024-08-28T20:33:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.329+0000 7f283aa00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f28200b4b30 0x7f28200b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.330+0000 7f283aa00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f28200b4b30 0x7f28200b7040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f282c005f70 tx=0x7f282c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:45.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.330+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28340ac8e0 con 0x7f283c104cb0 2024-08-28T20:33:45.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:33:45.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:33:45.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:45 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:33:45.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:33:45.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:33:45.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:45 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:33:45.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.529+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f283c1a4490 con 0x7f283c104cb0 2024-08-28T20:33:45.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.531+0000 7f2833400640 1 -- 172.21.15.1:0/4222963839 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7f28340ac1e0 con 0x7f283c104cb0 2024-08-28T20:33:45.533 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:45.533 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:33:45.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.533+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f28200b4b30 msgr2=0x7f28200b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f28200b4b30 0x7f28200b7040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f282c005f70 tx=0x7f282c0314a0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 msgr2=0x7f283c19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 0x7f283c19cef0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2834009fd0 tx=0x7f283400ef10 comp rx=0 tx=0).stop 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 shutdown_connections 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f28200b4b30 0x7f28200b7040 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f283c104310 0x7f283c19c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c104cb0 0x7f283c19cef0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 --2- 172.21.15.1:0/4222963839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f283c103290 0x7f283c19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 >> 172.21.15.1:0/4222963839 conn(0x7f283c0febd0 msgr2=0x7f283c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 shutdown_connections 2024-08-28T20:33:45.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.534+0000 7f283be00640 1 -- 172.21.15.1:0/4222963839 wait complete. 2024-08-28T20:33:45.561 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-28T20:11:04.566315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-28T20:15:48.139740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-28T20:15:51.422523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-28T20:33:45.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-28T20:33:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T20:33:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T20:33:45.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:45 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' 2024-08-28T20:33:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 -- 172.21.15.1:0/980024122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c106eb0 msgr2=0x7f909c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 --2- 172.21.15.1:0/980024122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c106eb0 0x7f909c10d850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9094009ca0 tx=0x7f909402a8c0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 -- 172.21.15.1:0/980024122 shutdown_connections 2024-08-28T20:33:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 --2- 172.21.15.1:0/980024122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c106eb0 0x7f909c10d850 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 --2- 172.21.15.1:0/980024122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 0x7f909c106920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 --2- 172.21.15.1:0/980024122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c105490 0x7f909c105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 -- 172.21.15.1:0/980024122 >> 172.21.15.1:0/980024122 conn(0x7f909c100df0 msgr2=0x7f909c103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 -- 172.21.15.1:0/980024122 shutdown_connections 2024-08-28T20:33:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.788+0000 7f90a2800640 1 -- 172.21.15.1:0/980024122 wait complete. 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.789+0000 7f90a2800640 1 Processor -- start 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 -- start start 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 0x7f909c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 0x7f909c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c106eb0 0x7f909c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f909c111110 con 0x7f909c105490 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f909c110f90 con 0x7f909c106510 2024-08-28T20:33:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a2800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f909c111290 con 0x7f909c106eb0 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a1400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 0x7f909c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a1400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 0x7f909c19bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56098/0 (socket says 172.21.15.1:56098) 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 0x7f909c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a1400640 1 -- 172.21.15.1:0/2327266977 learned_addr learned my addr 172.21.15.1:0/2327266977 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.790+0000 7f90a1e00640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c106eb0 0x7f909c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1400640 1 -- 172.21.15.1:0/2327266977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c106eb0 msgr2=0x7f909c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1400640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c106eb0 0x7f909c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1400640 1 -- 172.21.15.1:0/2327266977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 msgr2=0x7f909c19c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1400640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 0x7f909c19c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1400640 1 -- 172.21.15.1:0/2327266977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c19d690 con 0x7f909c105490 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a0a00640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 0x7f909c19c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1e00640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c106eb0 0x7f909c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:33:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a1400640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 0x7f909c19bcc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f909000e9f0 tx=0x7f909000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909000cd80 con 0x7f909c105490 2024-08-28T20:33:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90900054d0 con 0x7f909c105490 2024-08-28T20:33:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c19d980 con 0x7f909c105490 2024-08-28T20:33:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090010690 con 0x7f909c105490 2024-08-28T20:33:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.791+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909c1a4070 con 0x7f909c105490 2024-08-28T20:33:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.792+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909c19dbe0 con 0x7f909c105490 2024-08-28T20:33:45.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.795+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f9090004e90 con 0x7f909c105490 2024-08-28T20:33:45.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.796+0000 7f909a000640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90840b4b30 0x7f90840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:45.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.796+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f90900e55d0 con 0x7f909c105490 2024-08-28T20:33:45.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.796+0000 7f90a0a00640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90840b4b30 0x7f90840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:45.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.797+0000 7f90a0a00640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90840b4b30 0x7f90840b7040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9088009fc0 tx=0x7f9088005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:45.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.800+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f90900ac690 con 0x7f909c105490 2024-08-28T20:33:45.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.997+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f909c063d60 con 0x7f909c105490 2024-08-28T20:33:45.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:45.998+0000 7f909a000640 1 -- 172.21.15.1:0/2327266977 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f90900abf90 con 0x7f909c105490 2024-08-28T20:33:46.000 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-08-28T20:33:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90840b4b30 msgr2=0x7f90840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90840b4b30 0x7f90840b7040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9088009fc0 tx=0x7f9088005f90 comp rx=0 tx=0).stop 2024-08-28T20:33:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 msgr2=0x7f909c19bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 0x7f909c19bcc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f909000e9f0 tx=0x7f909000edf0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 shutdown_connections 2024-08-28T20:33:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f90840b4b30 0x7f90840b7040 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c106eb0 0x7f909c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909c106510 0x7f909c19c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 --2- 172.21.15.1:0/2327266977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f909c105490 0x7f909c19bcc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.000+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 >> 172.21.15.1:0/2327266977 conn(0x7f909c100df0 msgr2=0x7f909c109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.001+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 shutdown_connections 2024-08-28T20:33:46.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.001+0000 7f90a2800640 1 -- 172.21.15.1:0/2327266977 wait complete. 2024-08-28T20:33:46.028 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-28T20:33:46.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 -- 172.21.15.1:0/2056731916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a4109180 msgr2=0x7f06a410b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 --2- 172.21.15.1:0/2056731916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a4109180 0x7f06a410b690 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f069c009ca0 tx=0x7f069c02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 -- 172.21.15.1:0/2056731916 shutdown_connections 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 --2- 172.21.15.1:0/2056731916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a4109180 0x7f06a410b690 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 --2- 172.21.15.1:0/2056731916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06a41065c0 0x7f06a4108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 --2- 172.21.15.1:0/2056731916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 -- 172.21.15.1:0/2056731916 >> 172.21.15.1:0/2056731916 conn(0x7f06a40fdca0 msgr2=0x7f06a4100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 -- 172.21.15.1:0/2056731916 shutdown_connections 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.254+0000 7f06ab600640 1 -- 172.21.15.1:0/2056731916 wait complete. 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.255+0000 7f06ab600640 1 Processor -- start 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.255+0000 7f06ab600640 1 -- start start 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06ab600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06ab600640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a41065c0 0x7f06a419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06ab600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06a4109180 0x7f06a419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06ab600640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410f0a0 con 0x7f06a41065c0 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06ab600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410ef20 con 0x7f06a406c2e0 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06ab600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410f220 con 0x7f06a4109180 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a3e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a41065c0 0x7f06a419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:55216/0 (socket says 172.21.15.1:55216) 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 -- 172.21.15.1:0/3750213988 learned_addr learned my addr 172.21.15.1:0/3750213988 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a9600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06a4109180 0x7f06a419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 -- 172.21.15.1:0/3750213988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06a4109180 msgr2=0x7f06a419ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06a4109180 0x7f06a419ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 -- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a41065c0 msgr2=0x7f06a419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a41065c0 0x7f06a419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.256+0000 7f06a8c00640 1 -- 172.21.15.1:0/3750213988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a419b6b0 con 0x7f06a406c2e0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06a3e00640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a41065c0 0x7f06a419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06a8c00640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4199c70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f069800ea60 tx=0x7f069800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069800cde0 con 0x7f06a406c2e0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06980035f0 con 0x7f06a406c2e0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419b9a0 con 0x7f06a406c2e0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698010690 con 0x7f06a406c2e0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.257+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41a2090 con 0x7f06a406c2e0 2024-08-28T20:33:46.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.258+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a40ff7c0 con 0x7f06a406c2e0 2024-08-28T20:33:46.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.262+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f06980037a0 con 0x7f06a406c2e0 2024-08-28T20:33:46.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.263+0000 7f06a1600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f068c0b4bb0 0x7f068c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.263+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f06980e57f0 con 0x7f06a406c2e0 2024-08-28T20:33:46.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.264+0000 7f06a3e00640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f068c0b4bb0 0x7f068c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.264+0000 7f06a3e00640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f068c0b4bb0 0x7f068c0b70c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06a406c890 tx=0x7f0690005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:46.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.265+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06980ac8b0 con 0x7f06a406c2e0 2024-08-28T20:33:46.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.460+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06a402e5c0 con 0x7f06a406c2e0 2024-08-28T20:33:46.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.461+0000 7f06a1600640 1 -- 172.21.15.1:0/3750213988 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7f06980ac1b0 con 0x7f06a406c2e0 2024-08-28T20:33:46.463 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-08-28T20:33:46.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f068c0b4bb0 msgr2=0x7f068c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f068c0b4bb0 0x7f068c0b70c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06a406c890 tx=0x7f0690005f90 comp rx=0 tx=0).stop 2024-08-28T20:33:46.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 msgr2=0x7f06a4199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4199c70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f069800ea60 tx=0x7f069800ef20 comp rx=0 tx=0).stop 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 shutdown_connections 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f068c0b4bb0 0x7f068c0b70c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06a41065c0 0x7f06a419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06a4109180 0x7f06a419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 --2- 172.21.15.1:0/3750213988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a406c2e0 0x7f06a4199c70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 >> 172.21.15.1:0/3750213988 conn(0x7f06a40fdca0 msgr2=0x7f06a4104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 shutdown_connections 2024-08-28T20:33:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.464+0000 7f06ab600640 1 -- 172.21.15.1:0/3750213988 wait complete. 2024-08-28T20:33:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:46 smithi001 ceph-mon[20984]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 1.74k op/s 2024-08-28T20:33:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:46 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/4222963839' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:33:46.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:46 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2327266977' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T20:33:46.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:46 smithi121 ceph-mon[25248]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 1.74k op/s 2024-08-28T20:33:46.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:46 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/4222963839' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:33:46.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:46 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2327266977' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T20:33:46.490 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-28T20:33:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:46 smithi007 ceph-mon[25357]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 1.74k op/s 2024-08-28T20:33:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:46 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/4222963839' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:33:46.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:46 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2327266977' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 -- 172.21.15.1:0/634536439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 msgr2=0x7fe6f0106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 --2- 172.21.15.1:0/634536439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f0106940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009900 tx=0x7fe6dc02a410 comp rx=0 tx=0).stop 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 -- 172.21.15.1:0/634536439 shutdown_connections 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 --2- 172.21.15.1:0/634536439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f0106940 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 --2- 172.21.15.1:0/634536439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 0x7fe6f010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 --2- 172.21.15.1:0/634536439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 0x7fe6f0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 -- 172.21.15.1:0/634536439 >> 172.21.15.1:0/634536439 conn(0x7fe6f0100df0 msgr2=0x7fe6f01032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:46.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 -- 172.21.15.1:0/634536439 shutdown_connections 2024-08-28T20:33:46.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.715+0000 7fe6efe00640 1 -- 172.21.15.1:0/634536439 wait complete. 2024-08-28T20:33:46.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.716+0000 7fe6efe00640 1 Processor -- start 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 -- start start 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 0x7fe6f019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 0x7fe6f019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0111150 con 0x7fe6f0106530 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0110fd0 con 0x7fe6f01054b0 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6efe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f01112d0 con 0x7fe6f0106ed0 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6ee000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6eea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 0x7fe6f019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6ef400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 0x7fe6f019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6ee000640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f019c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56140/0 (socket says 172.21.15.1:56140) 2024-08-28T20:33:46.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.717+0000 7fe6ee000640 1 -- 172.21.15.1:0/3987038622 learned_addr learned my addr 172.21.15.1:0/3987038622 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6eea00640 1 -- 172.21.15.1:0/3987038622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 msgr2=0x7fe6f019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6eea00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 0x7fe6f019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6eea00640 1 -- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 msgr2=0x7fe6f019c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6eea00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f019c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6eea00640 1 -- 172.21.15.1:0/3987038622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f019d750 con 0x7fe6f01054b0 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6ef400640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 0x7fe6f019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6eea00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 0x7fe6f019bd10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000e9f0 tx=0x7fe6e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000ccc0 con 0x7fe6f01054b0 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f019da40 con 0x7fe6f01054b0 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6e00108e0 con 0x7fe6f01054b0 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0018880 con 0x7fe6f01054b0 2024-08-28T20:33:46.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.718+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f01a4130 con 0x7fe6f01054b0 2024-08-28T20:33:46.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.719+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f010c660 con 0x7fe6f01054b0 2024-08-28T20:33:46.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.722+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fe6e0010430 con 0x7fe6f01054b0 2024-08-28T20:33:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.724+0000 7fe6e7400640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe6d40b4b30 0x7fe6d40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.724+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fe6e00e5970 con 0x7fe6f01054b0 2024-08-28T20:33:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.724+0000 7fe6ee000640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe6d40b4b30 0x7fe6d40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.725+0000 7fe6ee000640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe6d40b4b30 0x7fe6d40b7040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005f70 tx=0x7fe6dc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.725+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe6e00ac3e0 con 0x7fe6f01054b0 2024-08-28T20:33:46.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.924+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6f0063d60 con 0x7fe6f01054b0 2024-08-28T20:33:46.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.925+0000 7fe6e7400640 1 -- 172.21.15.1:0/3987038622 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7fe6e00b0ba0 con 0x7fe6f01054b0 2024-08-28T20:33:46.926 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-08-28T20:33:46.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.927+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe6d40b4b30 msgr2=0x7fe6d40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe6d40b4b30 0x7fe6d40b7040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005f70 tx=0x7fe6dc0314a0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 msgr2=0x7fe6f019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:46.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 0x7fe6f019bd10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000e9f0 tx=0x7fe6e000eeb0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 shutdown_connections 2024-08-28T20:33:46.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fe6d40b4b30 0x7fe6d40b7040 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6f0106530 0x7fe6f019c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6f0106ed0 0x7fe6f019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 --2- 172.21.15.1:0/3987038622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f01054b0 0x7fe6f019bd10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:46.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 >> 172.21.15.1:0/3987038622 conn(0x7fe6f0100df0 msgr2=0x7fe6f0109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:46.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 shutdown_connections 2024-08-28T20:33:46.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:46.928+0000 7fe6efe00640 1 -- 172.21.15.1:0/3987038622 wait complete. 2024-08-28T20:33:46.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-28T20:33:47.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 -- 172.21.15.1:0/1427507843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 msgr2=0x7f56781038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 --2- 172.21.15.1:0/1427507843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 0x7f56781038c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f566c009900 tx=0x7f566c02a3f0 comp rx=0 tx=0).stop 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 -- 172.21.15.1:0/1427507843 shutdown_connections 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 --2- 172.21.15.1:0/1427507843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567810b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 --2- 172.21.15.1:0/1427507843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56781044d0 0x7f56781048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 --2- 172.21.15.1:0/1427507843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 0x7f56781038c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 -- 172.21.15.1:0/1427507843 >> 172.21.15.1:0/1427507843 conn(0x7f56780fed90 msgr2=0x7f5678101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 -- 172.21.15.1:0/1427507843 shutdown_connections 2024-08-28T20:33:47.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.179+0000 7f567f400640 1 -- 172.21.15.1:0/1427507843 wait complete. 2024-08-28T20:33:47.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 Processor -- start 2024-08-28T20:33:47.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 -- start start 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 0x7f567819bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56781044d0 0x7f567819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f567810f0d0 con 0x7f5678104e70 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f567810ef50 con 0x7f5678103450 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.180+0000 7f567f400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f567810f250 con 0x7f56781044d0 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567819d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36560/0 (socket says 172.21.15.1:36560) 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 -- 172.21.15.1:0/2865373192 learned_addr learned my addr 172.21.15.1:0/2865373192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567ca00640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 0x7f567819bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f5677e00640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56781044d0 0x7f567819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:47.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 -- 172.21.15.1:0/2865373192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56781044d0 msgr2=0x7f567819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56781044d0 0x7f567819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 -- 172.21.15.1:0/2865373192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 msgr2=0x7f567819bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 0x7f567819bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 -- 172.21.15.1:0/2865373192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567819d920 con 0x7f5678104e70 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.181+0000 7f567d400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567819d100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f567000efd0 tx=0x7f567000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.182+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670003b70 con 0x7f5678104e70 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.182+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670003d10 con 0x7f5678104e70 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.182+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567819dc10 con 0x7f5678104e70 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.182+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56700108a0 con 0x7f5678104e70 2024-08-28T20:33:47.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.182+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56781a4300 con 0x7f5678104e70 2024-08-28T20:33:47.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.183+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56781a44d0 con 0x7f5678104e70 2024-08-28T20:33:47.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.185+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f5670004020 con 0x7f5678104e70 2024-08-28T20:33:47.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.187+0000 7f5675600640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56600b4bb0 0x7f56600b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:33:47.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.187+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f56700e5520 con 0x7f5678104e70 2024-08-28T20:33:47.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.187+0000 7f567ca00640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56600b4bb0 0x7f56600b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:33:47.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.188+0000 7f567ca00640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56600b4bb0 0x7f56600b70c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f566c000c00 tx=0x7f566c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:33:47.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.190+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56700ac5e0 con 0x7f5678104e70 2024-08-28T20:33:47.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:47 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:33:47.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:47 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3750213988' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T20:33:47.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:47 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3987038622' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T20:33:47.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.436+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f56781a46a0 con 0x7f5678104e70 2024-08-28T20:33:47.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.446+0000 7f5675600640 1 -- 172.21.15.1:0/2865373192 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+825778 (secure 0 0 0) 0x7f56700abee0 con 0x7f5678104e70 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 18, 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 25450820 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 25450820 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/25450820", 2024-08-28T20:33:47.461 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-08-28T20:08:08.058088+0000", 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540701547738038271, 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24133, 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.467 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-08-28T20:33:47.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-08-28T20:33:47.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T20:33:47.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-08-28T20:33:47.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-08-28T20:33:47.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.487 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.493 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-08-28T20:33:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:47.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.503 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-08-28T20:33:47.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-08-28T20:33:47.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-08-28T20:33:47.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-28T20:33:47.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-28T20:33:47.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-08-28T20:33:47.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-08-28T20:33:47.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-08-28T20:33:47.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-08-28T20:33:47.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nginx": { 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nginx", 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-28T20:33:47.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nginx container image", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_oauth2_proxy": { 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_oauth2_proxy", 2024-08-28T20:33:47.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "oauth2-proxy container image", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-08-28T20:33:47.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-08-28T20:33:47.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-28T20:33:47.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-08-28T20:33:47.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-08-28T20:33:47.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-08-28T20:33:47.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-28T20:33:47.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-08-28T20:33:47.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-08-28T20:33:47.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-08-28T20:33:47.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-08-28T20:33:47.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-08-28T20:33:47.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-08-28T20:33:47.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-08-28T20:33:47.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.557 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.558 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.562 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-28T20:33:47.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-08-28T20:33:47.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-08-28T20:33:47.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.571 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-28T20:33:47.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-28T20:33:47.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.576 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-08-28T20:33:47.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-08-28T20:33:47.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-28T20:33:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-08-28T20:33:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-08-28T20:33:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-28T20:33:47.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.581 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-08-28T20:33:47.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-08-28T20:33:47.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-28T20:33:47.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.583 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-08-28T20:33:47.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-08-28T20:33:47.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.585 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-28T20:33:47.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-08-28T20:33:47.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.604 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-28T20:33:47.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-28T20:33:47.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-28T20:33:47.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.618 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.619 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "[]", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "MULTICLUSTER_CONFIG": { 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "{}", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-28T20:33:47.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-28T20:33:47.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.638 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "UNSAFE_TLS_v1_2": { 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-28T20:33:47.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-08-28T20:33:47.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-08-28T20:33:47.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-08-28T20:33:47.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-08-28T20:33:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-08-28T20:33:47.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.658 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.659 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.669 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-08-28T20:33:47.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-08-28T20:33:47.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.674 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.679 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-08-28T20:33:47.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-08-28T20:33:47.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.683 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.686 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.687 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-28T20:33:47.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.691 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.698 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-08-28T20:33:47.700 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-08-28T20:33:47.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.705 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.707 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.708 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-08-28T20:33:47.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.718 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.721 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-08-28T20:33:47.724 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.725 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.732 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.739 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.746 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.747 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-08-28T20:33:47.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-08-28T20:33:47.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.753 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.754 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.755 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.759 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.760 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.762 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.763 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.766 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.769 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.770 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.773 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-08-28T20:33:47.776 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.777 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.778 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.780 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.781 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.782 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-08-28T20:33:47.783 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.784 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.785 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.786 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.806 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.807 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.808 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.809 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.811 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.816 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.817 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.818 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-08-28T20:33:47.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.822 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.825 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.827 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-28T20:33:47.830 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-28T20:33:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.833 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.837 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.838 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.840 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-08-28T20:33:47.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-08-28T20:33:47.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-08-28T20:33:47.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.849 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.850 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.852 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max_requests": { 2024-08-28T20:33:47.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_requests", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.855 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.856 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.857 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.858 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.862 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.863 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.866 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.867 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.868 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.870 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-08-28T20:33:47.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.874 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.878 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.879 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-08-28T20:33:47.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-08-28T20:33:47.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-08-28T20:33:47.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-08-28T20:33:47.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.884 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.885 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.886 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.887 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smb", 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "internal_store_backend": { 2024-08-28T20:33:47.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "internal_store_backend", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.896 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.897 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.898 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.899 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "update_orchestration": { 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "update_orchestration", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-08-28T20:33:47.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-08-28T20:33:47.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.905 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.906 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.911 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.915 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.916 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.920 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.922 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.923 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-08-28T20:33:47.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.928 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.931 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.934 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.936 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-08-28T20:33:47.937 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-08-28T20:33:47.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.939 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.944 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.953 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.954 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-08-28T20:33:47.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-08-28T20:33:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-08-28T20:33:47.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.960 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.962 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.964 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.967 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.971 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.972 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-08-28T20:33:47.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-08-28T20:33:47.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-08-28T20:33:47.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.976 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-08-28T20:33:47.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.985 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:47.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.988 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.989 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.990 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24143, 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-08-28T20:33:47.992 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.994 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:47.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:47.997 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.998 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:47.999 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-08-28T20:33:48.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.005 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.006 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.007 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.008 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.010 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-08-28T20:33:48.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-08-28T20:33:48.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-08-28T20:33:48.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.016 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.017 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.018 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-28T20:33:48.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.024 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-08-28T20:33:48.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.027 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.028 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.031 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-08-28T20:33:48.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-08-28T20:33:48.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-28T20:33:48.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.042 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-28T20:33:48.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-28T20:33:48.045 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-28T20:33:48.046 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-28T20:33:48.047 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nginx": { 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nginx", 2024-08-28T20:33:48.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nginx container image", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-08-28T20:33:48.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.054 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_oauth2_proxy": { 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_oauth2_proxy", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "oauth2-proxy container image", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.056 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-08-28T20:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.072 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.074 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.075 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.076 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.078 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-28T20:33:48.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-28T20:33:48.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-08-28T20:33:48.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-28T20:33:48.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.083 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-08-28T20:33:48.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.090 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.091 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.096 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-28T20:33:48.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-08-28T20:33:48.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-28T20:33:48.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.101 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.102 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.106 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-28T20:33:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-28T20:33:48.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-28T20:33:48.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-28T20:33:48.112 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-08-28T20:33:48.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-28T20:33:48.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.115 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.122 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.125 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.129 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-28T20:33:48.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-28T20:33:48.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "[]", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "MULTICLUSTER_CONFIG": { 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-28T20:33:48.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "{}", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-28T20:33:48.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-28T20:33:48.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-28T20:33:48.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-28T20:33:48.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-28T20:33:48.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "UNSAFE_TLS_v1_2": { 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-28T20:33:48.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-28T20:33:48.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.160 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.161 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.166 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.178 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:48.179 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.181 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.183 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.186 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-08-28T20:33:48.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-08-28T20:33:48.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-08-28T20:33:48.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.196 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.197 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-08-28T20:33:48.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-08-28T20:33:48.206 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.207 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.211 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-08-28T20:33:48.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.223 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.233 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.236 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.242 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.245 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-28T20:33:48.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.247 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.251 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-08-28T20:33:48.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-08-28T20:33:48.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-08-28T20:33:48.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.255 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.259 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.268 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.270 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.271 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.272 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.275 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.278 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.283 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.287 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.290 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.291 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-08-28T20:33:48.294 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.295 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.297 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.298 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.301 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.305 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-28T20:33:48.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.319 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.320 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.327 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-08-28T20:33:48.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-28T20:33:48.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.331 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.333 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.340 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.343 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.345 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.349 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-08-28T20:33:48.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-08-28T20:33:48.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.353 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.354 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max_requests": { 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_requests", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-28T20:33:48.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.364 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.366 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.369 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.370 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.373 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.374 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.379 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.382 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-08-28T20:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-08-28T20:33:48.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-08-28T20:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-08-28T20:33:48.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.388 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.389 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.391 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smb", 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "internal_store_backend": { 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "internal_store_backend", 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "update_orchestration": { 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "update_orchestration", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.408 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.416 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.419 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.422 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.423 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.431 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.432 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-08-28T20:33:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-08-28T20:33:48.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-08-28T20:33:48.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-08-28T20:33:48.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-08-28T20:33:48.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-08-28T20:33:48.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.444 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.445 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.453 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.454 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.461 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.462 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.464 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.465 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.468 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.469 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-08-28T20:33:48.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.484 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.485 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.486 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.492 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.493 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-08-28T20:33:48.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-08-28T20:33:48.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-08-28T20:33:48.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-08-28T20:33:48.503 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-08-28T20:33:48.509 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T20:33:48.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-28T20:33:48.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-28T20:33:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-08-28T20:33:48.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-08-28T20:33:48.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.519 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.521 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-08-28T20:33:48.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-08-28T20:33:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.531 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-28T20:33:48.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-08-28T20:33:48.538 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-08-28T20:33:48.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-08-28T20:33:48.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-08-28T20:33:48.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.545 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-08-28T20:33:48.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nginx": { 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nginx", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nginx container image", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-28T20:33:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_oauth2_proxy": { 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_oauth2_proxy", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "oauth2-proxy container image", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-08-28T20:33:48.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-08-28T20:33:48.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.565 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-28T20:33:48.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-28T20:33:48.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-08-28T20:33:48.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-08-28T20:33:48.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.590 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.591 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.594 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-08-28T20:33:48.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-08-28T20:33:48.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-08-28T20:33:48.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-08-28T20:33:48.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.602 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-28T20:33:48.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-08-28T20:33:48.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.612 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.613 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-28T20:33:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-28T20:33:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-28T20:33:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "[]", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "MULTICLUSTER_CONFIG": { 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "{}", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-08-28T20:33:48.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.653 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.654 INFO:teuthology.orchestra.run.smithi001.stdout: "UNSAFE_TLS_v1_2": { 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-08-28T20:33:48.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.667 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-08-28T20:33:48.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:48.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-08-28T20:33:48.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.682 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.694 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.698 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-08-28T20:33:48.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-08-28T20:33:48.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-08-28T20:33:48.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.709 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.711 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.712 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-08-28T20:33:48.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.725 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.729 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.742 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.743 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-08-28T20:33:48.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.745 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.748 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-08-28T20:33:48.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-08-28T20:33:48.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-28T20:33:48.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.762 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.764 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.765 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.769 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.776 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.781 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.783 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.785 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-08-28T20:33:48.786 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-08-28T20:33:48.788 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.789 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.796 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.803 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.805 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-08-28T20:33:48.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.811 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.812 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.814 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.820 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.821 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.823 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.824 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.825 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.828 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.830 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.835 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-08-28T20:33:48.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.838 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.839 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.841 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.844 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.846 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.847 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.849 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.850 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.851 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.852 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.853 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "max_requests": { 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_requests", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-08-28T20:33:48.855 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.856 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.857 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.859 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.860 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.862 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.866 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.867 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-08-28T20:33:48.870 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.871 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.874 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-08-28T20:33:48.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.878 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.879 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.888 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.896 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smb", 2024-08-28T20:33:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "internal_store_backend": { 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "internal_store_backend", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.899 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.903 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "update_orchestration": { 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "update_orchestration", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-08-28T20:33:48.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.908 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.909 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.916 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.918 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.920 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.924 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.925 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.928 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.929 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.931 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.932 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.934 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.937 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.938 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.939 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.942 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.947 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.951 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.953 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.954 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.955 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-08-28T20:33:48.960 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.961 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.964 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.965 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.967 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.971 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-08-28T20:33:48.978 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.980 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.982 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "sqlite3_killpoint": { 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sqlite3_killpoint", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "dev", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.989 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-08-28T20:33:48.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-08-28T20:33:48.991 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-08-28T20:33:48.992 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-08-28T20:33:48.993 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-08-28T20:33:48.994 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-08-28T20:33:48.995 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1240637972 2024-08-28T20:33:48.996 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3007903725 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.997 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3206000469 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-08-28T20:33:48.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 664975483 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-08-28T20:33:48.999 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:33:49.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56600b4bb0 msgr2=0x7f56600b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56600b4bb0 0x7f56600b70c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f566c000c00 tx=0x7f566c031400 comp rx=0 tx=0).stop 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 msgr2=0x7f567819d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567819d100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f567000efd0 tx=0x7f567000c6a0 comp rx=0 tx=0).stop 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 shutdown_connections 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f56600b4bb0 0x7f56600b70c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5678104e70 0x7f567819d100 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56781044d0 0x7f567819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 --2- 172.21.15.1:0/2865373192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5678103450 0x7f567819bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 >> 172.21.15.1:0/2865373192 conn(0x7f56780fed90 msgr2=0x7f5678075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.454+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 shutdown_connections 2024-08-28T20:33:49.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:33:47.455+0000 7f567f400640 1 -- 172.21.15.1:0/2865373192 wait complete. 2024-08-28T20:33:49.068 DEBUG:tasks.check_counter:Getting stats from a 2024-08-28T20:33:49.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-28T20:33:49.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:48 smithi001 ceph-mon[20984]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 1.63k op/s 2024-08-28T20:33:49.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:48 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2865373192' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:47 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:47 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3750213988' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:47 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3987038622' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:48 smithi007 ceph-mon[25357]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 1.63k op/s 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:48 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2865373192' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:47 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:33:49.070 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:47 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3750213988' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T20:33:49.071 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:47 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3987038622' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T20:33:49.071 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:48 smithi121 ceph-mon[25248]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 1.63k op/s 2024-08-28T20:33:49.071 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:48 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2865373192' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-28T20:33:49.463 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:33:50.217 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:50 smithi001 ceph-mon[20984]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 27 MiB/s wr, 1.33k op/s 2024-08-28T20:33:50.357 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:33:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:33:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003678489, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000660971, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 6, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 225, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3312, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 199920, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.038763928, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.030803751, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.005496071, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 224, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.049358312, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000220349 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 199920 2024-08-28T20:33:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 295, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 292, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 544480, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 180240, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.089212525, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.048018339, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.045353637, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 291, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.047965662, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000164830 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 544480, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 180240 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-08-28T20:33:50.363 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:33:50.364 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:33:50.365 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:33:50.366 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 149735, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 30, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-08-28T20:33:50.367 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:33:50.368 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 297, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 502805, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 297, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 297, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 502805, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:50.369 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:50.370 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:50.370 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:50.370 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:50.370 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:33:50.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:50 smithi121 ceph-mon[25248]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 27 MiB/s wr, 1.33k op/s 2024-08-28T20:33:50.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:50 smithi007 ceph-mon[25357]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 27 MiB/s wr, 1.33k op/s 2024-08-28T20:33:51.520 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-28T20:33:51.520 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-28T20:33:51.520 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-08-28T20:33:51.520 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-08-28T20:33:51.520 DEBUG:tasks.check_counter:Getting stats from d 2024-08-28T20:33:51.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-28T20:33:51.902 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:33:52.388 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:52 smithi001 ceph-mon[20984]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-08-28T20:33:52.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:52 smithi121 ceph-mon[25248]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-08-28T20:33:52.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:52 smithi007 ceph-mon[25357]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-08-28T20:33:52.673 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003848278, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000707034, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:52.674 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:52.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.675 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T20:33:52.675 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T20:33:52.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 300, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 297, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 545840, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 183440, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-08-28T20:33:52.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.087527455, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.054040613, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.039787155, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 296, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.047697588, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000161140 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:52.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 545840, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 183440 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 6, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 229, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3312, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 200624, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.040813506, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.032820911, 2024-08-28T20:33:52.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.005259737, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 228, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.034235941, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000150157 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 200624 2024-08-28T20:33:52.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:33:52.682 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:33:52.683 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:33:52.684 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 149735, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 30, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-08-28T20:33:52.685 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:33:52.686 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 302, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 503455, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 302, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 302, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 503455, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:52.687 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:52.688 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:52.688 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:52.688 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:33:53.544 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-28T20:33:53.544 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-28T20:33:53.544 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-28T20:33:53.544 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-28T20:33:53.544 DEBUG:tasks.check_counter:Getting stats from g 2024-08-28T20:33:53.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-28T20:33:53.926 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:33:54.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:54 smithi001 ceph-mon[20984]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 759 op/s 2024-08-28T20:33:54.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:54 smithi121 ceph-mon[25248]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 759 op/s 2024-08-28T20:33:54.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:54 smithi007 ceph-mon[25357]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 759 op/s 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 5561, 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 6874, 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 1533680, 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 8843686, 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 14, 2024-08-28T20:33:54.678 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 5, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 1.572991994, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 1.183756734, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.367462092, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.077306416, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 6870, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 1.298324486, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000188984 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 4555, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.002069394, 2024-08-28T20:33:54.679 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000454 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 928, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 736 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 3134, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2943, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 2019274, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 1968151, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 9, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 5, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.485290333, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.245994688, 2024-08-28T20:33:54.680 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.302316265, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.009005140, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 2943, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.735981934, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000250078 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 5398, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.002276346, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000421 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.681 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 571792 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1241, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 1505, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 1068133, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 756479, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 9, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 6, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.256085638, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.122892197, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.132757978, 2024-08-28T20:33:54.682 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.014953603, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1505, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.290054622, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000192727 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1446, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000759062, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000524 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 699808, 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 189392 2024-08-28T20:33:54.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 1, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-MDSRank": { 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 2985, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 1.538931436, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000515554 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.684 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-PurgeQueue": { 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 94, 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.009187695, 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000097741 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": { 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "request": 2270, 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "reply": 2210, 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "reply_latency": { 2024-08-28T20:33:54.685 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 2210, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 4.958003655, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.002243440 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_reply": 0, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "forward": 60, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_complete": 4, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_keys": 0, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_commit": 11, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_split": 0, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_merge": 0, 2024-08-28T20:33:54.686 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes": 1156, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_top": 0, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_bottom": 942, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pin_tail": 214, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pinned": 1155, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_expired": 666, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_with_caps": 754, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": 754, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "subtrees": 11, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse": 5302, 2024-08-28T20:33:54.687 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_hit": 4159, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_forward": 56, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_discover": 28, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_dir_fetch": 0, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_remote_ino": 0, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_lock": 308, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "load_cent": 67901, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "q": 0, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "exported": 29, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "exported_inodes": 712, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "imported": 36, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "imported_inodes": 1115, 2024-08-28T20:33:54.688 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_dir_fetch": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_backtrace_fetch": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_peer_discover": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rfiles": 1030, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rbytes": 1689795876, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rsnaps": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_set_tag": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_inotable_repaired": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_inodes": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_file_inodes": 0, 2024-08-28T20:33:54.689 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_inode_file_caps": 1, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_revoke": 395, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_grant": 935, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_trunc": 1, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps": 1242, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps_dirty": 633, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_cap_release": 54, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "process_request_cap_release": 1039 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache": { 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update": 58, 2024-08-28T20:33:54.690 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update_receipt": 103, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_try_discover": 60, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_send_discover": 80, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_handle_discover": 87, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays": 1, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_delayed": 0, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_enqueuing": 0, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_created": 259, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_enqueued": 29, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_reintegrated": 229, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_migrated": 0, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_processing": 0, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_enqueued": 0, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_prioritized": 0, 2024-08-28T20:33:54.691 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_started": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_completed": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_path": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_inode": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_exportdir": 29, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_flush": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragmentdir": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragstats": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_inodestats": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_started": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_succeeded": 0, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "uninline_write_failed": 0 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.692 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log": { 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "evlrg": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "evadd": 2349, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "evex": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "evtrm": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "ev": 2349, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "evexg": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "evexd": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "segadd": 4, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "segex": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "segtrm": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "seg": 4, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "segmjr": 2, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "segexg": 0, 2024-08-28T20:33:54.693 INFO:teuthology.orchestra.run.smithi001.stdout: "segexd": 0, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "expos": 4194304, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "wrpos": 9367419, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "rdpos": 0, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "jlat": { 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1380, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 38.218545316, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.027694598 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "replayed": 0 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_mem": { 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "ino": 770, 2024-08-28T20:33:54.694 INFO:teuthology.orchestra.run.smithi001.stdout: "ino+": 1219, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "ino-": 449, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "dir": 66, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "dir+": 104, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "dir-": 38, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "dn": 952, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "dn+": 1686, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "dn-": 734, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "cap": 689, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "cap+": 1140, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "cap-": 451, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "rss": 125920, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "heap": 334245888 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.695 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_server": { 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_client_request": 3363, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_server_request": 13, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_request": 2270, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_session": 480, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_peer_request": 80, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "req_create_latency": { 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 107, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.163319721, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001526352 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getattr_latency": { 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 6, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.006840841, 2024-08-28T20:33:54.696 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001140140 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getfilelock_latency": { 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "req_link_latency": { 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 229, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.557524513, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.002434604 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookup_latency": { 2024-08-28T20:33:54.697 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1168, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 1.181296845, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001011384 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookuphash_latency": { 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupino_latency": { 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000123799, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000123799 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupname_latency": { 2024-08-28T20:33:54.698 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupparent_latency": { 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupsnap_latency": { 2024-08-28T20:33:54.699 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.700 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.700 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.700 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lssnap_latency": { 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mkdir_latency": { 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mknod_latency": { 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.701 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mksnap_latency": { 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "req_open_latency": { 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 163, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.215502843, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001322103 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "req_readdir_latency": { 2024-08-28T20:33:54.702 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 41, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.055551471, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001354913 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rename_latency": { 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 244, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 2.204573080, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.009035135 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "req_renamesnap_latency": { 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.703 INFO:teuthology.orchestra.run.smithi001.stdout: "req_snapdiff_latency": { 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmdir_latency": { 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmsnap_latency": { 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.704 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmxattr_latency": { 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setattr_latency": { 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.003946599, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.003946599 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.705 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setdirlayout_latency": { 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setfilelock_latency": { 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setlayout_latency": { 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setxattr_latency": { 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "req_symlink_latency": { 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "req_unlink_latency": { 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 250, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.569323943, 2024-08-28T20:33:54.707 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.002277295 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_revoke_eviction": 0, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_acquisition_throttle": 0, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getvxattr_latency": { 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sessions": { 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "session_count": 1, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "session_add": 2, 2024-08-28T20:33:54.708 INFO:teuthology.orchestra.run.smithi001.stdout: "session_remove": 1, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_open": 1, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_stale": 0, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "total_load": 461, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "average_load": 461, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "avg_session_uptime": 947, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "mdthresh_evicted": 0 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:33:54.709 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-08-28T20:33:54.710 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-08-28T20:33:54.711 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 416689, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 903, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 968, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 11, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-08-28T20:33:54.712 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 7600, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 157, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 2960321, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 41048, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-08-28T20:33:54.713 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter": { 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_active": 0, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_laggy": 0, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send": 1778, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send_bytes": 5253103, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_resend": 28, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_reply": 1778, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_latency": { 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1778, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 57.021331985, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.032070490 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.714 INFO:teuthology.orchestra.run.smithi001.stdout: "op_inflight": 0, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "oplen_avg": { 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1778, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 2041 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "op": 1778, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "op_r": 27, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "op_w": 1751, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "op_rmw": 0, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "op_pg": 0, 2024-08-28T20:33:54.715 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_stat": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_create": 10, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_read": 11, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_write": 1391, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writefull": 75, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writesame": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_append": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_zero": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_truncate": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_delete": 42, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_mapext": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_sparse_read": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_clonerange": 0, 2024-08-28T20:33:54.716 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_getxattr": 0, 2024-08-28T20:33:54.717 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_setxattr": 20, 2024-08-28T20:33:54.717 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_cmpxattr": 0, 2024-08-28T20:33:54.717 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_rmxattr": 0, 2024-08-28T20:33:54.717 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_resetxattrs": 0, 2024-08-28T20:33:54.717 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_call": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_watch": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_notify": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls_filter": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_other": 1, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_active": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_send": 0, 2024-08-28T20:33:54.721 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_resend": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_ping": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_active": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_send": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_resend": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_active": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_send": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_resend": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_active": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_send": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_resend": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "command_active": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "command_send": 0, 2024-08-28T20:33:54.722 INFO:teuthology.orchestra.run.smithi001.stdout: "command_resend": 0, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "map_epoch": 76, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "map_full": 0, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "map_inc": 2, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_sessions": 12, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_open": 12, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_close": 0, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_laggy": 0, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_wr": 359, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_rd": 20, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_del": 112 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "oft": { 2024-08-28T20:33:54.723 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_objs": 1, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_kv_pairs": 0, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_updates": 0, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_removes": 0 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "purge_queue": { 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops": 0, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops_high_water": 8, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing": 0, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_high_water": 8, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed_ops": 29, 2024-08-28T20:33:54.724 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed": 29, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_item_in_journal": 0 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 9932, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 3770797, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 9932, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 9932, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 3770797, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_bytes": { 2024-08-28T20:33:54.726 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 1778, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 5255661, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1778, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 5255661, 2024-08-28T20:33:54.727 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_ops": { 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 1024, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-08-28T20:33:54.728 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 1778, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 1778, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1778, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 1778, 2024-08-28T20:33:54.729 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle": { 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 29, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 2929, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 29, 2024-08-28T20:33:54.730 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 11, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 2929, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle-0x5562ce4665b0": { 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 2645, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-08-28T20:33:54.731 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 2349, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 5173115, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 2349, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 1380, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 5170470, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:54.732 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:54.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:54.733 INFO:teuthology.orchestra.run.smithi001.stdout: "trackedop": { 2024-08-28T20:33:54.733 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_ops_count": 0 2024-08-28T20:33:54.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:54.733 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:33:55.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:55 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:33:55.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:55 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:33:55.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:55 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:33:55.612 INFO:tasks.check_counter:Daemon mds.g mds.exported=29 2024-08-28T20:33:55.613 INFO:tasks.check_counter:Daemon mds.g mds.imported=36 2024-08-28T20:33:55.613 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=58 2024-08-28T20:33:55.613 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=103 2024-08-28T20:33:55.613 DEBUG:tasks.check_counter:Getting stats from j 2024-08-28T20:33:55.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-28T20:33:55.991 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:33:56.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:56 smithi001 ceph-mon[20984]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.4 MiB/s wr, 255 op/s 2024-08-28T20:33:56.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:56 smithi121 ceph-mon[25248]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.4 MiB/s wr, 255 op/s 2024-08-28T20:33:56.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:56 smithi007 ceph-mon[25357]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.4 MiB/s wr, 255 op/s 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-08-28T20:33:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003390647, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000799651, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 6, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 231, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3312, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 200976, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-08-28T20:33:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.038783484, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.030975824, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.005139331, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 230, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.051313937, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000223104 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 200976 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 302, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 299, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 546384, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 184720, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.069586617, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.029163527, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.045374737, 2024-08-28T20:33:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 298, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.056751533, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000190441 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 546384, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 184720 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:33:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:33:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:33:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148704, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 29, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:33:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-08-28T20:33:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 304, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 503715, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 304, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 304, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 503715, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-08-28T20:33:56.750 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-08-28T20:33:57.529 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-28T20:33:57.530 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-28T20:33:57.530 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-28T20:33:57.530 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-28T20:33:57.530 DEBUG:tasks.check_counter:Getting stats from b 2024-08-28T20:33:57.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-28T20:33:57.797 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:33:58.212 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:33:58 smithi007 ceph-mon[25357]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-08-28T20:33:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-28T20:33:58.337 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:33:58.337 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4087, 2024-08-28T20:33:58.337 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 5012, 2024-08-28T20:33:58.337 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1258550, 2024-08-28T20:33:58.337 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 12148579, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 148, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 7, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.449951680, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.189889699, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.198693821, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.059633337, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 5011, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.852435210, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000170112 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.338 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 4405, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.001034558, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000234 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 5984, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 7662, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 2519865, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 5647662, 2024-08-28T20:33:58.339 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 11, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 6, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.537930033, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.250629919, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.253067737, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.080132075, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 7661, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 1.888481345, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000246505 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 5362, 2024-08-28T20:33:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.001646966, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000307 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 759312, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 219360 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 3746, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4380, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1712785, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 3683554, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 11, 2024-08-28T20:33:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 6, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.319037088, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.152519890, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.161885734, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.034743891, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 4378, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 1.198407573, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000273734 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:33:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 5179, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.001197909, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000231 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 580000 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-08-28T20:33:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3510, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 1.627124136, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000463568 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 140, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.008717663, 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000062269 2024-08-28T20:33:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 2027, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 1784, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1784, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 6.001385496, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.003364005 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 243, 2024-08-28T20:33:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 773, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 3, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 300, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 8, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 279, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 13, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 289, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 1404, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 69, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 69, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 8, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 2417, 2024-08-28T20:33:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 1740, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 226, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 8, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 3, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 691, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 43, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 1407, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 28, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 706, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-08-28T20:33:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 1029, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 1724923309, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 15, 2024-08-28T20:33:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 139, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 1198, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 1192, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 924, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 21, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 172 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 80, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 46, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 25, 2024-08-28T20:33:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 46, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 182, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 31, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 30, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 1, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-08-28T20:33:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 43, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 3, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_succeeded": 0, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_write_failed": 0 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-08-28T20:33:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 3257, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 3251, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 3251, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 6, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 2, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 74, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 73, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 73, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 1, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 1, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-08-28T20:33:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 1, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 13700327, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 13785675, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 0, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1395, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 44.242356592, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.031714950 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 0 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 103, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 1465, 2024-08-28T20:33:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 1362, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 49, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 105, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 56, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 300, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 1980, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 1680, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 69, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 1171, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 1102, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 134632, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 363671552 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 2170, 2024-08-28T20:33:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 66, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 2027, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 192, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 136, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 980, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 4.877919741, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.004977469 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 46, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.111612239, 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.002426353 2024-08-28T20:33:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000916551, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000916551 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 249, 2024-08-28T20:33:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.169497062, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000680711 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-08-28T20:33:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-08-28T20:33:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-08-28T20:33:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 37, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.469278634, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.012683206 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 376, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.074901014, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000199204 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 47, 2024-08-28T20:33:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.097340480, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.002071074 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 16, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.093852884, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.005865805 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.014040323, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.007020161 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000960151, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000960151 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-08-28T20:33:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 7, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.021742336, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.003106048 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 22, 2024-08-28T20:33:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.069324081, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.003151094 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-08-28T20:33:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 2, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 1, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 1, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 2, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 2, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 950, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 240, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 240, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:33:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-08-28T20:33:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-08-28T20:33:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 309579, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 205, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 88, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 1, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-08-28T20:33:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 7600, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 157, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 557855, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 16932, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-08-28T20:33:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 4233, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 11981409, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 37, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 4233, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 4233, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 151.701556122, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.035837835 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 4233, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 7802 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 4233, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 15, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 4218, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 704, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 1048, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 15, 2024-08-28T20:33:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 1410, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 244, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 3, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 560, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 2096, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-08-28T20:33:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-08-28T20:33:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-08-28T20:33:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 76, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 2, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 12, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 12, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 1664, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 0, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 58 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-08-28T20:33:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 1, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 17, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 10, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 44, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 30, 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-08-28T20:33:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 13813, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 4291450, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 13813, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:33:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 13813, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 4291450, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-08-28T20:33:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 4233, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 11984439, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 4233, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 11984439, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-08-28T20:33:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 4233, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 4233, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 4233, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 4233, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 30, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 3030, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 30, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:33:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 15, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 3030, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x55c6db4f2680": { 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-08-28T20:33:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 3257, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 9591371, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 3257, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 1395, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 9591371, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:33:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:33:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: "trackedop": { 2024-08-28T20:33:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-08-28T20:33:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:33:58.387 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-28T20:33:58.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:33:58 smithi001 ceph-mon[20984]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-08-28T20:33:58.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:33:58 smithi121 ceph-mon[25248]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 1.4 MiB/s wr, 78 op/s 2024-08-28T20:33:59.308 INFO:tasks.check_counter:Daemon mds.b mds.exported=43 2024-08-28T20:33:59.308 INFO:tasks.check_counter:Daemon mds.b mds.imported=28 2024-08-28T20:33:59.308 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=80 2024-08-28T20:33:59.308 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=46 2024-08-28T20:33:59.308 DEBUG:tasks.check_counter:Getting stats from e 2024-08-28T20:33:59.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-28T20:33:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:34:00.005 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-28T20:34:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-08-28T20:34:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-08-28T20:34:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-08-28T20:34:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001473858, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000280068, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 2, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 228, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 320, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 200352, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.016569605, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.013195908, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001247604, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 226, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.014190111, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000062788 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 200352 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 305, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 300, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 549104, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 184528, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.045133326, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.022348527, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.028369929, 2024-08-28T20:34:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 300, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.023907292, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000079690 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 549104, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 184528 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148744, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 303, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 503585, 2024-08-28T20:34:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 303, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 303, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 503585, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:00.016 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-28T20:34:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:00 smithi007 ceph-mon[25357]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 78 KiB/s wr, 24 op/s 2024-08-28T20:34:00.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:00 smithi007 ceph-mon[25357]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:34:00.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:00 smithi001 ceph-mon[20984]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 78 KiB/s wr, 24 op/s 2024-08-28T20:34:00.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:00 smithi001 ceph-mon[20984]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:34:00.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:00 smithi121 ceph-mon[25248]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 78 KiB/s wr, 24 op/s 2024-08-28T20:34:00.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:00 smithi121 ceph-mon[25248]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-08-28T20:34:00.889 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-08-28T20:34:00.889 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-08-28T20:34:00.889 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-08-28T20:34:00.889 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-08-28T20:34:00.890 DEBUG:tasks.check_counter:Getting stats from h 2024-08-28T20:34:00.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-28T20:34:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:34:01.654 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-28T20:34:01.654 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:01.654 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1225, 2024-08-28T20:34:01.654 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 1224, 2024-08-28T20:34:01.654 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 4595455, 2024-08-28T20:34:01.654 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 388418, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.149336709, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.065940361, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.035131205, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.037489651, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1223, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.073682488, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000060247 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:01.655 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1536, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 1760, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1595690, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 969910, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-08-28T20:34:01.656 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 4, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.146146821, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.056269438, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.030474179, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.049428836, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1758, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.067983258, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000038670 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 482032 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1045, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 1013, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 5061301, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 410071, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-08-28T20:34:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.108046713, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.045974733, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.047281825, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.018149620, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1012, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.035858479, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000035433 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 685952, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 184608 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 5818, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.167120531, 2024-08-28T20:34:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000028724 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-08-28T20:34:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 315, 2024-08-28T20:34:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 26, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 289, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 278, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 4, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-08-28T20:34:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 1029, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 1724923309, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-08-28T20:34:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T20:34:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-08-28T20:34:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-08-28T20:34:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_succeeded": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_write_failed": 0 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 3258, 2024-08-28T20:34:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 2, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 71, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 13700327, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 13791796, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 13785675, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 3258 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 84, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 1504, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 1420, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 16, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 76, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 60, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 315, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 1757, 2024-08-28T20:34:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 1442, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 121392, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 321073152 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-08-28T20:34:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-08-28T20:34:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-08-28T20:34:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-08-28T20:34:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 2, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 1, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 1, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 2327, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 191979, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 120, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 7600, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 157, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 440308, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 15064, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 3463, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 26, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 4, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 3463, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3463, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 23.163642430, 2024-08-28T20:34:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.006688894 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3463, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 3464 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 3463, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 3463, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 2099, 2024-08-28T20:34:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 1361, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 2, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-08-28T20:34:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-08-28T20:34:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 76, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-08-28T20:34:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 1, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 5, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 5, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-08-28T20:34:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 3802, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 10890118, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 3802, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 3802, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 10890118, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 3463, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 9597502, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 3463, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 9597502, 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 3463, 2024-08-28T20:34:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 3463, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 3463, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 3463, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-08-28T20:34:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x55a44e5ca8f0": { 2024-08-28T20:34:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "trackedop": { 2024-08-28T20:34:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-08-28T20:34:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:01.702 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-28T20:34:02.366 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-28T20:34:02.366 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-28T20:34:02.366 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-28T20:34:02.366 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-08-28T20:34:02.366 DEBUG:tasks.check_counter:Getting stats from k 2024-08-28T20:34:02.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-28T20:34:02.389 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:02 smithi007 ceph-mon[25357]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-08-28T20:34:02.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:02 smithi001 ceph-mon[20984]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-08-28T20:34:02.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:02 smithi121 ceph-mon[25248]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-08-28T20:34:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T20:34:03.239 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-08-28T20:34:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-08-28T20:34:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-08-28T20:34:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 2992, 2024-08-28T20:34:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.003017388, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000040603, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002220480, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.003933862, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.001311287 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 2, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 231, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 320, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 200880, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.017220717, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.012859377, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002210940, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 229, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011108631, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000048509 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 200880 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 306, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 303, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 547536, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 186800, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.044578075, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.021133965, 2024-08-28T20:34:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.030607723, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 302, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.023930695, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000079240 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 547536, 2024-08-28T20:34:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 186800 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148704, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 29, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 308, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 504299, 2024-08-28T20:34:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 308, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 308, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 504299, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-08-28T20:34:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-08-28T20:34:03.251 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-08-28T20:34:04.024 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-28T20:34:04.024 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-28T20:34:04.024 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-08-28T20:34:04.024 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-08-28T20:34:04.024 DEBUG:tasks.check_counter:Getting stats from c 2024-08-28T20:34:04.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-28T20:34:04.285 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:34:04.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:04 smithi007 ceph-mon[25357]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 42 KiB/s wr, 11 op/s 2024-08-28T20:34:04.405 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:04 smithi121 ceph-mon[25248]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 42 KiB/s wr, 11 op/s 2024-08-28T20:34:04.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:04 smithi001 ceph-mon[20984]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 42 KiB/s wr, 11 op/s 2024-08-28T20:34:04.757 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1392, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1360, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1040880, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 520896, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.176490981, 2024-08-28T20:34:04.758 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.076305848, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.059201679, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.038018554, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1359, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.091799098, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000067549 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.759 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 686064, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 185088 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 4, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 230, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 876, 2024-08-28T20:34:04.760 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 574666, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.015713690, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.012091333, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.001720677, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000052460, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 228, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.012349467, 2024-08-28T20:34:04.762 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000054164 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T20:34:04.763 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 573968 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 2305, 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2305, 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 5768925, 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 732173, 2024-08-28T20:34:04.764 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.202503610, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.072063224, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.047297325, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.073454457, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2304, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.095444552, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000041425 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.765 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-08-28T20:34:04.766 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 5687, 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.148429008, 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000026099 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-28T20:34:04.767 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 0, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 0, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.768 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 886, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 436, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 450, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 263, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 0, 2024-08-28T20:34:04.769 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 12, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 0, 2024-08-28T20:34:04.770 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-08-28T20:34:04.771 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 0, 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 0 2024-08-28T20:34:04.772 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-08-28T20:34:04.773 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-08-28T20:34:04.774 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0, 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_started": 0, 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_succeeded": 0, 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_write_failed": 0 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 0, 2024-08-28T20:34:04.775 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 2353, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 4, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-08-28T20:34:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 9372718, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 9370658, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 2353 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 645, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 1189, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 544, 2024-08-28T20:34:04.777 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 58, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 96, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 38, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 886, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 1644, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 758, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 0, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 0, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 122924, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 320610304 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-08-28T20:34:04.778 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.779 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-08-28T20:34:04.780 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.782 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.782 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-08-28T20:34:04.782 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.782 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.782 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.782 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-08-28T20:34:04.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.788 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.789 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.790 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.791 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.792 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.793 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 1, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 2, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 1, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 0, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 0, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 2276, 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-08-28T20:34:04.794 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:04.795 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:04.796 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:04.797 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 205636, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 685, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:04.798 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7600, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 157, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 2139826, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 16464, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.799 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 3359, 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 21, 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 3, 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 3359, 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-08-28T20:34:04.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3359, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 23.325677521, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.006944232 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3359, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3360 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 3359, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 3359, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 0, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-08-28T20:34:04.801 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 2021, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 0, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 1336, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 0, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 0, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-08-28T20:34:04.802 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 1, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 0, 2024-08-28T20:34:04.803 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-08-28T20:34:04.804 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-08-28T20:34:04.805 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 76, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 1, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 4, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 5, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 1, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-08-28T20:34:04.806 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 0, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 2, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 0 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 0, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-08-28T20:34:04.807 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 3697, 2024-08-28T20:34:04.808 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 6457754, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 3697, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 3697, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 6457754, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-08-28T20:34:04.809 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 3359, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 5182127, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 3359, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 5182127, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.810 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 3359, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 3359, 2024-08-28T20:34:04.811 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 3359, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 3359, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:04.812 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.813 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55c3201c4c30": { 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:04.814 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "trackedop": { 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:04.815 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-28T20:34:05.515 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-08-28T20:34:05.515 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-08-28T20:34:05.515 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-08-28T20:34:05.515 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-08-28T20:34:05.515 DEBUG:tasks.check_counter:Getting stats from f 2024-08-28T20:34:05.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-28T20:34:05.771 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:34:06.265 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1287, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1286, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3557266, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 408187, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 7, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.122745184, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.050278821, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.031375465, 2024-08-28T20:34:06.266 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.031479245, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1285, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.050359750, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000039190 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.267 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 5, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 231, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1856, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 576418, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 8, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.016220430, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.011648742, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.002643986, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000069387, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 229, 2024-08-28T20:34:06.268 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.016866330, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000073652 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 575776 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 2357, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2325, 2024-08-28T20:34:06.269 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1278206, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 828088, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.270994503, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.105447103, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.080552197, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.073906400, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2324, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.112916717, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000048587 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:06.270 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 686336, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 185728 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-28T20:34:06.271 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 5591, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.162857624, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000029128 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.272 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-08-28T20:34:06.273 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 532, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 532, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 531, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 10, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 0, 2024-08-28T20:34:06.274 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-08-28T20:34:06.275 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T20:34:06.276 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 0 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-08-28T20:34:06.277 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-08-28T20:34:06.278 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-08-28T20:34:06.279 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_started": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_succeeded": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_write_failed": 0 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-08-28T20:34:06.280 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 2082, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 0, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 4, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-08-28T20:34:06.281 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 7415793, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 7409039, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 2082 2024-08-28T20:34:06.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 319, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 531, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 212, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 19, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 20, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 1, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 532, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 539, 2024-08-28T20:34:06.283 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 7, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 0, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 0, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 122448, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 318513152 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 0, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 0, 2024-08-28T20:34:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 0, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 0, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 0, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.285 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.288 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.289 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-08-28T20:34:06.289 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.289 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.289 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-08-28T20:34:06.290 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.291 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.291 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.291 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.292 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.293 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.294 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.295 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.297 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-08-28T20:34:06.298 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.299 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 1, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 2, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 1, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 0, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 0, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 2279, 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-08-28T20:34:06.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:06.301 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:06.302 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 209734, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 367, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:34:06.303 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7600, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 157, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 1114826, 2024-08-28T20:34:06.304 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 9714, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 3304, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 21, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 3, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 3304, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3304, 2024-08-28T20:34:06.305 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 25.176651105, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007620051 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3304, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3305 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 3304, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 3304, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 0, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 2020, 2024-08-28T20:34:06.306 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 1282, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 1, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 0, 2024-08-28T20:34:06.307 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-08-28T20:34:06.308 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-08-28T20:34:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-08-28T20:34:06.310 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 76, 2024-08-28T20:34:06.311 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-08-28T20:34:06.311 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 1, 2024-08-28T20:34:06.311 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 6, 2024-08-28T20:34:06.311 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 9, 2024-08-28T20:34:06.311 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 3, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 0, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 2, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 0 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 0, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-08-28T20:34:06.312 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 0, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 0, 2024-08-28T20:34:06.313 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 0, 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:06.314 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 3645, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 4489029, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 3645, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 3645, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 4489029, 2024-08-28T20:34:06.315 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:06.316 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 3304, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 3221494, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 3304, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 3221494, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 3304, 2024-08-28T20:34:06.318 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 3304, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 3304, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 3304, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:06.319 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-28T20:34:06.320 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x558fc6de8820": { 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:06.321 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:06.323 INFO:teuthology.orchestra.run.smithi121.stdout: "trackedop": { 2024-08-28T20:34:06.323 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-08-28T20:34:06.323 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:06.323 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-28T20:34:06.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:06 smithi001 ceph-mon[20984]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-08-28T20:34:06.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:06 smithi121 ceph-mon[25248]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-08-28T20:34:06.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:06 smithi007 ceph-mon[25357]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-08-28T20:34:07.068 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-28T20:34:07.068 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-28T20:34:07.068 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-08-28T20:34:07.068 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-08-28T20:34:07.068 DEBUG:tasks.check_counter:Getting stats from i 2024-08-28T20:34:07.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-28T20:34:07.313 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 3295, 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2368, 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1311657, 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 3960690, 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 9, 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-08-28T20:34:07.840 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.237519575, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.103855618, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.128426218, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.023733192, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2369, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.119642154, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000050503 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4334, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000810443, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000186 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.841 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1532, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1180, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1221676, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 602803, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 9, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.129421520, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.057381913, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.084797517, 2024-08-28T20:34:07.842 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.006861286, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1181, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.065994413, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000055880 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1522, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000256393, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000168 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 698560, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 190080 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.843 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 2340, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 3697, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 746727, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 2458640, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 13, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 11, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.213306746, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.112071056, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.109745294, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.009245800, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3691, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.166448347, 2024-08-28T20:34:07.844 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000045095 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2256, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000966632, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000428 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 486944 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-28T20:34:07.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 931, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.447043373, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000480175 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 700, 2024-08-28T20:34:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.027725602, 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000039608 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 1151, 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 1108, 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1108, 2024-08-28T20:34:07.847 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3.732761348, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.003368918 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 43, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 11, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 422, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 4, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 406, 2024-08-28T20:34:07.848 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 12, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 417, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 28, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 370, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 370, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 13, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 2147, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 1906, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 42, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 26, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 75, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 1823, 2024-08-28T20:34:07.849 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 2, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 12, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 16, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 395, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 1030, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 1689795876, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T20:34:07.850 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 36, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 694, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 699, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 420, 2024-08-28T20:34:07.851 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 124, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 886 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 21, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 210, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 115, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 166, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 23, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 217, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 217, 2024-08-28T20:34:07.852 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 2, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-08-28T20:34:07.853 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_started": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_succeeded": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_write_failed": 0 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 2083, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 2083, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 4, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-08-28T20:34:07.854 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 4, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 7415854, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 380, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 6.480962778, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.017055165 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.855 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 398, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 631, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 233, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 52, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 123, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 71, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 417, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 673, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 256, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 372, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 862, 2024-08-28T20:34:07.856 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 490, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 127400, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 332156928 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 1318, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 8, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 1151, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 17, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 35, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 215, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.206002699, 2024-08-28T20:34:07.857 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000958152 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000188010, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000188010 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.858 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 501, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3.073367328, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.006134465 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-08-28T20:34:07.859 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000154602, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000154602 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.860 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.861 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-08-28T20:34:07.861 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.861 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.861 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.861 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.861 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 165, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.066362903, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000402199 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-08-28T20:34:07.863 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 8, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.007210526, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000901315 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 210, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.369460069, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001759333 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-08-28T20:34:07.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 7, 2024-08-28T20:34:07.868 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.010015211, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001430744 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 1, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 2, 2024-08-28T20:34:07.869 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 1, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 112, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 112, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 960, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:07.870 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-28T20:34:07.872 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 357486, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 462, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 792, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 9, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:07.873 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7600, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 157, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 1210642, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 12902, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-08-28T20:34:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 1048, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 3321700, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 28, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 1048, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1048, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 12.991817935, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.012396772 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1048, 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1182 2024-08-28T20:34:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 1048, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 85, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 963, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 0, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 10, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 85, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 465, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 136, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-08-28T20:34:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 229, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 20, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T20:34:07.877 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-08-28T20:34:07.878 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 76, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 2, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 12, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 12, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 175, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 0, 2024-08-28T20:34:07.879 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 62 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 10, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 10, 2024-08-28T20:34:07.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 217, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 217, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 7163, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 2646835, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 7163, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 7163, 2024-08-28T20:34:07.881 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 2646835, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:07.882 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 1048, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 3343617, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1048, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 3343617, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-08-28T20:34:07.883 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 1048, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 1048, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1048, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 1048, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.884 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 217, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 21917, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 217, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 85, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 21917, 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:07.885 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x56309dbe4680": { 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 61, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2083, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 3221550, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2083, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:07.886 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 380, 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 3221489, 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "trackedop": { 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:07.887 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-28T20:34:08.474 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:08 smithi121 ceph-mon[25248]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-08-28T20:34:08.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:08 smithi001 ceph-mon[20984]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-08-28T20:34:08.502 INFO:tasks.check_counter:Daemon mds.i mds.exported=2 2024-08-28T20:34:08.502 INFO:tasks.check_counter:Daemon mds.i mds.imported=16 2024-08-28T20:34:08.502 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=21 2024-08-28T20:34:08.502 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=210 2024-08-28T20:34:08.502 DEBUG:tasks.check_counter:Getting stats from l 2024-08-28T20:34:08.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-28T20:34:08.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:08 smithi007 ceph-mon[25357]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-08-28T20:34:08.748 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T20:34:09.281 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-28T20:34:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T20:34:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 0, 2024-08-28T20:34:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2, 2024-08-28T20:34:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 0, 2024-08-28T20:34:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 0, 2024-08-28T20:34:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.001103849, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000000000, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.000233036, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:09.283 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:09.284 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:09.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.284 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:09.284 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:09.284 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:09.285 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:09.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.285 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T20:34:09.285 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T20:34:09.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.285 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 6, 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 235, 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3312, 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 201680, 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-08-28T20:34:09.286 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.018272791, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.013039157, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.003026921, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 234, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.017835806, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000076221 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:09.287 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 201680 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 308, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 305, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 548080, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 188080, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.044830426, 2024-08-28T20:34:09.288 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.022058119, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.029324292, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 304, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014055301, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000046234 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.289 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 548080, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 188080 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-28T20:34:09.290 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T20:34:09.291 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T20:34:09.292 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 148704, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 29, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-08-28T20:34:09.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 928, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-28T20:34:09.294 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 310, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 504559, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 310, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 310, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 504559, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-28T20:34:09.295 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:09.296 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-28T20:34:09.296 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-28T20:34:09.935 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-28T20:34:09.935 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-28T20:34:09.935 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-08-28T20:34:09.935 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-08-28T20:34:09.935 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-28T20:34:10.000 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-28T20:34:10.000 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:34:10.000 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T20:34:10.044 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-08-28T20:34:10.044 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T20:34:10.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-28T20:34:10.229 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:10 smithi121 ceph-mon[25248]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-08-28T20:34:10.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:10 smithi001 ceph-mon[20984]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-08-28T20:34:10.548 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:10.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:10 smithi007 ceph-mon[25357]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 -- 172.21.15.1:0/1235488123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d41141d0 msgr2=0x7f41d41166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 --2- 172.21.15.1:0/1235488123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d41141d0 0x7f41d41166a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009ca0 tx=0x7f41cc02a8b0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 -- 172.21.15.1:0/1235488123 shutdown_connections 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 --2- 172.21.15.1:0/1235488123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d41141d0 0x7f41d41166a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 --2- 172.21.15.1:0/1235488123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41d4075b70 0x7f41d4075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 --2- 172.21.15.1:0/1235488123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d4077120 0x7f41d4075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 -- 172.21.15.1:0/1235488123 >> 172.21.15.1:0/1235488123 conn(0x7f41d407b5f0 msgr2=0x7f41d407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:11.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 -- 172.21.15.1:0/1235488123 shutdown_connections 2024-08-28T20:34:11.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.224+0000 7f41dc400640 1 -- 172.21.15.1:0/1235488123 wait complete. 2024-08-28T20:34:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.225+0000 7f41dc400640 1 Processor -- start 2024-08-28T20:34:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.225+0000 7f41dc400640 1 -- start start 2024-08-28T20:34:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.225+0000 7f41dc400640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 0x7f41d41a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41dc400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41d4077120 0x7f41d41a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41dc400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d41141d0 0x7f41d41a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41dc400640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4119e60 con 0x7f41d4075b70 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41dc400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4119ce0 con 0x7f41d41141d0 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41dc400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4119fe0 con 0x7f41d4077120 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 0x7f41d41a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 0x7f41d41a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45934/0 (socket says 172.21.15.1:45934) 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 -- 172.21.15.1:0/4157299215 learned_addr learned my addr 172.21.15.1:0/4157299215 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41da400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d41141d0 0x7f41d41a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9000640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41d4077120 0x7f41d41a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 -- 172.21.15.1:0/4157299215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41d4077120 msgr2=0x7f41d41a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41d4077120 0x7f41d41a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 -- 172.21.15.1:0/4157299215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d41141d0 msgr2=0x7f41d41a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d41141d0 0x7f41d41a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.226+0000 7f41d9a00640 1 -- 172.21.15.1:0/4157299215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d41a6740 con 0x7f41d4075b70 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.227+0000 7f41d9a00640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 0x7f41d41a07d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f41c800ea60 tx=0x7f41c800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.227+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c800cde0 con 0x7f41d4075b70 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.227+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d41a6a30 con 0x7f41d4075b70 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.227+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c80035f0 con 0x7f41d4075b70 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.227+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41ad190 con 0x7f41d4075b70 2024-08-28T20:34:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.227+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8005220 con 0x7f41d4075b70 2024-08-28T20:34:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.228+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d4075f80 con 0x7f41d4075b70 2024-08-28T20:34:11.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.232+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f41c80037a0 con 0x7f41d4075b70 2024-08-28T20:34:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.234+0000 7f41d2000640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f41bc0b4b30 0x7f41bc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.234+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f41c80e57e0 con 0x7f41d4075b70 2024-08-28T20:34:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.234+0000 7f41d9000640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f41bc0b4b30 0x7f41bc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.235+0000 7f41d9000640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f41bc0b4b30 0x7f41bc0b7040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f41d41169f0 tx=0x7f41c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:11.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.236+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f41c80ac8a0 con 0x7f41d4075b70 2024-08-28T20:34:11.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.443+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41d41a1900 con 0x7f41d4075b70 2024-08-28T20:34:11.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.444+0000 7f41d2000640 1 -- 172.21.15.1:0/4157299215 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v76) ==== 81+0+582 (secure 0 0 0) 0x7f41c80ac1a0 con 0x7f41d4075b70 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2589583493 2024-08-29T20:08:08.057916+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/1152565265 2024-08-29T20:08:08.057916+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2571286405 2024-08-29T20:07:38.468473+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2902108707 2024-08-29T20:08:08.057916+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/1152565265 2024-08-29T20:08:08.057916+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2047796715 2024-08-29T20:07:38.468473+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1825727919 2024-08-29T20:07:38.468473+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/2106947194 2024-08-29T20:07:38.468473+0000 2024-08-28T20:34:11.447 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1421728777 2024-08-29T20:08:08.057916+0000 2024-08-28T20:34:11.448 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/2106947194 2024-08-29T20:07:38.468473+0000 2024-08-28T20:34:11.448 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-08-28T20:34:11.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.446+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f41bc0b4b30 msgr2=0x7f41bc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:11.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.446+0000 7f41dc400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f41bc0b4b30 0x7f41bc0b7040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f41d41169f0 tx=0x7f41c0005f90 comp rx=0 tx=0).stop 2024-08-28T20:34:11.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 msgr2=0x7f41d41a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:11.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 0x7f41d41a07d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f41c800ea60 tx=0x7f41c800ef20 comp rx=0 tx=0).stop 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 shutdown_connections 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f41bc0b4b30 0x7f41bc0b7040 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41d41141d0 0x7f41d41a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41d4077120 0x7f41d41a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 --2- 172.21.15.1:0/4157299215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41d4075b70 0x7f41d41a07d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 >> 172.21.15.1:0/4157299215 conn(0x7f41d407b5f0 msgr2=0x7f41d4112aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 shutdown_connections 2024-08-28T20:34:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:11.447+0000 7f41dc400640 1 -- 172.21.15.1:0/4157299215 wait complete. 2024-08-28T20:34:12.188 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-28T20:34:12.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:34:12.189 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /tmp/cephfs 2024-08-28T20:34:12.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:12 smithi001 ceph-mon[20984]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-08-28T20:34:12.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:12 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/4157299215' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T20:34:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:12 smithi121 ceph-mon[25248]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-08-28T20:34:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:12 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/4157299215' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T20:34:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:12 smithi007 ceph-mon[25357]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-08-28T20:34:12.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:12 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/4157299215' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T20:34:12.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:34:12.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:34:12.571 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-08-28T20:34:12.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:34:12.666 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-08-28T20:34:12.744 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-08-28T20:34:12.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:34:12.745 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-08-28T20:34:12.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T20:34:12.869 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-08-28T20:34:13.216 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-28T20:34:13.226 INFO:tasks.cephadm:Teardown begin 2024-08-28T20:34:13.226 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-28T20:34:13.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:34:13.776 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:14.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:14 smithi001 ceph-mon[20984]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 -- 172.21.15.1:0/764811879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498010fe60 msgr2=0x7f49801122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 --2- 172.21.15.1:0/764811879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498010fe60 0x7f49801122a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4978009ca0 tx=0x7f497802a8b0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 -- 172.21.15.1:0/764811879 shutdown_connections 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 --2- 172.21.15.1:0/764811879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f498010fe60 0x7f49801122a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 --2- 172.21.15.1:0/764811879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4980075ea0 0x7f498010f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 --2- 172.21.15.1:0/764811879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4980075550 0x7f4980075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 -- 172.21.15.1:0/764811879 >> 172.21.15.1:0/764811879 conn(0x7f498007b5f0 msgr2=0x7f498007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:14.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 -- 172.21.15.1:0/764811879 shutdown_connections 2024-08-28T20:34:14.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.449+0000 7f4984e00640 1 -- 172.21.15.1:0/764811879 wait complete. 2024-08-28T20:34:14.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.450+0000 7f4984e00640 1 Processor -- start 2024-08-28T20:34:14.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 -- start start 2024-08-28T20:34:14.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 0x7f498019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:14.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4980075ea0 0x7f498019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:14.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f498010fe60 0x7f49801a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:14.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4980115a10 con 0x7f498010fe60 2024-08-28T20:34:14.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4980115890 con 0x7f4980075550 2024-08-28T20:34:14.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f4984e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4980115b90 con 0x7f4980075ea0 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.451+0000 7f497de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 0x7f498019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 0x7f498019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:43618/0 (socket says 172.21.15.1:43618) 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 -- 172.21.15.1:0/3408417046 learned_addr learned my addr 172.21.15.1:0/3408417046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f4977e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4980075ea0 0x7f498019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497e800640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f498010fe60 0x7f49801a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 -- 172.21.15.1:0/3408417046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4980075ea0 msgr2=0x7f498019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4980075ea0 0x7f498019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 -- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f498010fe60 msgr2=0x7f49801a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f498010fe60 0x7f49801a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 -- 172.21.15.1:0/3408417046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49801a22d0 con 0x7f4980075550 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.452+0000 7f497de00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 0x7f498019c360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f497000ea60 tx=0x7f497000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.453+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497000cde0 con 0x7f4980075550 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.453+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49700035f0 con 0x7f4980075550 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.453+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970010690 con 0x7f4980075550 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.453+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49801a25c0 con 0x7f4980075550 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.453+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49801a8d20 con 0x7f4980075550 2024-08-28T20:34:14.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.454+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4980075960 con 0x7f4980075550 2024-08-28T20:34:14.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.456+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f49700037a0 con 0x7f4980075550 2024-08-28T20:34:14.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.458+0000 7f4976a00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49640b4bb0 0x7f49640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:14.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.458+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f49700e57b0 con 0x7f4980075550 2024-08-28T20:34:14.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.458+0000 7f4977e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49640b4bb0 0x7f49640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:14.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.459+0000 7f4977e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49640b4bb0 0x7f49640b70c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f49680095f0 tx=0x7f4968005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:14.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.460+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f49700ac870 con 0x7f4980075550 2024-08-28T20:34:14.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:14 smithi121 ceph-mon[25248]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-08-28T20:34:14.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:14 smithi007 ceph-mon[25357]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-08-28T20:34:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.693+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f498019d490 con 0x7f4980075550 2024-08-28T20:34:14.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.694+0000 7f4976a00640 1 -- 172.21.15.1:0/3408417046 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11885 (secure 0 0 0) 0x7f49700ac170 con 0x7f4980075550 2024-08-28T20:34:14.697 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:34:14.697 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":53,"btime":"2024-08-28T20:33:59:117089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:33:58.677686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:34:14.698 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 53 2024-08-28T20:34:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49640b4bb0 msgr2=0x7f49640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49640b4bb0 0x7f49640b70c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f49680095f0 tx=0x7f4968005f90 comp rx=0 tx=0).stop 2024-08-28T20:34:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 msgr2=0x7f498019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 0x7f498019c360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f497000ea60 tx=0x7f497000ef20 comp rx=0 tx=0).stop 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 shutdown_connections 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f49640b4bb0 0x7f49640b70c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f498010fe60 0x7f49801a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4980075ea0 0x7f498019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 --2- 172.21.15.1:0/3408417046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4980075550 0x7f498019c360 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 >> 172.21.15.1:0/3408417046 conn(0x7f498007b5f0 msgr2=0x7f49801078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 shutdown_connections 2024-08-28T20:34:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:14.697+0000 7f4984e00640 1 -- 172.21.15.1:0/3408417046 wait complete. 2024-08-28T20:34:15.423 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:15 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3408417046' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:34:15.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:15 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3408417046' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:34:15.490 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T20:34:15.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:15 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3408417046' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:34:15.880 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:16.428 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:16 smithi001 ceph-mon[20984]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-08-28T20:34:16.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:16 smithi121 ceph-mon[25248]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 -- 172.21.15.1:0/752905938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c410dbb0 msgr2=0x7fc4c41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/752905938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c410dbb0 0x7fc4c41100a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009ca0 tx=0x7fc4bc02a8c0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 -- 172.21.15.1:0/752905938 shutdown_connections 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/752905938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c410dbb0 0x7fc4c41100a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/752905938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c41050a0 0x7fc4c410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/752905938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c4104750 0x7fc4c4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 -- 172.21.15.1:0/752905938 >> 172.21.15.1:0/752905938 conn(0x7fc4c4079500 msgr2=0x7fc4c4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:16.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 -- 172.21.15.1:0/752905938 shutdown_connections 2024-08-28T20:34:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.496+0000 7fc4cbe00640 1 -- 172.21.15.1:0/752905938 wait complete. 2024-08-28T20:34:16.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.497+0000 7fc4cbe00640 1 Processor -- start 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 -- start start 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c4104750 0x7fc4c419c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c41050a0 0x7fc4c419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c410dbb0 0x7fc4c41a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4113880 con 0x7fc4c41050a0 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4113700 con 0x7fc4c4104750 2024-08-28T20:34:16.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4cbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4113a00 con 0x7fc4c410dbb0 2024-08-28T20:34:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.498+0000 7fc4c8a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c41050a0 0x7fc4c419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c4104750 0x7fc4c419c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:16.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c8a00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c41050a0 0x7fc4c419c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45978/0 (socket says 172.21.15.1:45978) 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c8a00640 1 -- 172.21.15.1:0/2859185030 learned_addr learned my addr 172.21.15.1:0/2859185030 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9e00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c410dbb0 0x7fc4c41a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 -- 172.21.15.1:0/2859185030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c410dbb0 msgr2=0x7fc4c41a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c410dbb0 0x7fc4c41a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 -- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c41050a0 msgr2=0x7fc4c419c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c41050a0 0x7fc4c419c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 -- 172.21.15.1:0/2859185030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c41a23a0 con 0x7fc4c4104750 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.499+0000 7fc4c9400640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c4104750 0x7fc4c419c430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800e9f0 tx=0x7fc4b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.500+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800ccc0 con 0x7fc4c4104750 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.500+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c41a2690 con 0x7fc4c4104750 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.500+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4b8005020 con 0x7fc4c4104750 2024-08-28T20:34:16.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.500+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8004a00 con 0x7fc4c4104750 2024-08-28T20:34:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.500+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c41a8df0 con 0x7fc4c4104750 2024-08-28T20:34:16.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.501+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c406c060 con 0x7fc4c4104750 2024-08-28T20:34:16.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.503+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fc4b8004ba0 con 0x7fc4c4104750 2024-08-28T20:34:16.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.505+0000 7fc4c2000640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc4ac0b4b30 0x7fc4ac0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:16.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.505+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fc4b80e5150 con 0x7fc4c4104750 2024-08-28T20:34:16.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.505+0000 7fc4c8a00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc4ac0b4b30 0x7fc4ac0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:16.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.506+0000 7fc4c8a00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc4ac0b4b30 0x7fc4ac0b7040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc4c410f8e0 tx=0x7fc4b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:16.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.506+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc4b80ac2a0 con 0x7fc4c4104750 2024-08-28T20:34:16.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:16 smithi007 ceph-mon[25357]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-08-28T20:34:16.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.743+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4c4104b60 con 0x7fc4c4104750 2024-08-28T20:34:16.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.744+0000 7fc4c2000640 1 -- 172.21.15.1:0/2859185030 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11885 (secure 0 0 0) 0x7fc4b80abba0 con 0x7fc4c4104750 2024-08-28T20:34:16.747 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:34:16.747 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":53,"btime":"2024-08-28T20:33:59:117089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/3430910515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":3430910515},{"type":"v1","addr":"172.21.15.1:6837","nonce":3430910515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/508380082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":508380082},{"type":"v1","addr":"172.21.15.1:6841","nonce":508380082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2034298209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2034298209},{"type":"v1","addr":"172.21.15.121:6833","nonce":2034298209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/3463409516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3463409516},{"type":"v1","addr":"172.21.15.7:6833","nonce":3463409516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2494570830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2494570830},{"type":"v1","addr":"172.21.15.1:6835","nonce":2494570830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24632,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2627425818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2627425818},{"type":"v1","addr":"172.21.15.7:6835","nonce":2627425818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T20:15:54.165615+0000","modified":"2024-08-28T20:33:58.677686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24701,"mds_1":24673,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24640":{"gid":24640,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/179317583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":179317583},{"type":"v1","addr":"172.21.15.121:6835","nonce":179317583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1661917289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1661917289},{"type":"v1","addr":"172.21.15.121:6837","nonce":1661917289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/3668716781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3668716781},{"type":"v1","addr":"172.21.15.7:6837","nonce":3668716781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.121:6839/1704938195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1704938195},{"type":"v1","addr":"172.21.15.121:6839","nonce":1704938195}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.1:6839/825690381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":825690381},{"type":"v1","addr":"172.21.15.1:6839","nonce":825690381}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24701":{"gid":24701,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.7:6839/1672375051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1672375051},{"type":"v1","addr":"172.21.15.7:6839","nonce":1672375051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24701,"qdb_cluster":[24701,24673,24667]},"id":1}]} 2024-08-28T20:34:16.747 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 53 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.746+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc4ac0b4b30 msgr2=0x7fc4ac0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.746+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc4ac0b4b30 0x7fc4ac0b7040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc4c410f8e0 tx=0x7fc4b0005f90 comp rx=0 tx=0).stop 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.746+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c4104750 msgr2=0x7fc4c419c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.746+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c4104750 0x7fc4c419c430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800e9f0 tx=0x7fc4b800eeb0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.746+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 shutdown_connections 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fc4ac0b4b30 0x7fc4ac0b7040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c41050a0 0x7fc4c419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c410dbb0 0x7fc4c41a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 --2- 172.21.15.1:0/2859185030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4c4104750 0x7fc4c419c430 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:16.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 >> 172.21.15.1:0/2859185030 conn(0x7fc4c4079500 msgr2=0x7fc4c4103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:16.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 shutdown_connections 2024-08-28T20:34:16.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:16.747+0000 7fc4cbe00640 1 -- 172.21.15.1:0/2859185030 wait complete. 2024-08-28T20:34:17.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:17 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2859185030' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:34:17.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:17 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2859185030' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:34:17.537 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T20:34:17.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:17 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2859185030' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T20:34:17.916 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:18.395 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:18 smithi001 ceph-mon[20984]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-08-28T20:34:18.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:18 smithi121 ceph-mon[25248]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-08-28T20:34:18.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:18 smithi007 ceph-mon[25357]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 -- 172.21.15.1:0/390092963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f2010bbe0 msgr2=0x7f5f20112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 --2- 172.21.15.1:0/390092963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f2010bbe0 0x7f5f20112410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009ca0 tx=0x7f5f1802a8c0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 -- 172.21.15.1:0/390092963 shutdown_connections 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 --2- 172.21.15.1:0/390092963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f2010bbe0 0x7f5f20112410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 --2- 172.21.15.1:0/390092963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 0x7f5f2010b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 --2- 172.21.15.1:0/390092963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f20105950 0x7f5f20105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 -- 172.21.15.1:0/390092963 >> 172.21.15.1:0/390092963 conn(0x7f5f20101420 msgr2=0x7f5f20103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:18.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 -- 172.21.15.1:0/390092963 shutdown_connections 2024-08-28T20:34:18.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.571+0000 7f5f1f200640 1 -- 172.21.15.1:0/390092963 wait complete. 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.572+0000 7f5f1f200640 1 Processor -- start 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.572+0000 7f5f1f200640 1 -- start start 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1f200640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f20105950 0x7f5f2019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 0x7f5f2019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f2010bbe0 0x7f5f201a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1f200640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201158a0 con 0x7f5f20105950 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20115720 con 0x7f5f2010b290 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20115a20 con 0x7f5f2010bbe0 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f20105950 0x7f5f2019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f2010bbe0 0x7f5f201a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:18.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 0x7f5f2019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:18.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f2010bbe0 0x7f5f201a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39524/0 (socket says 172.21.15.1:39524) 2024-08-28T20:34:18.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1e800640 1 -- 172.21.15.1:0/3039023662 learned_addr learned my addr 172.21.15.1:0/3039023662 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:18.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.573+0000 7f5f1de00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f20105950 0x7f5f2019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55442/0 (socket says 172.21.15.1:55442) 2024-08-28T20:34:18.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f1d400640 1 -- 172.21.15.1:0/3039023662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f2010bbe0 msgr2=0x7f5f201a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f1d400640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f2010bbe0 0x7f5f201a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f1d400640 1 -- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f20105950 msgr2=0x7f5f2019c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f1d400640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f20105950 0x7f5f2019c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f1d400640 1 -- 172.21.15.1:0/3039023662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f201a22c0 con 0x7f5f2010b290 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f1d400640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 0x7f5f2019c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f2006c660 tx=0x7f5f0c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.574+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00cd00 con 0x7f5f2010b290 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.575+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f201a25b0 con 0x7f5f2010b290 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.575+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f0c0035f0 con 0x7f5f2010b290 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.575+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f201a8d10 con 0x7f5f2010b290 2024-08-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.575+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c018690 con 0x7f5f2010b290 2024-08-28T20:34:18.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.576+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f20105d60 con 0x7f5f2010b290 2024-08-28T20:34:18.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.579+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f5f0c003a30 con 0x7f5f2010b290 2024-08-28T20:34:18.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.580+0000 7f5f16a00640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f040b4bb0 0x7f5f040b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:18.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.581+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7f5f0c0e5380 con 0x7f5f2010b290 2024-08-28T20:34:18.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.581+0000 7f5f1de00640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f040b4bb0 0x7f5f040b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:18.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.581+0000 7f5f1de00640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f040b4bb0 0x7f5f040b70c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009bd0 tx=0x7f5f10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:18.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.582+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f0c0ac4d0 con 0x7f5f2010b290 2024-08-28T20:34:18.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.780+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f2019d480 con 0x7f5f2010b290 2024-08-28T20:34:18.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.782+0000 7f5f16a00640 1 -- 172.21.15.1:0/3039023662 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22603 (secure 0 0 0) 0x7f5f2019d480 con 0x7f5f2010b290 2024-08-28T20:34:18.785 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-08-28T20:34:18.785 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"f9e93946-6578-11ef-bcd4-c7b262605968","created":"2024-08-28T20:07:12.748179+0000","modified":"2024-08-28T20:16:09.246336+0000","last_up_change":"2024-08-28T20:14:56.548418+0000","last_in_change":"2024-08-28T20:14:34.416389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T20:11:04.566315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T20:15:48.139740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T20:15:51.422523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1b3b5c1-9a16-483f-944f-6e8e933cd76a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6803","nonce":62453617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6805","nonce":62453617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6809","nonce":62453617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":62453617},{"type":"v1","addr":"172.21.15.1:6807","nonce":62453617}]},"public_addr":"172.21.15.1:6803/62453617","cluster_addr":"172.21.15.1:6805/62453617","heartbeat_back_addr":"172.21.15.1:6809/62453617","heartbeat_front_addr":"172.21.15.1:6807/62453617","state":["exists","up"]},{"osd":1,"uuid":"e8587b29-15e2-45cc-8929-361b1068c099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6801","nonce":512270550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6803","nonce":512270550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6807","nonce":512270550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":512270550},{"type":"v1","addr":"172.21.15.7:6805","nonce":512270550}]},"public_addr":"172.21.15.7:6801/512270550","cluster_addr":"172.21.15.7:6803/512270550","heartbeat_back_addr":"172.21.15.7:6807/512270550","heartbeat_front_addr":"172.21.15.7:6805/512270550","state":["exists","up"]},{"osd":2,"uuid":"294c27ff-a326-428f-8084-139bf4bf7cad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6801","nonce":1023461840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6803","nonce":1023461840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6807","nonce":1023461840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1023461840},{"type":"v1","addr":"172.21.15.121:6805","nonce":1023461840}]},"public_addr":"172.21.15.121:6801/1023461840","cluster_addr":"172.21.15.121:6803/1023461840","heartbeat_back_addr":"172.21.15.121:6807/1023461840","heartbeat_front_addr":"172.21.15.121:6805/1023461840","state":["exists","up"]},{"osd":3,"uuid":"71bf4c49-dd40-44d9-a2fa-7dbfb2c7066d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6811","nonce":3058293665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6813","nonce":3058293665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6817","nonce":3058293665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3058293665},{"type":"v1","addr":"172.21.15.1:6815","nonce":3058293665}]},"public_addr":"172.21.15.1:6811/3058293665","cluster_addr":"172.21.15.1:6813/3058293665","heartbeat_back_addr":"172.21.15.1:6817/3058293665","heartbeat_front_addr":"172.21.15.1:6815/3058293665","state":["exists","up"]},{"osd":4,"uuid":"dc09afde-7028-48d3-b258-e7a52e67317e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6809","nonce":1548276367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6811","nonce":1548276367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6815","nonce":1548276367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1548276367},{"type":"v1","addr":"172.21.15.7:6813","nonce":1548276367}]},"public_addr":"172.21.15.7:6809/1548276367","cluster_addr":"172.21.15.7:6811/1548276367","heartbeat_back_addr":"172.21.15.7:6815/1548276367","heartbeat_front_addr":"172.21.15.7:6813/1548276367","state":["exists","up"]},{"osd":5,"uuid":"024ef980-246c-45ae-9b35-2ec8c5a58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6809","nonce":506146623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6811","nonce":506146623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6815","nonce":506146623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":506146623},{"type":"v1","addr":"172.21.15.121:6813","nonce":506146623}]},"public_addr":"172.21.15.121:6809/506146623","cluster_addr":"172.21.15.121:6811/506146623","heartbeat_back_addr":"172.21.15.121:6815/506146623","heartbeat_front_addr":"172.21.15.121:6813/506146623","state":["exists","up"]},{"osd":6,"uuid":"38aa1326-0c57-4925-a4c6-706fa7eb6c40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6819","nonce":4096512062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6821","nonce":4096512062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6825","nonce":4096512062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":4096512062},{"type":"v1","addr":"172.21.15.1:6823","nonce":4096512062}]},"public_addr":"172.21.15.1:6819/4096512062","cluster_addr":"172.21.15.1:6821/4096512062","heartbeat_back_addr":"172.21.15.1:6825/4096512062","heartbeat_front_addr":"172.21.15.1:6823/4096512062","state":["exists","up"]},{"osd":7,"uuid":"8cfe4d05-a623-481c-9463-e8571c13f7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6817","nonce":1084781736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6819","nonce":1084781736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6823","nonce":1084781736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1084781736},{"type":"v1","addr":"172.21.15.7:6821","nonce":1084781736}]},"public_addr":"172.21.15.7:6817/1084781736","cluster_addr":"172.21.15.7:6819/1084781736","heartbeat_back_addr":"172.21.15.7:6823/1084781736","heartbeat_front_addr":"172.21.15.7:6821/1084781736","state":["exists","up"]},{"osd":8,"uuid":"817fb875-66b9-428f-abcd-cd62e49c6f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6817","nonce":989579690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6819","nonce":989579690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6823","nonce":989579690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":989579690},{"type":"v1","addr":"172.21.15.121:6821","nonce":989579690}]},"public_addr":"172.21.15.121:6817/989579690","cluster_addr":"172.21.15.121:6819/989579690","heartbeat_back_addr":"172.21.15.121:6823/989579690","heartbeat_front_addr":"172.21.15.121:6821/989579690","state":["exists","up"]},{"osd":9,"uuid":"9a163d6f-2558-4097-a93e-0714aa8ff4b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6827","nonce":3838494531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6829","nonce":3838494531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6833","nonce":3838494531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3838494531},{"type":"v1","addr":"172.21.15.1:6831","nonce":3838494531}]},"public_addr":"172.21.15.1:6827/3838494531","cluster_addr":"172.21.15.1:6829/3838494531","heartbeat_back_addr":"172.21.15.1:6833/3838494531","heartbeat_front_addr":"172.21.15.1:6831/3838494531","state":["exists","up"]},{"osd":10,"uuid":"284360f9-662f-43ab-924b-7820d7e7042f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6825","nonce":407515474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6827","nonce":407515474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6831","nonce":407515474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":407515474},{"type":"v1","addr":"172.21.15.7:6829","nonce":407515474}]},"public_addr":"172.21.15.7:6825/407515474","cluster_addr":"172.21.15.7:6827/407515474","heartbeat_back_addr":"172.21.15.7:6831/407515474","heartbeat_front_addr":"172.21.15.7:6829/407515474","state":["exists","up"]},{"osd":11,"uuid":"e7656a4e-5f9c-4081-a1ef-7ea7c74028e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6825","nonce":1879105040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6827","nonce":1879105040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6831","nonce":1879105040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1879105040},{"type":"v1","addr":"172.21.15.121:6829","nonce":1879105040}]},"public_addr":"172.21.15.121:6825/1879105040","cluster_addr":"172.21.15.121:6827/1879105040","heartbeat_back_addr":"172.21.15.121:6831/1879105040","heartbeat_front_addr":"172.21.15.121:6829/1879105040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:13.061417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:10:37.669302+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:01.488367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:31.093742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:11:56.239064+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:19.413082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:12:48.796142+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:13.588986+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:13:36.889726+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:06.588727+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:31.475516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T20:14:54.910735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.11","mappings":[{"from":7,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2589583493":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2571286405":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/2902108707":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6801/1152565265":"2024-08-29T20:08:08.057916+0000","172.21.15.1:0/2047796715":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1825727919":"2024-08-29T20:07:38.468473+0000","172.21.15.1:6801/2106947194":"2024-08-29T20:07:38.468473+0000","172.21.15.1:0/1421728777":"2024-08-29T20:08:08.057916+0000","172.21.15.1:6800/2106947194":"2024-08-29T20:07:38.468473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f040b4bb0 msgr2=0x7f5f040b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f040b4bb0 0x7f5f040b70c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009bd0 tx=0x7f5f10005f90 comp rx=0 tx=0).stop 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 msgr2=0x7f5f2019c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 0x7f5f2019c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f2006c660 tx=0x7f5f0c00ee50 comp rx=0 tx=0).stop 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 shutdown_connections 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f5f040b4bb0 0x7f5f040b70c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f2010bbe0 0x7f5f201a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f2010b290 0x7f5f2019c8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 --2- 172.21.15.1:0/3039023662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f20105950 0x7f5f2019c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:18.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 >> 172.21.15.1:0/3039023662 conn(0x7f5f20101420 msgr2=0x7f5f20108840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:18.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 shutdown_connections 2024-08-28T20:34:18.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:18.785+0000 7f5f1f200640 1 -- 172.21.15.1:0/3039023662 wait complete. 2024-08-28T20:34:19.480 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:19 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3039023662' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:34:19.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:19 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3039023662' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:34:19.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:19 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3039023662' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T20:34:19.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-28T20:34:20.027 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:20.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:20 smithi001 ceph-mon[20984]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-08-28T20:34:20.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:20 smithi121 ceph-mon[25248]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-08-28T20:34:20.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-mon[25357]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-08-28T20:34:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.672+0000 7fd848e00640 1 -- 172.21.15.1:0/4070696473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd844077120 msgr2=0x7fd844075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.672+0000 7fd848e00640 1 --2- 172.21.15.1:0/4070696473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd844077120 0x7fd844075550 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd834009900 tx=0x7fd83402a3f0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 -- 172.21.15.1:0/4070696473 shutdown_connections 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 --2- 172.21.15.1:0/4070696473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8441141f0 0x7fd8441166c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 --2- 172.21.15.1:0/4070696473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd844075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 --2- 172.21.15.1:0/4070696473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd844077120 0x7fd844075550 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 -- 172.21.15.1:0/4070696473 >> 172.21.15.1:0/4070696473 conn(0x7fd8440ff330 msgr2=0x7fd844101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 -- 172.21.15.1:0/4070696473 shutdown_connections 2024-08-28T20:34:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.673+0000 7fd848e00640 1 -- 172.21.15.1:0/4070696473 wait complete. 2024-08-28T20:34:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.674+0000 7fd848e00640 1 Processor -- start 2024-08-28T20:34:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.674+0000 7fd848e00640 1 -- start start 2024-08-28T20:34:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.674+0000 7fd848e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd8441a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd848e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd844077120 0x7fd8441a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd848e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8441141f0 0x7fd8441a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd848e00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd844119e30 con 0x7fd8441141f0 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd848e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd844119cb0 con 0x7fd844075b70 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd848e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd844119fb0 con 0x7fd844077120 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd8441a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd8441a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.1:59294/0 (socket says 172.21.15.1:59294) 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 -- 172.21.15.1:0/2087539889 learned_addr learned my addr 172.21.15.1:0/2087539889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd842800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8441141f0 0x7fd8441a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841400640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd844077120 0x7fd8441a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 -- 172.21.15.1:0/2087539889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd844077120 msgr2=0x7fd8441a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd844077120 0x7fd8441a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 -- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8441141f0 msgr2=0x7fd8441a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:20.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8441141f0 0x7fd8441a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.675+0000 7fd841e00640 1 -- 172.21.15.1:0/2087539889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8441a6870 con 0x7fd844075b70 2024-08-28T20:34:20.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.676+0000 7fd841e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd8441a0900 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd834005940 tx=0x7fd834004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.676+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83403f030 con 0x7fd844075b70 2024-08-28T20:34:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.676+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8441a6b00 con 0x7fd844075b70 2024-08-28T20:34:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.676+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8441ad2c0 con 0x7fd844075b70 2024-08-28T20:34:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.677+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd834003aa0 con 0x7fd844075b70 2024-08-28T20:34:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.677+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834035070 con 0x7fd844075b70 2024-08-28T20:34:20.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.678+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8240052c0 con 0x7fd844075b70 2024-08-28T20:34:20.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.680+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fd834042030 con 0x7fd844075b70 2024-08-28T20:34:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.681+0000 7fd83aa00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd8280b4bb0 0x7fd8280b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.682+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8248+0+0 (secure 0 0 0) 0x7fd834105840 con 0x7fd844075b70 2024-08-28T20:34:20.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.682+0000 7fd841400640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd8280b4bb0 0x7fd8280b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:20.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.683+0000 7fd841400640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd8280b4bb0 0x7fd8280b70c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd844102a60 tx=0x7fd830005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:20.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.683+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd8340cc2b0 con 0x7fd844075b70 2024-08-28T20:34:20.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.919+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd824005880 con 0x7fd844075b70 2024-08-28T20:34:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.929+0000 7fd83aa00640 1 -- 172.21.15.1:0/2087539889 <== mon.2 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7fd8340d0a70 con 0x7fd844075b70 2024-08-28T20:34:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-28T20:34:20.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd8280b4bb0 msgr2=0x7fd8280b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd8280b4bb0 0x7fd8280b70c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd844102a60 tx=0x7fd830005f90 comp rx=0 tx=0).stop 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 msgr2=0x7fd8441a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd8441a0900 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd834005940 tx=0x7fd834004270 comp rx=0 tx=0).stop 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 shutdown_connections 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fd8280b4bb0 0x7fd8280b70c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8441141f0 0x7fd8441a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd844077120 0x7fd8441a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 --2- 172.21.15.1:0/2087539889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd844075b70 0x7fd8441a0900 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd834005940 tx=0x7fd834004270 comp rx=0 tx=0).stop 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 >> 172.21.15.1:0/2087539889 conn(0x7fd8440ff330 msgr2=0x7fd8441100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 shutdown_connections 2024-08-28T20:34:20.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:20.933+0000 7fd848e00640 1 -- 172.21.15.1:0/2087539889 wait complete. 2024-08-28T20:34:21.178 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:20 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a[20980]: 2024-08-28T20:34:20.921+0000 7f1fd5600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T20:34:21.179 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g[63692]: ignoring --setuser ceph since I am not root 2024-08-28T20:34:21.179 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g[63692]: ignoring --setgroup ceph since I am not root 2024-08-28T20:34:21.179 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mds[63711]: -- 172.21.15.1:0/3729974038 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597109bd860 con 0x559714b63180 2024-08-28T20:34:21.179 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g[63692]: starting mds.g at 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2087539889' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: osdmap e77: 12 total, 12 up, 12 in 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-28T20:34:21.318 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:34:21.319 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h[54908]: ignoring --setuser ceph since I am not root 2024-08-28T20:34:21.319 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h[54908]: ignoring --setgroup ceph since I am not root 2024-08-28T20:34:21.319 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-mds[54912]: -- 172.21.15.7:0/1935398782 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561631a41860 con 0x561635be7600 2024-08-28T20:34:21.319 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h[54908]: starting mds.h at 2024-08-28T20:34:21.320 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: ignoring --setuser ceph since I am not root 2024-08-28T20:34:21.320 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: ignoring --setgroup ceph since I am not root 2024-08-28T20:34:21.320 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:34:20 smithi007 ceph-mds[55227]: -- 172.21.15.7:0/45152439 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c0ca45c20 con 0x560c10beba80 2024-08-28T20:34:21.320 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:34:21 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: starting mds.b at 2024-08-28T20:34:21.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2087539889' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: osdmap e77: 12 total, 12 up, 12 in 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-28T20:34:21.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:21 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:34:21.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c[55302]: ignoring --setuser ceph since I am not root 2024-08-28T20:34:21.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c[55302]: ignoring --setgroup ceph since I am not root 2024-08-28T20:34:21.479 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mds[55306]: -- 172.21.15.121:0/2840564769 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55786d39f860 con 0x557871545180 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c[55302]: starting mds.c at 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i[55604]: ignoring --setuser ceph since I am not root 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i[55604]: ignoring --setgroup ceph since I am not root 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mds[55608]: -- 172.21.15.121:0/3818969624 <== mon.2 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581dbe5b860 con 0x5581e0001180 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i[55604]: starting mds.i at 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2087539889' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T20:34:21.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: osdmap e77: 12 total, 12 up, 12 in 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:34:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f[54998]: ignoring --setuser ceph since I am not root 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:34:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f[54998]: ignoring --setgroup ceph since I am not root 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-mds[55002]: -- 172.21.15.121:0/2187785569 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0fe5d7860 con 0x55e10277da80 2024-08-28T20:34:21.481 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:34:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f[54998]: starting mds.f at 2024-08-28T20:34:21.656 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-28T20:34:22.043 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-08-28T20:34:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6836/4112227274,v1:172.21.15.7:6838/4112227274] up:boot 2024-08-28T20:34:22.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.7:6837/1567040659,v1:172.21.15.7:6839/1567040659] up:boot 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6834/1054571521,v1:172.21.15.121:6835/1054571521] up:boot 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6836/595410826,v1:172.21.15.121:6838/595410826] up:boot 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.121:6837/227375031,v1:172.21.15.121:6839/227375031] up:boot 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: mds.? [v2:172.21.15.1:6838/2909825817,v1:172.21.15.1:6839/2909825817] up:boot 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T20:34:22.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:22 smithi001 ceph-mon[20984]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T20:34:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-08-28T20:34:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6836/4112227274,v1:172.21.15.7:6838/4112227274] up:boot 2024-08-28T20:34:22.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.7:6837/1567040659,v1:172.21.15.7:6839/1567040659] up:boot 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6834/1054571521,v1:172.21.15.121:6835/1054571521] up:boot 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6836/595410826,v1:172.21.15.121:6838/595410826] up:boot 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.121:6837/227375031,v1:172.21.15.121:6839/227375031] up:boot 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: mds.? [v2:172.21.15.1:6838/2909825817,v1:172.21.15.1:6839/2909825817] up:boot 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T20:34:22.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:22 smithi121 ceph-mon[25248]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T20:34:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-08-28T20:34:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6836/4112227274,v1:172.21.15.7:6838/4112227274] up:boot 2024-08-28T20:34:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.7:6837/1567040659,v1:172.21.15.7:6839/1567040659] up:boot 2024-08-28T20:34:22.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6834/1054571521,v1:172.21.15.121:6835/1054571521] up:boot 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6836/595410826,v1:172.21.15.121:6838/595410826] up:boot 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.121:6837/227375031,v1:172.21.15.121:6839/227375031] up:boot 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: mds.? [v2:172.21.15.1:6838/2909825817,v1:172.21.15.1:6839/2909825817] up:boot 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T20:34:22.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:22 smithi007 ceph-mon[25357]: from='mgr.14150 172.21.15.1:0/2077124717' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T20:34:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.714+0000 7f18aca00640 1 -- 172.21.15.1:0/1431809135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a81099e0 msgr2=0x7f18a8110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:22.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.714+0000 7f18aca00640 1 --2- 172.21.15.1:0/1431809135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a81099e0 0x7f18a8110210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009ca0 tx=0x7f18a002a8c0 comp rx=0 tx=0).stop 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 -- 172.21.15.1:0/1431809135 shutdown_connections 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 --2- 172.21.15.1:0/1431809135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a81099e0 0x7f18a8110210 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 --2- 172.21.15.1:0/1431809135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18a8109090 0x7f18a81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 --2- 172.21.15.1:0/1431809135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a8103750 0x7f18a8103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 -- 172.21.15.1:0/1431809135 >> 172.21.15.1:0/1431809135 conn(0x7f18a80ff1a0 msgr2=0x7f18a81015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 -- 172.21.15.1:0/1431809135 shutdown_connections 2024-08-28T20:34:22.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.715+0000 7f18aca00640 1 -- 172.21.15.1:0/1431809135 wait complete. 2024-08-28T20:34:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 Processor -- start 2024-08-28T20:34:22.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 -- start start 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 0x7f18a819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18a8109090 0x7f18a819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a81099e0 0x7f18a81a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8113700 con 0x7f18a8103750 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8113580 con 0x7f18a8109090 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.716+0000 7f18aca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8113880 con 0x7f18a81099e0 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 0x7f18a819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 0x7f18a819c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55496/0 (socket says 172.21.15.1:55496) 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 -- 172.21.15.1:0/2662525165 learned_addr learned my addr 172.21.15.1:0/2662525165 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a7200640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a81099e0 0x7f18a81a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:22.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f189fe00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18a8109090 0x7f18a819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 -- 172.21.15.1:0/2662525165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a81099e0 msgr2=0x7f18a81a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a81099e0 0x7f18a81a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 -- 172.21.15.1:0/2662525165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18a8109090 msgr2=0x7f18a819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18a8109090 0x7f18a819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:22.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.717+0000 7f18a6800640 1 -- 172.21.15.1:0/2662525165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a81a2240 con 0x7f18a8103750 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.718+0000 7f18a6800640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 0x7f18a819c2d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f189800e9f0 tx=0x7f189800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.718+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189800cd80 con 0x7f18a8103750 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.718+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18980054d0 con 0x7f18a8103750 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.718+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a81a2530 con 0x7f18a8103750 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.718+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898010690 con 0x7f18a8103750 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.718+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a81a8c90 con 0x7f18a8103750 2024-08-28T20:34:22.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.719+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a8103b60 con 0x7f18a8103750 2024-08-28T20:34:22.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.721+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f1898004e30 con 0x7f18a8103750 2024-08-28T20:34:22.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.724+0000 7f189f400640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f188c0b4b30 0x7f188c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:22.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.724+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8506+0+0 (secure 0 0 0) 0x7f18980e5840 con 0x7f18a8103750 2024-08-28T20:34:22.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.724+0000 7f189fe00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f188c0b4b30 0x7f188c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:22.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.725+0000 7f189fe00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f188c0b4b30 0x7f188c0b7040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f18900095f0 tx=0x7f1890005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:22.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.726+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f18980ac800 con 0x7f18a8103750 2024-08-28T20:34:22.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:22.960+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f18a81a9000 con 0x7f18a8103750 2024-08-28T20:34:23.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.184+0000 7f189f400640 1 -- 172.21.15.1:0/2662525165 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) ==== 104+0+0 (secure 0 0 0) 0x7f18980ac100 con 0x7f18a8103750 2024-08-28T20:34:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.186+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f188c0b4b30 msgr2=0x7f188c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.186+0000 7f18aca00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f188c0b4b30 0x7f188c0b7040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f18900095f0 tx=0x7f1890005f90 comp rx=0 tx=0).stop 2024-08-28T20:34:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.186+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 msgr2=0x7f18a819c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.186+0000 7f18aca00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 0x7f18a819c2d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f189800e9f0 tx=0x7f189800edf0 comp rx=0 tx=0).stop 2024-08-28T20:34:23.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 shutdown_connections 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f188c0b4b30 0x7f188c0b7040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a81099e0 0x7f18a81a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18a8109090 0x7f18a819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 --2- 172.21.15.1:0/2662525165 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a8103750 0x7f18a819c2d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 >> 172.21.15.1:0/2662525165 conn(0x7f18a80ff1a0 msgr2=0x7f18a8106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 shutdown_connections 2024-08-28T20:34:23.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:23.187+0000 7f18aca00640 1 -- 172.21.15.1:0/2662525165 wait complete. 2024-08-28T20:34:23.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:23 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2662525165' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:34:23.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:23 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2662525165' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:34:23.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:23 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2662525165' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-28T20:34:23.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-28T20:34:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:24.441 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:24 smithi001 ceph-mon[20984]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-08-28T20:34:24.441 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:24 smithi001 ceph-mon[20984]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-28T20:34:24.441 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:24 smithi001 ceph-mon[20984]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-28T20:34:24.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:24 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2662525165' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-28T20:34:24.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:24 smithi001 ceph-mon[20984]: fsmap 12 up:standby 2024-08-28T20:34:24.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:24 smithi121 ceph-mon[25248]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-08-28T20:34:24.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:24 smithi121 ceph-mon[25248]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-28T20:34:24.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:24 smithi121 ceph-mon[25248]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-28T20:34:24.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:24 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2662525165' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-28T20:34:24.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:24 smithi121 ceph-mon[25248]: fsmap 12 up:standby 2024-08-28T20:34:24.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:24 smithi007 ceph-mon[25357]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-08-28T20:34:24.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:24 smithi007 ceph-mon[25357]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-28T20:34:24.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:24 smithi007 ceph-mon[25357]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-28T20:34:24.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:24 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2662525165' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-28T20:34:24.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:24 smithi007 ceph-mon[25357]: fsmap 12 up:standby 2024-08-28T20:34:25.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 -- 172.21.15.1:0/2501539026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c103730 msgr2=0x7fae5c103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:25.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 --2- 172.21.15.1:0/2501539026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c103730 0x7fae5c103b40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fae50009900 tx=0x7fae5002a3f0 comp rx=0 tx=0).stop 2024-08-28T20:34:25.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 -- 172.21.15.1:0/2501539026 shutdown_connections 2024-08-28T20:34:25.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 --2- 172.21.15.1:0/2501539026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae5c109070 0x7fae5c109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:25.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 --2- 172.21.15.1:0/2501539026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1099c0 0x7fae5c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:25.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 --2- 172.21.15.1:0/2501539026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c103730 0x7fae5c103b40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:25.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 -- 172.21.15.1:0/2501539026 >> 172.21.15.1:0/2501539026 conn(0x7fae5c0ff180 msgr2=0x7fae5c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:25.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 -- 172.21.15.1:0/2501539026 shutdown_connections 2024-08-28T20:34:25.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.094+0000 7fae62c00640 1 -- 172.21.15.1:0/2501539026 wait complete. 2024-08-28T20:34:25.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.095+0000 7fae62c00640 1 Processor -- start 2024-08-28T20:34:25.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 -- start start 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae5c103730 0x7fae5c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c109070 0x7fae5c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 0x7fae5c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c1136e0 con 0x7fae5c103730 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c113560 con 0x7fae5c109070 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c113860 con 0x7fae5c1099c0 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae61800640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae5c103730 0x7fae5c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 0x7fae5c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c109070 0x7fae5c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 0x7fae5c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39608/0 (socket says 172.21.15.1:39608) 2024-08-28T20:34:25.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.096+0000 7fae62200640 1 -- 172.21.15.1:0/2604831014 learned_addr learned my addr 172.21.15.1:0/2604831014 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:25.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62200640 1 -- 172.21.15.1:0/2604831014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c109070 msgr2=0x7fae5c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:25.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62200640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c109070 0x7fae5c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:25.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62200640 1 -- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae5c103730 msgr2=0x7fae5c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:25.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62200640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae5c103730 0x7fae5c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:25.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62200640 1 -- 172.21.15.1:0/2604831014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c1a8330 con 0x7fae5c1099c0 2024-08-28T20:34:25.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62200640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 0x7fae5c075f30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae5400eb10 tx=0x7fae5400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:25.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54004b20 con 0x7fae5c1099c0 2024-08-28T20:34:25.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae54004cc0 con 0x7fae5c1099c0 2024-08-28T20:34:25.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5c1a8620 con 0x7fae5c1099c0 2024-08-28T20:34:25.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54010670 con 0x7fae5c1099c0 2024-08-28T20:34:25.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.097+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5c1a8b30 con 0x7fae5c1099c0 2024-08-28T20:34:25.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.098+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c103b40 con 0x7fae5c1099c0 2024-08-28T20:34:25.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.101+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7fae54005020 con 0x7fae5c1099c0 2024-08-28T20:34:25.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.102+0000 7fae5a000640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae440b4b30 0x7fae440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:25.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.103+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8506+0+0 (secure 0 0 0) 0x7fae540e57b0 con 0x7fae5c1099c0 2024-08-28T20:34:25.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.103+0000 7fae61800640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae440b4b30 0x7fae440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:25.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.103+0000 7fae61800640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae440b4b30 0x7fae440b7040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fae50005ab0 tx=0x7fae50005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:25.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.104+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fae540ac770 con 0x7fae5c1099c0 2024-08-28T20:34:25.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:25.307+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fae5c0767b0 con 0x7fae5c1099c0 2024-08-28T20:34:26.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.193+0000 7fae5a000640 1 -- 172.21.15.1:0/2604831014 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7fae540ac070 con 0x7fae5c1099c0 2024-08-28T20:34:26.197 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae440b4b30 msgr2=0x7fae440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae440b4b30 0x7fae440b7040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fae50005ab0 tx=0x7fae50005a20 comp rx=0 tx=0).stop 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 msgr2=0x7fae5c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 0x7fae5c075f30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae5400eb10 tx=0x7fae5400c2d0 comp rx=0 tx=0).stop 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 shutdown_connections 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7fae440b4b30 0x7fae440b7040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae5c1099c0 0x7fae5c075f30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c109070 0x7fae5c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 --2- 172.21.15.1:0/2604831014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae5c103730 0x7fae5c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 >> 172.21.15.1:0/2604831014 conn(0x7fae5c0ff180 msgr2=0x7fae5c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:26.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 shutdown_connections 2024-08-28T20:34:26.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:26.197+0000 7fae62c00640 1 -- 172.21.15.1:0/2604831014 wait complete. 2024-08-28T20:34:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:26 smithi001 ceph-mon[20984]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-08-28T20:34:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:26 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/2604831014' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:26.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:26 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:26 smithi121 ceph-mon[25248]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-08-28T20:34:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:26 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/2604831014' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:26.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:26 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:26 smithi007 ceph-mon[25357]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-08-28T20:34:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:26 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/2604831014' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:26.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:26 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:27.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid f9e93946-6578-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-28T20:34:27.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:27 smithi001 ceph-mon[20984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T20:34:27.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:27 smithi001 ceph-mon[20984]: osdmap e78: 12 total, 12 up, 12 in 2024-08-28T20:34:27.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:27 smithi121 ceph-mon[25248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T20:34:27.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:27 smithi121 ceph-mon[25248]: osdmap e78: 12 total, 12 up, 12 in 2024-08-28T20:34:27.518 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T20:34:27.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:27 smithi007 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T20:34:27.566 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:27 smithi007 ceph-mon[25357]: osdmap e78: 12 total, 12 up, 12 in 2024-08-28T20:34:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 -- 172.21.15.1:0/1428034580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d810bdb0 msgr2=0x7f01d81125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 --2- 172.21.15.1:0/1428034580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d810bdb0 0x7f01d81125e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009be0 tx=0x7f01d002a6d0 comp rx=0 tx=0).stop 2024-08-28T20:34:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 -- 172.21.15.1:0/1428034580 shutdown_connections 2024-08-28T20:34:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 --2- 172.21.15.1:0/1428034580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d810bdb0 0x7f01d81125e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 --2- 172.21.15.1:0/1428034580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01d810b460 0x7f01d810b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:28.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 --2- 172.21.15.1:0/1428034580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d8105b20 0x7f01d8105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 -- 172.21.15.1:0/1428034580 >> 172.21.15.1:0/1428034580 conn(0x7f01d81015b0 msgr2=0x7f01d8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 -- 172.21.15.1:0/1428034580 shutdown_connections 2024-08-28T20:34:28.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.158+0000 7f01dca00640 1 -- 172.21.15.1:0/1428034580 wait complete. 2024-08-28T20:34:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.159+0000 7f01dca00640 1 Processor -- start 2024-08-28T20:34:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.159+0000 7f01dca00640 1 -- start start 2024-08-28T20:34:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01dca00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 0x7f01d819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01dca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01d810b460 0x7f01d819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:28.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01dca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d810bdb0 0x7f01d81a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01dca00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f01d8115a70 con 0x7f01d8105b20 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01dca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01d81158f0 con 0x7f01d810b460 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01dca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01d8115bf0 con 0x7f01d810bdb0 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 0x7f01d819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 0x7f01d819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42824/0 (socket says 172.21.15.1:42824) 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 -- 172.21.15.1:0/3558178632 learned_addr learned my addr 172.21.15.1:0/3558178632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01cd400640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01d810b460 0x7f01d819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d6800640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d810bdb0 0x7f01d81a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 -- 172.21.15.1:0/3558178632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d810bdb0 msgr2=0x7f01d81a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d810bdb0 0x7f01d81a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 -- 172.21.15.1:0/3558178632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01d810b460 msgr2=0x7f01d819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:28.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01d810b460 0x7f01d819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.160+0000 7f01d5e00640 1 -- 172.21.15.1:0/3558178632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d81a2370 con 0x7f01d8105b20 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.161+0000 7f01d5e00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 0x7f01d819c400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f01c800e9f0 tx=0x7f01c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.161+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c800cd80 con 0x7f01d8105b20 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.161+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c80054d0 con 0x7f01d8105b20 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.161+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d81a2660 con 0x7f01d8105b20 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.161+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8010690 con 0x7f01d8105b20 2024-08-28T20:34:28.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.161+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d81a8dc0 con 0x7f01d8105b20 2024-08-28T20:34:28.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.163+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d8105f30 con 0x7f01d8105b20 2024-08-28T20:34:28.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.167+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 152576+0+0 (secure 0 0 0) 0x7f01c8004e30 con 0x7f01d8105b20 2024-08-28T20:34:28.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.168+0000 7f01cf400640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01bc0b4bb0 0x7f01bc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T20:34:28.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.168+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7915+0+0 (secure 0 0 0) 0x7f01c80e5550 con 0x7f01d8105b20 2024-08-28T20:34:28.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.168+0000 7f01cd400640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01bc0b4bb0 0x7f01bc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T20:34:28.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.169+0000 7f01cd400640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01bc0b4bb0 0x7f01bc0b70c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f01d8104e00 tx=0x7f01c0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T20:34:28.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.170+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f01c8056130 con 0x7f01d8105b20 2024-08-28T20:34:28.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:28.375+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f01d819d530 con 0x7f01d8105b20 2024-08-28T20:34:28.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:28 smithi001 ceph-mon[20984]: pgmap v857: 65 pgs: 65 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:34:28.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:28 smithi121 ceph-mon[25248]: pgmap v857: 65 pgs: 65 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:34:28.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:28 smithi007 ceph-mon[25357]: pgmap v857: 65 pgs: 65 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:34:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.213+0000 7f01cf400640 1 -- 172.21.15.1:0/3558178632 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7f01c80ac770 con 0x7f01d8105b20 2024-08-28T20:34:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-08-28T20:34:29.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01bc0b4bb0 msgr2=0x7f01bc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:29.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01bc0b4bb0 0x7f01bc0b70c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f01d8104e00 tx=0x7f01c0009260 comp rx=0 tx=0).stop 2024-08-28T20:34:29.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 msgr2=0x7f01d819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T20:34:29.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 0x7f01d819c400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f01c800e9f0 tx=0x7f01c800edf0 comp rx=0 tx=0).stop 2024-08-28T20:34:29.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 shutdown_connections 2024-08-28T20:34:29.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:6800/25450820,v1:172.21.15.1:6801/25450820] conn(0x7f01bc0b4bb0 0x7f01bc0b70c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:29.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d810bdb0 0x7f01d81a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:29.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01d810b460 0x7f01d819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:29.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 --2- 172.21.15.1:0/3558178632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01d8105b20 0x7f01d819c400 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T20:34:29.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 >> 172.21.15.1:0/3558178632 conn(0x7f01d81015b0 msgr2=0x7f01d8108a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T20:34:29.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.217+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 shutdown_connections 2024-08-28T20:34:29.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-08-28T20:34:29.218+0000 7f01dca00640 1 -- 172.21.15.1:0/3558178632 wait complete. 2024-08-28T20:34:29.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:29 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3558178632' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:29.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:29 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3558178632' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:29.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:29 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3558178632' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T20:34:30.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:34:30.269 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:34:30.306 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:34:30.345 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-28T20:34:30.345 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-28T20:34:30.402 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-28T20:34:30.425 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-28T20:34:30.440 INFO:tasks.cephadm:Stopping all daemons... 2024-08-28T20:34:30.440 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-28T20:34:30.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a 2024-08-28T20:34:30.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:30 smithi001 ceph-mon[20984]: pgmap v858: 65 pgs: 65 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:34:30.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:30 smithi001 ceph-mon[20984]: from='client.? 172.21.15.1:0/3558178632' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T20:34:30.477 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:30 smithi001 ceph-mon[20984]: osdmap e79: 12 total, 12 up, 12 in 2024-08-28T20:34:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:30 smithi121 ceph-mon[25248]: pgmap v858: 65 pgs: 65 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:34:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:30 smithi121 ceph-mon[25248]: from='client.? 172.21.15.1:0/3558178632' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T20:34:30.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:30 smithi121 ceph-mon[25248]: osdmap e79: 12 total, 12 up, 12 in 2024-08-28T20:34:30.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:30 smithi007 ceph-mon[25357]: pgmap v858: 65 pgs: 65 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T20:34:30.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:30 smithi007 ceph-mon[25357]: from='client.? 172.21.15.1:0/3558178632' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T20:34:30.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:30 smithi007 ceph-mon[25357]: osdmap e79: 12 total, 12 up, 12 in 2024-08-28T20:34:30.975 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:30 smithi001 systemd[1]: Stopping Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:31.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a[20980]: 2024-08-28T20:34:30.972+0000 7f1fdc400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:31.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a[20980]: 2024-08-28T20:34:30.972+0000 7f1fdc400640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-28T20:34:31.227 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:31 smithi001 podman[82848]: 2024-08-28 20:34:31.096303866 +0000 UTC m=+0.297159737 container died e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-28T20:34:31.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:31 smithi001 podman[82848]: 2024-08-28 20:34:31.669103821 +0000 UTC m=+0.869959681 container cleanup e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:34:31.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:31 smithi001 bash[82848]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a 2024-08-28T20:34:31.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:31 smithi001 podman[82860]: 2024-08-28 20:34:31.853949961 +0000 UTC m=+0.750279819 container remove e8a1e11853d34acdee81e946cd788ec73fc6dc0a12d8483491dba50b82c9e835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-28T20:34:32.135 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-28T20:34:32.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:32 smithi001 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-28T20:34:32.226 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:32 smithi001 systemd[1]: Stopped Ceph mon.a for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:34:32.226 INFO:journalctl@ceph.mon.a.smithi001.stdout:Aug 28 20:34:32 smithi001 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.a.service: Consumed 31.181s CPU time. 2024-08-28T20:34:32.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:32.278 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-28T20:34:32.278 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-28T20:34:32.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.b 2024-08-28T20:34:32.565 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:32 smithi007 systemd[1]: Stopping Ceph mon.b for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:32.957 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-b[25353]: 2024-08-28T20:34:32.572+0000 7f356f3d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:32.958 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-b[25353]: 2024-08-28T20:34:32.572+0000 7f356f3d4640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-28T20:34:32.958 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:32 smithi007 podman[60381]: 2024-08-28 20:34:32.685020099 +0000 UTC m=+0.223103336 container died ac8898ed341a0089675ec3d592741641eed37bc66249ebc4cd938b12d2e6d91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-28T20:34:33.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:33 smithi007 podman[60381]: 2024-08-28 20:34:33.056039185 +0000 UTC m=+0.594122414 container cleanup ac8898ed341a0089675ec3d592741641eed37bc66249ebc4cd938b12d2e6d91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:34:33.315 INFO:journalctl@ceph.mon.b.smithi007.stdout:Aug 28 20:34:33 smithi007 bash[60381]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-b 2024-08-28T20:34:33.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-28T20:34:33.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:33.527 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-28T20:34:33.527 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-28T20:34:33.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.c 2024-08-28T20:34:33.842 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:33 smithi121 systemd[1]: Stopping Ceph mon.c for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:34.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c[25242]: 2024-08-28T20:34:33.840+0000 7fc36c33c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:34.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c[25242]: 2024-08-28T20:34:33.840+0000 7fc36c33c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-28T20:34:34.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:33 smithi121 podman[60918]: 2024-08-28 20:34:33.881963388 +0000 UTC m=+0.169517990 container died eaf4fc6c27992fef57c4aed477d4f50668eb012294a98551fd05aebfab3fa4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:34:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:34 smithi121 podman[60918]: 2024-08-28 20:34:34.249825499 +0000 UTC m=+0.537380100 container cleanup eaf4fc6c27992fef57c4aed477d4f50668eb012294a98551fd05aebfab3fa4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:34:34.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Aug 28 20:34:34 smithi121 bash[60918]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mon-c 2024-08-28T20:34:34.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-28T20:34:34.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:34.684 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-28T20:34:34.685 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-28T20:34:34.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x 2024-08-28T20:34:35.113 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:34 smithi001 systemd[1]: Stopping Ceph mgr.x for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:35.477 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:35 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:34:35.109+0000 7fb994e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:35.477 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:35 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x[21218]: 2024-08-28T20:34:35.109+0000 7fb994e00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-28T20:34:35.478 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:35 smithi001 podman[82971]: 2024-08-28 20:34:35.203098991 +0000 UTC m=+0.225915339 container died 05838921b52c64c8d2668ea64485683e4f33ae0681d4816de9e06e02c2eb30f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-28T20:34:36.128 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:35 smithi001 podman[82971]: 2024-08-28 20:34:35.900276005 +0000 UTC m=+0.923092361 container cleanup 05838921b52c64c8d2668ea64485683e4f33ae0681d4816de9e06e02c2eb30f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-08-28T20:34:36.128 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:35 smithi001 bash[82971]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x 2024-08-28T20:34:36.378 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Aug 28 20:34:36 smithi001 podman[82983]: 2024-08-28 20:34:36.126792423 +0000 UTC m=+0.911315881 container remove 05838921b52c64c8d2668ea64485683e4f33ae0681d4816de9e06e02c2eb30f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-28T20:34:36.396 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-28T20:34:36.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:36.472 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-28T20:34:36.472 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-28T20:34:36.472 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.y 2024-08-28T20:34:36.815 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:34:36 smithi007 systemd[1]: Stopping Ceph mgr.y for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:37.080 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:34:36 smithi007 podman[60504]: 2024-08-28 20:34:36.814975696 +0000 UTC m=+0.148199681 container died afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-28T20:34:37.471 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:34:37 smithi007 podman[60504]: 2024-08-28 20:34:37.152632469 +0000 UTC m=+0.485856453 container cleanup afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:34:37.471 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:34:37 smithi007 bash[60504]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y 2024-08-28T20:34:37.725 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:34:37 smithi007 podman[60516]: 2024-08-28 20:34:37.470524381 +0000 UTC m=+0.650438515 container remove afb5a59267491be1137e5cc89628c443daf6e77a764b15b44cddcffc22315f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-y, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-28T20:34:37.725 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Aug 28 20:34:37 smithi007 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-08-28T20:34:37.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-28T20:34:37.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:37.779 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-28T20:34:37.780 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-28T20:34:37.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.z 2024-08-28T20:34:38.085 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:34:37 smithi121 systemd[1]: Stopping Ceph mgr.z for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:38.364 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:34:38 smithi121 podman[61042]: 2024-08-28 20:34:38.083880014 +0000 UTC m=+0.123204571 container died c2c58cce56863aefcf3f17178ff729d8c3859d39e2ca9ce2e123ea0be20d5a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:34:38.729 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:34:38 smithi121 podman[61042]: 2024-08-28 20:34:38.4543373 +0000 UTC m=+0.493661848 container cleanup c2c58cce56863aefcf3f17178ff729d8c3859d39e2ca9ce2e123ea0be20d5a28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-28T20:34:38.730 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Aug 28 20:34:38 smithi121 bash[61042]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mgr-z 2024-08-28T20:34:38.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-28T20:34:38.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:38.896 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-28T20:34:38.896 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-28T20:34:38.896 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.0 2024-08-28T20:34:39.227 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:38 smithi001 systemd[1]: Stopping Ceph osd.0 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:39.727 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0[37244]: 2024-08-28T20:34:39.357+0000 7f13a8800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:39.727 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0[37244]: 2024-08-28T20:34:39.357+0000 7f13a8800640 -1 osd.0 79 *** Got signal Terminated *** 2024-08-28T20:34:39.727 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0[37244]: 2024-08-28T20:34:39.357+0000 7f13a8800640 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:34:45.228 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:44 smithi001 podman[83108]: 2024-08-28 20:34:44.96232737 +0000 UTC m=+5.777378399 container died ca444131b08d7f892720692c57c367d03c87140b39190ddb2b4628b16f1e93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-28T20:34:45.977 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:45 smithi001 podman[83108]: 2024-08-28 20:34:45.504790754 +0000 UTC m=+6.319841782 container cleanup ca444131b08d7f892720692c57c367d03c87140b39190ddb2b4628b16f1e93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-28T20:34:45.977 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:45 smithi001 bash[83108]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0 2024-08-28T20:34:45.977 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:45 smithi001 podman[83124]: 2024-08-28 20:34:45.71472101 +0000 UTC m=+0.740666047 container remove ca444131b08d7f892720692c57c367d03c87140b39190ddb2b4628b16f1e93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:34:46.413 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:46 smithi001 podman[83212]: 2024-08-28 20:34:46.184491827 +0000 UTC m=+0.028079945 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:34:46.413 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:46 smithi001 podman[83212]: 2024-08-28 20:34:46.282462679 +0000 UTC m=+0.126050778 container create f26ebcbabe35924cf35ccc601eb974da46eab5b23741fe1746b3cb2ff47ef77f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-28T20:34:46.828 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:46 smithi001 podman[83212]: 2024-08-28 20:34:46.551820686 +0000 UTC m=+0.395408813 container init f26ebcbabe35924cf35ccc601eb974da46eab5b23741fe1746b3cb2ff47ef77f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-28T20:34:46.828 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:46 smithi001 podman[83212]: 2024-08-28 20:34:46.558756258 +0000 UTC m=+0.402344357 container start f26ebcbabe35924cf35ccc601eb974da46eab5b23741fe1746b3cb2ff47ef77f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-28T20:34:46.828 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:46 smithi001 podman[83212]: 2024-08-28 20:34:46.659804406 +0000 UTC m=+0.503392524 container attach f26ebcbabe35924cf35ccc601eb974da46eab5b23741fe1746b3cb2ff47ef77f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:34:47.227 INFO:journalctl@ceph.osd.0.smithi001.stdout:Aug 28 20:34:46 smithi001 podman[83212]: 2024-08-28 20:34:46.827322913 +0000 UTC m=+0.670911022 container died f26ebcbabe35924cf35ccc601eb974da46eab5b23741fe1746b3cb2ff47ef77f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-28T20:34:47.570 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-28T20:34:47.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:47.647 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-28T20:34:47.647 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-28T20:34:47.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.1 2024-08-28T20:34:48.065 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:47 smithi007 systemd[1]: Stopping Ceph osd.1 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:48.065 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1[29825]: 2024-08-28T20:34:47.906+0000 7f977dc01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:48.065 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1[29825]: 2024-08-28T20:34:47.906+0000 7f977dc01640 -1 osd.1 79 *** Got signal Terminated *** 2024-08-28T20:34:48.066 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1[29825]: 2024-08-28T20:34:47.906+0000 7f977dc01640 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:34:53.717 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:53 smithi007 podman[60638]: 2024-08-28 20:34:53.325176528 +0000 UTC m=+5.494232330 container died 9cbd9ed9d38d7d0a67cdab064245f4b1846912d902129dbfe03523704a56cad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-28T20:34:54.065 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:53 smithi007 podman[60638]: 2024-08-28 20:34:53.790305468 +0000 UTC m=+5.959361269 container cleanup 9cbd9ed9d38d7d0a67cdab064245f4b1846912d902129dbfe03523704a56cad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-08-28T20:34:54.065 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:53 smithi007 bash[60638]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1 2024-08-28T20:34:54.376 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60657]: 2024-08-28 20:34:54.066814734 +0000 UTC m=+0.739013845 container remove 9cbd9ed9d38d7d0a67cdab064245f4b1846912d902129dbfe03523704a56cad5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-28T20:34:54.688 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60746]: 2024-08-28 20:34:54.277966659 +0000 UTC m=+0.015750935 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:34:54.688 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60746]: 2024-08-28 20:34:54.384382911 +0000 UTC m=+0.122167174 container create 09c73022049081330efe868f0f5631626e911cb301492fe3e462f0f46a40abd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-08-28T20:34:54.688 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60746]: 2024-08-28 20:34:54.612459125 +0000 UTC m=+0.350243390 container init 09c73022049081330efe868f0f5631626e911cb301492fe3e462f0f46a40abd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-28T20:34:54.688 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60746]: 2024-08-28 20:34:54.615867677 +0000 UTC m=+0.353651942 container start 09c73022049081330efe868f0f5631626e911cb301492fe3e462f0f46a40abd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-28T20:34:54.689 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60746]: 2024-08-28 20:34:54.687251895 +0000 UTC m=+0.425036167 container attach 09c73022049081330efe868f0f5631626e911cb301492fe3e462f0f46a40abd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:34:55.065 INFO:journalctl@ceph.osd.1.smithi007.stdout:Aug 28 20:34:54 smithi007 podman[60746]: 2024-08-28 20:34:54.815201341 +0000 UTC m=+0.552985624 container died 09c73022049081330efe868f0f5631626e911cb301492fe3e462f0f46a40abd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-28T20:34:55.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-28T20:34:55.416 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:34:55.417 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-28T20:34:55.417 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-28T20:34:55.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.2 2024-08-28T20:34:55.731 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:34:55 smithi121 systemd[1]: Stopping Ceph osd.2 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:34:56.229 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:34:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2[30206]: 2024-08-28T20:34:55.834+0000 7fbbf2a97640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:34:56.230 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:34:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2[30206]: 2024-08-28T20:34:55.834+0000 7fbbf2a97640 -1 osd.2 79 *** Got signal Terminated *** 2024-08-28T20:34:56.230 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:34:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2[30206]: 2024-08-28T20:34:55.834+0000 7fbbf2a97640 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:01.635 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:01 smithi121 podman[61167]: 2024-08-28 20:35:01.340933236 +0000 UTC m=+5.735522075 container died 3aa5208f2d7855b76cd096d2450dc51d5a7b4ffaa5bc690bd645e1a9a22c680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-28T20:35:01.969 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:01 smithi121 podman[61167]: 2024-08-28 20:35:01.733911615 +0000 UTC m=+6.128500498 container cleanup 3aa5208f2d7855b76cd096d2450dc51d5a7b4ffaa5bc690bd645e1a9a22c680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-28T20:35:01.969 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:01 smithi121 bash[61167]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2 2024-08-28T20:35:02.229 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:01 smithi121 podman[61195]: 2024-08-28 20:35:01.968456132 +0000 UTC m=+0.629975140 container remove 3aa5208f2d7855b76cd096d2450dc51d5a7b4ffaa5bc690bd645e1a9a22c680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-28T20:35:02.548 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:02 smithi121 podman[61284]: 2024-08-28 20:35:02.269232443 +0000 UTC m=+0.109589958 container create ecb64f0f66b8d4dfdda39ecf12ed77263f1ce9fb51b56f3ac506267c4becf5fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-28T20:35:02.548 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:02 smithi121 podman[61284]: 2024-08-28 20:35:02.175032581 +0000 UTC m=+0.015390113 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:02.548 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:02 smithi121 podman[61284]: 2024-08-28 20:35:02.547320458 +0000 UTC m=+0.387677978 container init ecb64f0f66b8d4dfdda39ecf12ed77263f1ce9fb51b56f3ac506267c4becf5fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-28T20:35:02.980 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:02 smithi121 podman[61284]: 2024-08-28 20:35:02.55096489 +0000 UTC m=+0.391322406 container start ecb64f0f66b8d4dfdda39ecf12ed77263f1ce9fb51b56f3ac506267c4becf5fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:35:02.980 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:02 smithi121 podman[61284]: 2024-08-28 20:35:02.622186271 +0000 UTC m=+0.462543797 container attach ecb64f0f66b8d4dfdda39ecf12ed77263f1ce9fb51b56f3ac506267c4becf5fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-28T20:35:02.981 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:02 smithi121 podman[61284]: 2024-08-28 20:35:02.737975424 +0000 UTC m=+0.578332947 container died ecb64f0f66b8d4dfdda39ecf12ed77263f1ce9fb51b56f3ac506267c4becf5fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-28T20:35:03.352 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 28 20:35:03 smithi121 podman[61308]: 2024-08-28 20:35:03.333790829 +0000 UTC m=+0.586002983 container remove ecb64f0f66b8d4dfdda39ecf12ed77263f1ce9fb51b56f3ac506267c4becf5fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-08-28T20:35:03.357 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-28T20:35:03.400 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:03.400 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-28T20:35:03.401 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-28T20:35:03.401 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.3 2024-08-28T20:35:03.727 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:03 smithi001 systemd[1]: Stopping Ceph osd.3 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:04.227 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:03 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3[44074]: 2024-08-28T20:35:03.871+0000 7f2f79400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:04.227 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:03 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3[44074]: 2024-08-28T20:35:03.871+0000 7f2f79400640 -1 osd.3 79 *** Got signal Terminated *** 2024-08-28T20:35:04.227 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:03 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3[44074]: 2024-08-28T20:35:03.871+0000 7f2f79400640 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:05.729 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:05.299+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:05.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:05.383+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:06.272 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:06.013+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:06.729 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:06.270+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:06.372+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:07.229 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:07.039+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:07.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:07 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:07.158+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:07.729 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:07.232+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:07.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:07 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:07.352+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:08.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:08 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:08.119+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:08.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:08.044+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:08.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:08.247+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:08.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:08 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:08.321+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:09.227 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:09.156+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:09.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:09.032+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:09.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:09.271+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:09.644 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:09 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:09.375+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:09.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:09 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:09.346+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:09.977 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:09 smithi001 podman[83313]: 2024-08-28 20:35:09.643446951 +0000 UTC m=+5.954251377 container stop 56b3a0cb4c8bbc46dfa4101075c5a0d2295a07888687485c56e81eb9aed6fda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-28T20:35:09.977 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:09 smithi001 podman[83313]: 2024-08-28 20:35:09.671734229 +0000 UTC m=+5.982538664 container died 56b3a0cb4c8bbc46dfa4101075c5a0d2295a07888687485c56e81eb9aed6fda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T20:35:10.403 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:10 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:10.122+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:10.403 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:10 smithi001 podman[83313]: 2024-08-28 20:35:10.241471626 +0000 UTC m=+6.552276057 container cleanup 56b3a0cb4c8bbc46dfa4101075c5a0d2295a07888687485c56e81eb9aed6fda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-28T20:35:10.403 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:10 smithi001 bash[83313]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3 2024-08-28T20:35:10.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:10.010+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:10.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:10.233+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:10.727 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:10 smithi001 podman[83341]: 2024-08-28 20:35:10.518110999 +0000 UTC m=+0.860727763 container remove 56b3a0cb4c8bbc46dfa4101075c5a0d2295a07888687485c56e81eb9aed6fda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-28T20:35:10.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:10 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:10.401+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:10.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:10 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:10.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:11.227 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:11 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:11.137+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:11.227 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:10 smithi001 podman[83421]: 2024-08-28 20:35:10.867843926 +0000 UTC m=+0.027385336 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:11.227 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:11 smithi001 podman[83421]: 2024-08-28 20:35:11.102537317 +0000 UTC m=+0.262078711 container create 74fc8b6c5bc60070cbd82c29ee1882eb844b224575b2c2dfef0f168e66776bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:35:11.229 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:10.968+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:11.657 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:11 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:11.430+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:11.658 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:11 smithi001 podman[83421]: 2024-08-28 20:35:11.373726351 +0000 UTC m=+0.533267747 container init 74fc8b6c5bc60070cbd82c29ee1882eb844b224575b2c2dfef0f168e66776bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-28T20:35:11.658 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:11 smithi001 podman[83421]: 2024-08-28 20:35:11.380828225 +0000 UTC m=+0.540369619 container start 74fc8b6c5bc60070cbd82c29ee1882eb844b224575b2c2dfef0f168e66776bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-28T20:35:11.658 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:11 smithi001 podman[83421]: 2024-08-28 20:35:11.456628768 +0000 UTC m=+0.616170162 container attach 74fc8b6c5bc60070cbd82c29ee1882eb844b224575b2c2dfef0f168e66776bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-28T20:35:11.729 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:11.239+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:11.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:11 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:11.314+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:11.977 INFO:journalctl@ceph.osd.3.smithi001.stdout:Aug 28 20:35:11 smithi001 podman[83421]: 2024-08-28 20:35:11.656785948 +0000 UTC m=+0.816327351 container died 74fc8b6c5bc60070cbd82c29ee1882eb844b224575b2c2dfef0f168e66776bf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-28T20:35:12.336 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:12 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:12.178+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:12.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-28T20:35:12.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:12.441 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-28T20:35:12.441 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-28T20:35:12.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.4 2024-08-28T20:35:12.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:12.014+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:12.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:12.195+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:12.565 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:12 smithi007 systemd[1]: Stopping Ceph osd.4 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:12.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:12 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:12.278+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:12.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:12 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:12.461+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:13.065 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:12 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:12.733+0000 7f75394e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:13.065 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:12 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:12.733+0000 7f75394e6640 -1 osd.4 79 *** Got signal Terminated *** 2024-08-28T20:35:13.065 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:12 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:12.733+0000 7f75394e6640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:13.457 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:13.132+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:13.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:13.021+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:13.219+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:13.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:13 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:13.237+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:13.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:13 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:13.456+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:14.457 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:14 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:14.115+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:14.480 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:14 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:14.028+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:14 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:14.175+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:14 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:14.175+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:14.539 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:14 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:14.466+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:14.539 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:14 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:14.263+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:14.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:14 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:14.456+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:14.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:14 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:14.456+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:14.815 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:14 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:14.537+0000 7f7531ac9640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.342985+0000 front 2024-08-28T20:34:47.342953+0000 (oldest deadline 2024-08-28T20:35:14.343872+0000) 2024-08-28T20:35:15.455 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:15 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:15.146+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:15.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:15 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:15.030+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:15.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:15 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:15.202+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:15.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:15 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:15.202+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:15.498 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:15 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:15.229+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:15.498 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:15 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:15.229+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:15.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:15 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:15.453+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:15.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:15 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:15.453+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:15.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:15 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:15.508+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:15.815 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:15 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:15.496+0000 7f7531ac9640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.342985+0000 front 2024-08-28T20:34:47.342953+0000 (oldest deadline 2024-08-28T20:35:14.343872+0000) 2024-08-28T20:35:16.458 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:16 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:16.133+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:16.465 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:16 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:16.208+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:16.465 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:16 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:16.208+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:16.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:16 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:16.076+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:16.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:16 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:16.172+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:16.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:16 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:16.172+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:16.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:16 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:16.457+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:16.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:16 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:16.457+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:16.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:16 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:16.540+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:16.815 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:16 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:16.463+0000 7f7531ac9640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.342985+0000 front 2024-08-28T20:34:47.342953+0000 (oldest deadline 2024-08-28T20:35:14.343872+0000) 2024-08-28T20:35:17.422 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:17 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:17.037+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:17.422 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:17 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:17.037+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:17.423 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:17 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:17.197+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:17.423 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:17 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:17.197+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:17.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:17 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:17.124+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:17.565 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:17 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4[36691]: 2024-08-28T20:35:17.477+0000 7f7531ac9640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.342985+0000 front 2024-08-28T20:34:47.342953+0000 (oldest deadline 2024-08-28T20:35:14.343872+0000) 2024-08-28T20:35:17.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:17 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:17.228+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:17.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:17 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:17.228+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:17.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:17 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:17.418+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:17.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:17 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:17.496+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:17.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:17 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:17.496+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:18.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:17 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:17.569+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:18.396 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:18 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:18.074+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:18.397 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:18 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:18.074+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:18.397 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:18 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:18.184+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:18.397 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:18 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:18.184+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:18.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:18 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:18.111+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:18.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:18 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:18.111+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:18.511 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:18 smithi007 podman[60848]: 2024-08-28 20:35:18.217047151 +0000 UTC m=+5.579599440 container died 26c6d8e3a925a762da0467d15eccac92168fa061e74ed70078357f2b5271a4c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-28T20:35:18.511 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:18 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:18.223+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:18.511 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:18 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:18.223+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:18.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:18 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:18.395+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:18.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:18 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:18.558+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:18.815 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:18 smithi007 podman[60848]: 2024-08-28 20:35:18.718268825 +0000 UTC m=+6.080821108 container cleanup 26c6d8e3a925a762da0467d15eccac92168fa061e74ed70078357f2b5271a4c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-28T20:35:18.815 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:18 smithi007 bash[60848]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4 2024-08-28T20:35:18.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:18 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:18.534+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:18.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:18 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:18.534+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:19.251 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:18 smithi007 podman[60865]: 2024-08-28 20:35:18.944617658 +0000 UTC m=+0.724471613 container remove 26c6d8e3a925a762da0467d15eccac92168fa061e74ed70078357f2b5271a4c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-28T20:35:19.393 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:19 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:19.031+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:19.393 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:19 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:19.031+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:19.393 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:19 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:19.188+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:19.393 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:19 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:19.188+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:19.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:19 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:19.149+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:19.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:19 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:19.149+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:19.502 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:19 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:19.249+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:19.502 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:19 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:19.249+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:19.502 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:19 smithi007 podman[60951]: 2024-08-28 20:35:19.165124944 +0000 UTC m=+0.015826302 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:19.502 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:19 smithi007 podman[60951]: 2024-08-28 20:35:19.273236852 +0000 UTC m=+0.123938241 container create 06795e2edb5bc9710c2196ee57ce957c13259177d797bfdfd0410105d2159086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:35:19.502 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:19 smithi007 podman[60951]: 2024-08-28 20:35:19.497842025 +0000 UTC m=+0.348543375 container init 06795e2edb5bc9710c2196ee57ce957c13259177d797bfdfd0410105d2159086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-28T20:35:19.502 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:19 smithi007 podman[60951]: 2024-08-28 20:35:19.501069799 +0000 UTC m=+0.351771147 container start 06795e2edb5bc9710c2196ee57ce957c13259177d797bfdfd0410105d2159086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-28T20:35:19.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:19 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:19.391+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:19.815 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:19 smithi007 podman[60951]: 2024-08-28 20:35:19.598109302 +0000 UTC m=+0.448810660 container attach 06795e2edb5bc9710c2196ee57ce957c13259177d797bfdfd0410105d2159086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:35:19.816 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:19 smithi007 podman[60951]: 2024-08-28 20:35:19.693916916 +0000 UTC m=+0.544618273 container died 06795e2edb5bc9710c2196ee57ce957c13259177d797bfdfd0410105d2159086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-28T20:35:19.816 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:19 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:19.519+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:19.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:19 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:19.496+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:19.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:19 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:19.496+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:20.353 INFO:journalctl@ceph.osd.4.smithi007.stdout:Aug 28 20:35:20 smithi007 podman[60974]: 2024-08-28 20:35:20.335085227 +0000 UTC m=+0.634341845 container remove 06795e2edb5bc9710c2196ee57ce957c13259177d797bfdfd0410105d2159086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-28T20:35:20.354 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:20.254+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:20.354 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:20.254+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:20.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-28T20:35:20.401 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:20.401 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-28T20:35:20.401 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-28T20:35:20.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.5 2024-08-28T20:35:20.429 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:20.069+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:20.429 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:20.069+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:20.429 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:20.176+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:20.429 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:20.176+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:20.467 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:20 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:20.196+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:20.467 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:20 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:20.196+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:20.686 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:20 smithi121 systemd[1]: Stopping Ceph osd.5 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:20.686 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:20.430+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:20.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:20 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:20.466+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:20.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:20 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:20.466+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:20.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:20 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:20.487+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:20.979 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:20.684+0000 7f3ace899640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:20.979 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:20.684+0000 7f3ace899640 -1 osd.5 79 *** Got signal Terminated *** 2024-08-28T20:35:20.980 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:20 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:20.684+0000 7f3ace899640 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:21.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:21.180+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:21.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:21.180+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:21.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:21.059+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:21.479 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:21.059+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:21.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:21.171+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:21.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:21.171+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:21.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:21 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:21.484+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:21.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:21 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:21.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:21.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:21 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:21.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:21.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:21.498+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:21.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:21 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:21.498+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:21.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:21 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:21.479+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:22.469 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:22.169+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:22.469 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:22.169+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:22.469 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:22.018+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:22.469 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:22.018+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:22.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:22 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:22.217+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:22.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:22 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:22.217+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:22.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:22 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:22.449+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:22.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:22 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:22.276+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:22.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:22 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:22.276+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:22.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:22.468+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:22.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:22 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:22.531+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:22.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:22 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:22.531+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:23.430 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:22.995+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:23.430 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:22 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:22.995+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:23.431 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:23 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:23.203+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:23.431 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:23 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:23.203+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:23.431 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:23 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:23.203+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:23.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:23 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:23.204+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:23.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:23 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:23.204+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:23.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:23 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:23.204+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:23.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:23 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:23.428+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:23.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:23 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:23.474+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:23.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:23 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:23.324+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:23.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:23 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:23.324+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:23.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:23 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:23.496+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:23.977 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:23 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:23.496+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:24.397 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:24 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:24.035+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:24.398 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:24 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:24.035+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:24.398 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:24 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:24.224+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:24.398 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:24 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:24.224+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:24.398 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:24 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:24.224+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:24.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:24 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:24.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:24.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:24 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:24.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:24.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:24 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:24.247+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:24.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:24 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:24.247+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:24.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:24 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:24.247+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:24.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:24 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:24.396+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:24.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:24 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:24.512+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:24.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:24 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:24.371+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:24.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:24 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:24.371+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:25.419 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:25.058+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:40.553624+0000 front 2024-08-28T20:34:40.553503+0000 (oldest deadline 2024-08-28T20:35:05.853518+0000) 2024-08-28T20:35:25.420 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:25.058+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.655419+0000 front 2024-08-28T20:34:51.655188+0000 (oldest deadline 2024-08-28T20:35:16.355167+0000) 2024-08-28T20:35:25.420 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5[37090]: 2024-08-28T20:35:25.058+0000 7f3acae84640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.057251+0000 front 2024-08-28T20:34:59.057173+0000 (oldest deadline 2024-08-28T20:35:24.957360+0000) 2024-08-28T20:35:25.420 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:25.267+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:25.420 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:25.267+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:25.420 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:25.267+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:25.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:25 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:25.432+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:25.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:25 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:25.432+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:25.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:25 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:25.432+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:25.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:25 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:25.290+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:25.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:25 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:25.290+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:25.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:25 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:25.290+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:25.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:25 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:25.417+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:25.817 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:25 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:25.519+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:25.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:25 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:25.333+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:25.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:25 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:25.333+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:26.479 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:26 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:26.414+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:26.480 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:26 smithi121 podman[61388]: 2024-08-28 20:35:26.221636647 +0000 UTC m=+5.628202180 container died 813b4da93a076cad1186b1cf3bd19281540bc6014f5e5cfd5ce68c47900b219c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-28T20:35:26.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:26 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:26.238+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:26.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:26 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:26.238+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:26.481 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:26 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:26.238+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:26.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:26 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:26.505+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:26.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:26 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:26.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:26.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:26 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:26.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:26.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:26 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:26.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:26.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:26 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:26.402+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:26.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:26 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:26.402+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:26.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:26 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:26.402+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:26.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:26 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:26.273+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:26.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:26 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:26.273+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:26.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:26 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:26.273+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:26.861 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:26 smithi121 podman[61388]: 2024-08-28 20:35:26.626090742 +0000 UTC m=+6.032656275 container cleanup 813b4da93a076cad1186b1cf3bd19281540bc6014f5e5cfd5ce68c47900b219c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-28T20:35:26.861 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:26 smithi121 bash[61388]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5 2024-08-28T20:35:27.223 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:26 smithi121 podman[61406]: 2024-08-28 20:35:26.860787999 +0000 UTC m=+0.633761847 container remove 813b4da93a076cad1186b1cf3bd19281540bc6014f5e5cfd5ce68c47900b219c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-28T20:35:27.479 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:27 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:27.411+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:27.480 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:27 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:27.411+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:27.480 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:27 smithi121 podman[61504]: 2024-08-28 20:35:27.228302582 +0000 UTC m=+0.110221434 container create e130c70ad772d24f316b9cf4d9fae01320c385895e7870208c501c93094862c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:35:27.480 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:27 smithi121 podman[61504]: 2024-08-28 20:35:27.134679217 +0000 UTC m=+0.016598075 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:27.480 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:27 smithi121 podman[61504]: 2024-08-28 20:35:27.438871161 +0000 UTC m=+0.320790016 container init e130c70ad772d24f316b9cf4d9fae01320c385895e7870208c501c93094862c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-28T20:35:27.480 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:27 smithi121 podman[61504]: 2024-08-28 20:35:27.442165789 +0000 UTC m=+0.324084643 container start e130c70ad772d24f316b9cf4d9fae01320c385895e7870208c501c93094862c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-08-28T20:35:27.481 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:27 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:27.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:27.481 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:27 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:27.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:27.481 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:27 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:27.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:27.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:27.429+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:27.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:27.429+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:27.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:27.429+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:27.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:27.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:27.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:27.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:27.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:27.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:27.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:27 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:27.495+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:27.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:27 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:27.495+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:27.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:27 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:27.331+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:27.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:27 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:27.331+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:27.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:27 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:27.331+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:27.952 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:27 smithi121 podman[61504]: 2024-08-28 20:35:27.514011273 +0000 UTC m=+0.395930131 container attach e130c70ad772d24f316b9cf4d9fae01320c385895e7870208c501c93094862c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:35:27.952 INFO:journalctl@ceph.osd.5.smithi121.stdout:Aug 28 20:35:27 smithi121 podman[61504]: 2024-08-28 20:35:27.647444116 +0000 UTC m=+0.529362980 container died e130c70ad772d24f316b9cf4d9fae01320c385895e7870208c501c93094862c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-28T20:35:28.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:28 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:28.196+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:28.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:28 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:28.196+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:28.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:28 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:28.196+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:28.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-28T20:35:28.350 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:28.350 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-28T20:35:28.350 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-28T20:35:28.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.6 2024-08-28T20:35:28.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:28.318+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:28.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:28.318+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:28.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:28.318+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:28.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 systemd[1]: Stopping Ceph osd.6 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:28.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:28.437+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:28.729 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:28.437+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:28.729 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:28.437+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:28.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:28 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:28.448+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:28.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:28 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:28.448+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:28.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:28 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:28.519+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:28.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:28 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:28.519+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:28.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:28 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:28.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:28.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:28 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:28.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:28.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:28 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:28.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:29.227 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:28.757+0000 7fd738400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:29.227 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:28.757+0000 7fd738400640 -1 osd.6 79 *** Got signal Terminated *** 2024-08-28T20:35:29.227 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:28 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:28.757+0000 7fd738400640 -1 osd.6 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:29.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:29 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:29.235+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:29.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:29 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:29.235+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:29.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:29 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:29.235+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:29.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:29 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:29.330+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:29.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:29 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:29.330+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:29.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:29 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:29.330+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:29.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:29 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:29.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:29.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:29 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:29.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:29.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:29 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:29.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:29.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:29 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:29.335+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:29.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:29 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:29.335+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:29.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:29 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:29.335+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:29.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:29 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:29.471+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:29.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:29 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:29.471+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:29.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:29 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:29.493+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:29.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:29 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:29.493+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:30.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:30.439+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:30.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:30.439+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:30.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:30.310+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:30.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:30.310+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:30.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:30.310+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:30.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:30 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:30.310+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:30.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:30.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:30.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:30.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:30.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:30.454+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:30.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:30.339+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:30.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:30.339+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:30.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:30.339+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:30.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:30 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:30.484+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:30.729 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:30 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:30.484+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:30.730 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:30 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:30.235+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:30.730 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:30 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:30.235+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:30.730 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:30 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:30.235+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:31.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:31 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:31.202+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:31.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:31 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:31.202+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:31.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:31 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:31.202+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:31.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:31 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:31.433+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:31.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:31 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:31.433+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:31.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:31 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:31.433+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:31.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:31 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:31.385+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:31.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:31 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:31.385+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:31.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:31 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:31.385+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:31.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:31.483+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:31.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:31.483+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:31.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:31.483+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:31.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:31.343+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:31.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:31.343+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:31.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:31.343+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:31.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:31 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:31.343+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:31.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:31 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:31.533+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:31.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:31 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:31.533+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:32.561 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:32 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:32.230+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:32.561 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:32 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:32.230+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:32.561 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:32 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:32.230+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:32.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:32.351+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:32.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:32.351+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:32.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:32.351+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:32.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:32.417+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:32.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:32.417+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:32.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:32.417+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:32.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:32 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:32.417+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.652221+0000 front 2024-08-28T20:35:06.652546+0000 (oldest deadline 2024-08-28T20:35:31.852929+0000) 2024-08-28T20:35:32.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:32.506+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:32.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:32.506+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:32.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:32.506+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:32.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:32.324+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:32.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:32.324+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:32.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:32.324+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:32.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:32 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:32.324+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:32.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:32 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:32.560+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:32.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:32 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:32.560+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:32.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:32 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:32.560+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:33.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:33.195+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:33.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:33.195+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:33.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:33.195+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:33.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:33.327+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:33.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:33.327+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:33.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:33.327+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:33.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:33.327+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:33.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:33.448+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:44.046201+0000 front 2024-08-28T20:34:44.046236+0000 (oldest deadline 2024-08-28T20:35:08.647396+0000) 2024-08-28T20:35:33.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:33.448+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.348896+0000 front 2024-08-28T20:34:50.349040+0000 (oldest deadline 2024-08-28T20:35:14.448954+0000) 2024-08-28T20:35:33.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:33.448+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.250962+0000 front 2024-08-28T20:35:00.250924+0000 (oldest deadline 2024-08-28T20:35:24.951049+0000) 2024-08-28T20:35:33.728 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:33 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6[50529]: 2024-08-28T20:35:33.448+0000 7fd72ee00640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.652221+0000 front 2024-08-28T20:35:06.652546+0000 (oldest deadline 2024-08-28T20:35:31.852929+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:33.555+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:33.555+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:33.555+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:33.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:33.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:33.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:33.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:33 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:33.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:33.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:33.602+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:33.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:33.602+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:33.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:33 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:33.602+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:34.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:34 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:34.162+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:34.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:34 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:34.162+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:34.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:34 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:34.162+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:34.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:34 smithi001 podman[83523]: 2024-08-28 20:35:34.43493254 +0000 UTC m=+5.800409377 container died 8458efcef95715d360e7cb77745f458c7f2a3933629564f49cefa7b2bd953406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-28T20:35:34.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:34 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:34.355+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:34.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:34 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:34.355+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:34.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:34 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:34.355+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:34.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:34 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:34.355+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:34.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:34.515+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:34.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:34.515+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:34.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:34.515+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:34.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:34.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:34.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:34.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:34.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:34.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:34.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:34 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:34.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:34.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:34 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:34.627+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:34.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:34 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:34.627+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:34.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:34 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:34.627+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:35.227 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:34 smithi001 podman[83523]: 2024-08-28 20:35:34.896116081 +0000 UTC m=+6.261592917 container cleanup 8458efcef95715d360e7cb77745f458c7f2a3933629564f49cefa7b2bd953406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-28T20:35:35.227 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:34 smithi001 bash[83523]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6 2024-08-28T20:35:35.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:35.139+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:35.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:35.139+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:35.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:35.139+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:35.727 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:35 smithi001 podman[83541]: 2024-08-28 20:35:35.239192852 +0000 UTC m=+0.790766761 container remove 8458efcef95715d360e7cb77745f458c7f2a3933629564f49cefa7b2bd953406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:35:35.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:35 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:35.342+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:35.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:35 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:35.342+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:35.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:35 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:35.342+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:35.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:35 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:35.342+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:35.362+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:35.362+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:35.362+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:35.362+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:35.529+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:35.529+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:35.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:35.529+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:35.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:35.629+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:35.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:35.629+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:35.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:35 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:35.629+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:36.168 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:35 smithi001 podman[83630]: 2024-08-28 20:35:35.722162052 +0000 UTC m=+0.027750508 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:36.168 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:35 smithi001 podman[83630]: 2024-08-28 20:35:35.823399821 +0000 UTC m=+0.128988285 container create 57ddb95912e785d2a960441fa7990f0a932732479210fa0c29fb2a195df8e0aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-28T20:35:36.169 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:36 smithi001 podman[83630]: 2024-08-28 20:35:36.042676306 +0000 UTC m=+0.348264786 container init 57ddb95912e785d2a960441fa7990f0a932732479210fa0c29fb2a195df8e0aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-28T20:35:36.169 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:36 smithi001 podman[83630]: 2024-08-28 20:35:36.049523764 +0000 UTC m=+0.355112228 container start 57ddb95912e785d2a960441fa7990f0a932732479210fa0c29fb2a195df8e0aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-28T20:35:36.169 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:36 smithi001 podman[83630]: 2024-08-28 20:35:36.167296402 +0000 UTC m=+0.472884867 container attach 57ddb95912e785d2a960441fa7990f0a932732479210fa0c29fb2a195df8e0aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T20:35:36.477 INFO:journalctl@ceph.osd.6.smithi001.stdout:Aug 28 20:35:36 smithi001 podman[83630]: 2024-08-28 20:35:36.3293647 +0000 UTC m=+0.634953156 container died 57ddb95912e785d2a960441fa7990f0a932732479210fa0c29fb2a195df8e0aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:35:36.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:36 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:36.323+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:36.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:36 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:36.323+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:36.478 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:36 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:36.323+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:36.478 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:36 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:36.323+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:36.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:36 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:36.177+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:36.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:36 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:36.177+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:36.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:36 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:36.177+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:36.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:36.566+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:36.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:36.566+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:36.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:36.566+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:36.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:36.381+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:36.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:36.381+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:36.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:36.381+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:36.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:36 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:36.381+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:36.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:36 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:36.664+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:36.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:36 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:36.664+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:36.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:36 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:36.664+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:37.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-28T20:35:37.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:37.142 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-28T20:35:37.143 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-28T20:35:37.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.7 2024-08-28T20:35:37.438 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 systemd[1]: Stopping Ceph osd.7 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:37.439 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:37.437+0000 7f46f1002640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:37.439 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:37.388+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:37.439 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:37.388+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:37.439 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:37.388+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:37.439 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:37.388+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:37.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:37.213+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:37.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:37.213+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:37.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:37.213+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:37.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:37 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:37.312+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:37.729 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:37 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:37.312+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:37.729 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:37 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:37.312+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:37.729 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:37 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:37.312+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:37.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:37.437+0000 7f46f1002640 -1 osd.7 79 *** Got signal Terminated *** 2024-08-28T20:35:37.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:37.437+0000 7f46f1002640 -1 osd.7 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:37.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:37.614+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:37.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:37.614+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:37.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:37 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:37.614+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:37.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:37.654+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:37.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:37.654+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:37.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:37 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:37.654+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:38.659 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:38 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:38.359+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:38.659 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:38 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:38.359+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:38.659 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:38 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:38.359+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:38.659 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:38 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:38.359+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:38.668 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:38 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:38.232+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:38.668 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:38 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:38.232+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:38.668 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:38 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:38.232+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:38.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:38.569+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:38.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:38.569+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:38.815 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:38.569+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:38.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:38.384+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:38.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:38.384+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:38.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:38.384+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:38.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:38.384+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:38.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:38 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:38.666+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:38.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:38 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:38.666+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:38.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:38 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:38.666+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:39.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:39.204+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:39.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:39.204+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:39.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:39.204+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:39.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:39.204+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:39.597 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:39.336+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:39.597 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:39.336+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:39.597 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:39.336+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:39.597 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:39.336+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:39.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:39.334+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:39.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:39.334+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:39.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:39.334+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:39.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:39.334+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:39.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:39 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:39.334+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:39.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:39.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:39.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:39.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:39.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:39 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:39.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:40.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:39.595+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:40.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:39.595+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:40.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:39 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:39.595+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:40.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:40.165+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:40.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:40.165+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:40.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:40.165+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:40.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:40.165+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:40.589 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:40.337+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:40.589 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:40.337+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:40.589 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:40.337+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:40.589 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:40.337+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:40.589 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:40.337+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:40.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:40 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:40.316+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:40.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:40 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:40.316+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:40.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:40 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:40.316+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:40.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:40 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:40.316+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:40.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:40 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:40.316+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:40.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:40.655+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:40.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:40.655+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:40.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:40.655+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:40.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:40 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:40.655+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:41.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:40.587+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:41.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:40.587+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:41.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:40.587+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:41.065 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:40 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:40.587+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:15.171116+0000 front 2024-08-28T20:35:15.171072+0000 (oldest deadline 2024-08-28T20:35:40.471280+0000) 2024-08-28T20:35:41.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:41.172+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:41.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:41.172+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:41.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:41.173+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:41.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:41.173+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:41.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:41.293+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:41.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:41.293+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:41.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:41.293+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:41.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:41.293+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:41.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:41 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:41.293+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:41.816 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:41.592+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:50.067679+0000 front 2024-08-28T20:34:50.067736+0000 (oldest deadline 2024-08-28T20:35:14.167847+0000) 2024-08-28T20:35:41.816 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:41.592+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.969523+0000 front 2024-08-28T20:34:59.969431+0000 (oldest deadline 2024-08-28T20:35:26.969688+0000) 2024-08-28T20:35:41.816 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:41.592+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.970122+0000 front 2024-08-28T20:35:06.970403+0000 (oldest deadline 2024-08-28T20:35:30.470139+0000) 2024-08-28T20:35:41.816 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7[43177]: 2024-08-28T20:35:41.592+0000 7f46e95e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:15.171116+0000 front 2024-08-28T20:35:15.171072+0000 (oldest deadline 2024-08-28T20:35:40.471280+0000) 2024-08-28T20:35:41.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:41.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:41.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:41.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:41.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:41.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:41.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:41.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:41.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:41.360+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:41.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:41.633+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:41.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:41.633+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:41.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:41.633+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:41.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:41 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:41.633+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:42.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:42.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:42.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:42.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:42.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:42.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:42.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:42.221+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:42.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:42 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:42.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:42.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:42 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:42.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:42.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:42 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:42.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:42.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:42 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:42.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:42.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:42 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:42.283+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:42.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:42 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:42.393+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:42.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:42 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:42.393+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:42.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:42 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:42.393+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:42.817 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:42 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:42.393+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:42.818 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:42 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:42.393+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:42.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:42.663+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:42.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:42.663+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:42.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:42.663+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:42.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:42 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:42.663+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:43.279 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:42 smithi007 podman[61054]: 2024-08-28 20:35:42.993652126 +0000 UTC m=+5.655338298 container died d4b3933e0449332158e517f89d6f67faa68b241848e5eb124618a076a47356c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-28T20:35:43.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:43 smithi007 podman[61054]: 2024-08-28 20:35:43.278961905 +0000 UTC m=+5.940648134 container cleanup d4b3933e0449332158e517f89d6f67faa68b241848e5eb124618a076a47356c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-28T20:35:43.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:43 smithi007 bash[61054]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7 2024-08-28T20:35:43.565 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:43 smithi007 podman[61069]: 2024-08-28 20:35:43.505152901 +0000 UTC m=+0.504339278 container remove d4b3933e0449332158e517f89d6f67faa68b241848e5eb124618a076a47356c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-28T20:35:43.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:43 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:43.376+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:43.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:43 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:43.376+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:43.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:43 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:43.376+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:43.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:43 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:43.376+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:43.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:43 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:43.376+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:43.632 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:43.242+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:43.632 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:43.242+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:43.632 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:43.242+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:43.632 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:43.242+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:43.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:43 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:43.319+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:43.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:43 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:43.319+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:43.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:43 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:43.319+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:43.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:43 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:43.319+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:43.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:43 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:43.319+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:43.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:43.630+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:43.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:43.630+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:43.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:43.630+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:43.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:43 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:43.630+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:44.084 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:43 smithi007 podman[61160]: 2024-08-28 20:35:43.831099354 +0000 UTC m=+0.107756231 container create c56111e930052075015fd8b101ff4008404dd3eec79c4607b495fe79d2b455f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:35:44.084 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:43 smithi007 podman[61160]: 2024-08-28 20:35:43.739285119 +0000 UTC m=+0.015941960 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:44.084 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:44 smithi007 podman[61160]: 2024-08-28 20:35:44.008701417 +0000 UTC m=+0.285358258 container init c56111e930052075015fd8b101ff4008404dd3eec79c4607b495fe79d2b455f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-28T20:35:44.084 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:44 smithi007 podman[61160]: 2024-08-28 20:35:44.012367821 +0000 UTC m=+0.289024660 container start c56111e930052075015fd8b101ff4008404dd3eec79c4607b495fe79d2b455f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:35:44.084 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:44 smithi007 podman[61160]: 2024-08-28 20:35:44.08329357 +0000 UTC m=+0.359950402 container attach c56111e930052075015fd8b101ff4008404dd3eec79c4607b495fe79d2b455f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-28T20:35:44.345 INFO:journalctl@ceph.osd.7.smithi007.stdout:Aug 28 20:35:44 smithi007 podman[61160]: 2024-08-28 20:35:44.204367919 +0000 UTC m=+0.481024751 container died c56111e930052075015fd8b101ff4008404dd3eec79c4607b495fe79d2b455f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-28T20:35:44.680 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:44.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:44.680 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:44.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:44.680 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:44.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:44.680 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:44.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:44.714 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:44 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:44.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:44.714 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:44 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:44.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:44.714 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:44 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:44.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:44.714 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:44 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:44.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:44.714 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:44 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:44.344+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:44.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:44.367+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:44.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:44.367+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:44.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:44.367+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:44.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:44.367+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:44.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:44 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:44.367+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:44.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-28T20:35:44.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:44.779 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-28T20:35:44.779 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-28T20:35:44.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.8 2024-08-28T20:35:44.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:44.678+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:44.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:44.678+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:44.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:44.678+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:44.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:44 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:44.678+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:44.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:44 smithi121 systemd[1]: Stopping Ceph osd.8 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:45.479 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.068+0000 7fe70b021640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:45.480 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.068+0000 7fe70b021640 -1 osd.8 79 *** Got signal Terminated *** 2024-08-28T20:35:45.480 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.068+0000 7fe70b021640 -1 osd.8 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:45.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:45.279+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:45.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:45.279+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:45.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:45.279+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:45.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:45.279+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:45.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:45 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:45.298+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:45.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:45 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:45.298+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:45.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:45 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:45.298+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:45.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:45 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:45.298+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:45.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:45 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:45.298+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:45.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:45 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:45.384+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:45.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:45 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:45.384+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:45.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:45 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:45.384+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:45.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:45 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:45.384+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:45.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:45 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:45.384+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:45.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.656+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:45.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.656+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:45.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.656+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:45.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:45 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:45.656+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:46.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:46.316+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:46.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:46.316+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:46.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:46.316+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:46.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:46.316+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:46.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:46.316+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:46.694 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:46.280+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:46.694 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:46.280+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:46.694 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:46.280+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:46.694 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:46.280+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:46.695 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:46.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:46.695 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:46.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:46.695 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:46.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:46.695 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:46 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:46.692+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:46.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:46 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:46.343+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:46.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:46 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:46.343+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:46.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:46 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:46.343+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:46.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:46 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:46.343+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:46.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:46 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:46.343+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:47.315 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:47.288+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:47.315 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:47.288+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:47.315 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:47.288+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:47.315 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:47.288+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:47.315 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:47 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:47.288+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:47.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:47 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:47.341+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:47.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:47 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:47.341+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:47.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:47 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:47.341+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:47.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:47 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:47.341+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:47.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:47 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:47.341+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:47.729 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:47.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:47.729 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:47.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:47.730 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:47.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:47.730 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:47.237+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:48.212 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:47.735+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:48.212 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:47.735+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:48.212 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:47.735+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:48.212 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:47 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:47.735+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:48.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:48.209+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:48.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:48.209+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:48.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:48.209+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:48.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:48.209+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:48.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:48 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:48.348+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:48.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:48 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:48.348+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:48.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:48 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:48.348+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:48.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:48 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:48.348+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:48.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:48 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:48.348+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:48.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:48 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:48.320+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:48.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:48 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:48.320+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:48.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:48 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:48.320+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:48.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:48 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:48.320+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:48.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:48 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:48.320+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:48.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:48.725+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:48.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:48.725+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:48.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:48.725+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:48.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:48 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:48.725+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:49.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:49.189+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:49.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:49.189+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:49.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:49.189+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:49.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:49.189+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:49.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:49.189+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:49.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:49 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:49.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:49.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:49 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:49.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:49.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:49 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:49.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:49.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:49 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:49.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:49.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:49 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:49.313+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:49.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:49 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:49.322+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:49.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:49 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:49.322+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:49.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:49 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:49.322+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:49.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:49 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:49.322+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:49.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:49 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:49.322+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:49.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:49 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:49.322+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:49.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:49.682+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.754793+0000 front 2024-08-28T20:34:51.754769+0000 (oldest deadline 2024-08-28T20:35:16.454532+0000) 2024-08-28T20:35:49.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:49.682+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:56.454952+0000 front 2024-08-28T20:34:56.454860+0000 (oldest deadline 2024-08-28T20:35:26.455604+0000) 2024-08-28T20:35:49.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:49.682+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:06.456297+0000 front 2024-08-28T20:35:06.456267+0000 (oldest deadline 2024-08-28T20:35:31.756155+0000) 2024-08-28T20:35:49.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:49.682+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:17.557692+0000 front 2024-08-28T20:35:17.557653+0000 (oldest deadline 2024-08-28T20:35:40.457529+0000) 2024-08-28T20:35:49.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:49 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8[43559]: 2024-08-28T20:35:49.682+0000 7fe70760c640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:23.958345+0000 front 2024-08-28T20:35:23.958368+0000 (oldest deadline 2024-08-28T20:35:49.258410+0000) 2024-08-28T20:35:50.462 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:50 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:50.146+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:50.462 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:50 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:50.146+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:50.462 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:50 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:50.146+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:50.462 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:50 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:50.146+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:50.462 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:50 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:50.146+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:50.568 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:50 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:50.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:50.569 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:50 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:50.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:50.569 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:50 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:50.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:50.569 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:50 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:50.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:50.569 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:50 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:50.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:50.569 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:50 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:50.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:50.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:50.277+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:50.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:50.277+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:50.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:50.277+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:50.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:50.277+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:50.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:50.277+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:50.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:50 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:50.277+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:50.728 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:50 smithi121 podman[61609]: 2024-08-28 20:35:50.46130831 +0000 UTC m=+5.496703779 container died 73fc6c2e40af6125b14276ef6cce787a8b0350c0308ee0bfbe1f45938f2fa505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-28T20:35:50.979 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:50 smithi121 podman[61609]: 2024-08-28 20:35:50.817862899 +0000 UTC m=+5.853258359 container cleanup 73fc6c2e40af6125b14276ef6cce787a8b0350c0308ee0bfbe1f45938f2fa505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-28T20:35:50.980 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:50 smithi121 bash[61609]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8 2024-08-28T20:35:51.422 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61623]: 2024-08-28 20:35:51.094232424 +0000 UTC m=+0.631668886 container remove 73fc6c2e40af6125b14276ef6cce787a8b0350c0308ee0bfbe1f45938f2fa505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-28T20:35:51.422 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:51.112+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:51.422 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:51.112+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:51.423 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:51.112+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:51.423 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:51.112+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:51.423 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:51.112+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:51.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:51 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:51.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:51.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:51 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:51.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:51.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:51 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:51.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:51.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:51 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:51.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:51.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:51 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:51.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:51.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:51 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:51.272+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:51.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:51 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:51.307+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:51.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:51 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:51.307+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:51.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:51 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:51.307+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:51.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:51 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:51.307+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:51.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:51 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:51.307+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:51.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:51 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:51.307+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:51.730 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61713]: 2024-08-28 20:35:51.324070637 +0000 UTC m=+0.015475739 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:51.730 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61713]: 2024-08-28 20:35:51.441878644 +0000 UTC m=+0.133283778 container create c368d540655088b04afbf9b24925fe9c7446a6b3458722ee795f00ee39e44fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-28T20:35:51.730 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61713]: 2024-08-28 20:35:51.664084958 +0000 UTC m=+0.355490049 container init c368d540655088b04afbf9b24925fe9c7446a6b3458722ee795f00ee39e44fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-28T20:35:51.730 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61713]: 2024-08-28 20:35:51.667498995 +0000 UTC m=+0.358904084 container start c368d540655088b04afbf9b24925fe9c7446a6b3458722ee795f00ee39e44fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-28T20:35:52.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61713]: 2024-08-28 20:35:51.755571268 +0000 UTC m=+0.446976374 container attach c368d540655088b04afbf9b24925fe9c7446a6b3458722ee795f00ee39e44fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-28T20:35:52.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Aug 28 20:35:51 smithi121 podman[61713]: 2024-08-28 20:35:51.852004117 +0000 UTC m=+0.543409219 container died c368d540655088b04afbf9b24925fe9c7446a6b3458722ee795f00ee39e44fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-28T20:35:52.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-28T20:35:52.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:35:52.363 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-28T20:35:52.363 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-28T20:35:52.363 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.9 2024-08-28T20:35:52.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:52 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:52.156+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:52.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:52 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:52.156+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:52.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:52 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:52.156+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:52.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:52 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:52.156+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:52.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:52 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:52.156+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:52.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:52 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:52.300+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:52.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:52 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:52.300+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:52.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:52 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:52.300+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:52.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:52 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:52.300+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:52.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:52 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:52.300+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:52.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:52 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:52.300+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:52.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.294+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:52.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.294+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:52.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.294+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:52.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.294+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:52.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.294+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:52.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.294+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:52.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 systemd[1]: Stopping Ceph osd.9 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:35:53.227 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.817+0000 7f0795a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:35:53.227 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.817+0000 7f0795a00640 -1 osd.9 79 *** Got signal Terminated *** 2024-08-28T20:35:53.227 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:52 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:52.817+0000 7f0795a00640 -1 osd.9 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:35:53.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:53 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:53.183+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:53.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:53 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:53.183+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:53.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:53 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:53.183+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:53.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:53 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:53.183+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:53.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:53 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:53.183+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:53.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:53 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:53.301+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:53.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:53 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:53.301+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:53.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:53 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:53.301+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:53.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:53 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:53.301+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:53.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:53 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:53.301+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:53.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:53 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:53.301+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:53.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:53 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:53.246+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:53.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:53 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:53.246+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:53.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:53 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:53.246+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:53.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:53 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:53.246+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:53.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:53 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:53.246+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:53.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:53 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:53.246+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:54.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:54.136+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:54.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:54.136+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:54.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:54.136+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:54.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:54.136+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:54.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:54.136+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:54.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:54 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:54.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:54.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:54 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:54.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:54.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:54 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:54.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:54.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:54 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:54.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:54.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:54 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:54.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:54.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:54 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:54.299+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:54.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:54 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:54.270+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:54.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:54 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:54.270+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:54.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:54 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:54.270+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:54.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:54 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:54.270+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:54.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:54 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:54.270+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:54.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:54 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:54.270+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:55.382 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:55.107+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:55.382 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:55.107+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:55.382 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:55.107+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:55.382 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:55.107+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:55.382 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:55.107+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:55.382 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:55 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:55.107+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:35:55.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:55.297+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:55.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:55.297+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:55.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:55.297+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:55.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:55.297+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:55.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:55.297+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:55.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:55 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:55.297+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:55.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:55 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:55.230+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:55.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:55 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:55.230+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:55.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:55 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:55.230+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:55.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:55 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:55.230+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:55.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:55 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:55.230+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:55.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:55 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:55.230+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:56.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:56 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:56.074+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:56.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:56 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:56.074+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:56.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:56 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:56.074+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:56.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:56 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:56.074+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:56.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:56 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:56.074+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:56.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:56 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:56.074+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:35:56.555 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:56 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:56.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:56.555 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:56 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:56.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:56.555 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:56 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:56.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:56.555 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:56 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:56.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:56.556 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:56 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:56.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:56.556 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:56 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:56.292+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:56.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:56.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:56.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:56.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:56.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:56.727 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:56.728 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:56 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:56.259+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.945501+0000 front 2024-08-28T20:35:28.945442+0000 (oldest deadline 2024-08-28T20:35:55.946343+0000) 2024-08-28T20:35:57.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:43.036757+0000 front 2024-08-28T20:34:43.036790+0000 (oldest deadline 2024-08-28T20:35:07.136898+0000) 2024-08-28T20:35:57.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:47.137520+0000 front 2024-08-28T20:34:47.137410+0000 (oldest deadline 2024-08-28T20:35:17.138290+0000) 2024-08-28T20:35:57.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:35:00.639354+0000 front 2024-08-28T20:35:00.639671+0000 (oldest deadline 2024-08-28T20:35:22.839994+0000) 2024-08-28T20:35:57.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:07.441607+0000 front 2024-08-28T20:35:07.441827+0000 (oldest deadline 2024-08-28T20:35:33.242130+0000) 2024-08-28T20:35:57.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:13.743434+0000 front 2024-08-28T20:35:13.743570+0000 (oldest deadline 2024-08-28T20:35:38.443427+0000) 2024-08-28T20:35:57.478 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.445240+0000 front 2024-08-28T20:35:25.445350+0000 (oldest deadline 2024-08-28T20:35:48.945114+0000) 2024-08-28T20:35:57.478 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:57 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9[57481]: 2024-08-28T20:35:57.214+0000 7f0791400640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.945501+0000 front 2024-08-28T20:35:28.945442+0000 (oldest deadline 2024-08-28T20:35:55.946343+0000) 2024-08-28T20:35:57.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:57 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:57.052+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:57.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:57 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:57.052+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:57.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:57 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:57.052+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:57.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:57 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:57.052+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:57.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:57 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:57.052+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:57.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:57 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:57.052+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:35:57.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:57.289+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:57.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:57.289+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:57.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:57.289+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:57.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:57.289+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:57.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:57.289+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:57.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:57 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:57.289+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:58.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:58.018+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:58.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:58.018+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:58.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:58.018+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:58.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:58.018+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:58.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:58.018+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:58.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:58.018+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:35:58.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:58.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:58.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:58.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:58.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:58.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:58.566 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:58 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:58.306+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:35:58.717 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:58 smithi001 podman[83742]: 2024-08-28 20:35:58.371752538 +0000 UTC m=+5.715603979 container died cb906268744c78a5c0b211f296d6d2f76297bda9586c05ca3e4f0ab3d98eb0a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-28T20:35:58.977 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:58 smithi001 podman[83742]: 2024-08-28 20:35:58.831432829 +0000 UTC m=+6.175284270 container cleanup cb906268744c78a5c0b211f296d6d2f76297bda9586c05ca3e4f0ab3d98eb0a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:35:58.977 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:58 smithi001 bash[83742]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9 2024-08-28T20:35:59.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:59 smithi001 podman[83760]: 2024-08-28 20:35:59.07470407 +0000 UTC m=+0.686005582 container remove cb906268744c78a5c0b211f296d6d2f76297bda9586c05ca3e4f0ab3d98eb0a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-28T20:35:59.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:59 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:59.034+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:35:59.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:59 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:59.034+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:35:59.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:59 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:59.034+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:35:59.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:59 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:59.034+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:35:59.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:59 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:59.034+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:35:59.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:35:59 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:35:59.034+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:35:59.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:35:59.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:35:59.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:35:59.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:35:59.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:35:59.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:35:59.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:35:59 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:35:59.317+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:35:59.946 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:59 smithi001 podman[83843]: 2024-08-28 20:35:59.549868431 +0000 UTC m=+0.027307842 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:35:59.946 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:59 smithi001 podman[83843]: 2024-08-28 20:35:59.709392183 +0000 UTC m=+0.186831593 container create d54b34f09fcf09de1fb6776622adde9ff7ba25cc71ffe7d0155e010fb8ba78b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-28T20:36:00.221 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:59 smithi001 podman[83843]: 2024-08-28 20:35:59.945162357 +0000 UTC m=+0.422601768 container init d54b34f09fcf09de1fb6776622adde9ff7ba25cc71ffe7d0155e010fb8ba78b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-28T20:36:00.221 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:35:59 smithi001 podman[83843]: 2024-08-28 20:35:59.952689773 +0000 UTC m=+0.430129187 container start d54b34f09fcf09de1fb6776622adde9ff7ba25cc71ffe7d0155e010fb8ba78b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:36:00.221 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:36:00 smithi001 podman[83843]: 2024-08-28 20:36:00.069837555 +0000 UTC m=+0.547276989 container attach d54b34f09fcf09de1fb6776622adde9ff7ba25cc71ffe7d0155e010fb8ba78b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-28T20:36:00.477 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:36:00 smithi001 podman[83843]: 2024-08-28 20:36:00.219483622 +0000 UTC m=+0.696923032 container died d54b34f09fcf09de1fb6776622adde9ff7ba25cc71ffe7d0155e010fb8ba78b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T20:36:00.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:00.005+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:00.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:00.005+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:00.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:00.005+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:00.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:00.005+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:00.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:00.005+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:00.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:00 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:00.005+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:00.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:00 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:00.341+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:01.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Aug 28 20:36:01 smithi001 podman[83866]: 2024-08-28 20:36:01.073288664 +0000 UTC m=+0.839753282 container remove d54b34f09fcf09de1fb6776622adde9ff7ba25cc71ffe7d0155e010fb8ba78b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:36:01.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-28T20:36:01.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:01.176 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-28T20:36:01.176 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-28T20:36:01.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.10 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 systemd[1]: Stopping Ceph osd.10 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:01.466 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:01.467 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.382+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:01.467 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.464+0000 7f3ce0449640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:01.467 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.464+0000 7f3ce0449640 -1 osd.10 79 *** Got signal Terminated *** 2024-08-28T20:36:01.467 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:01 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:01.464+0000 7f3ce0449640 -1 osd.10 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:36:01.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.001+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:01.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.001+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:01.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.001+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:01.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.001+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:01.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.001+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:01.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.001+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:02.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.952+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:02.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.952+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:02.231 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.952+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:02.231 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.952+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:02.231 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.952+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:02.231 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:01 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:01.952+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:02.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:02.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:02.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:02.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:02.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:02.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:02.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:02 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:02.424+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:03.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:02.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:03.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:02.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:03.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:02.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:03.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:02.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:03.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:02.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:03.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:02.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:03.819 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:03.820 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:03.820 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:03.820 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:03.820 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:03.820 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:03.820 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:03 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:03.432+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:04.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:04.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:04.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:04.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:04.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:04.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:04.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:03 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:03.976+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:04.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:04 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:04.464+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:05.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:05.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:05.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:05.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:05.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:05.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:05.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:04 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:04.972+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:05.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:05.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:05.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:05.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:05.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:05.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:05.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:05 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:05.416+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:06.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:06.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:06.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:06.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:06.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:06.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:06.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:05 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:05.940+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:41.668913+0000 front 2024-08-28T20:34:41.668846+0000 (oldest deadline 2024-08-28T20:35:05.168827+0000) 2024-08-28T20:36:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:52.770413+0000 front 2024-08-28T20:34:52.770516+0000 (oldest deadline 2024-08-28T20:35:15.070624+0000) 2024-08-28T20:36:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:59.672108+0000 front 2024-08-28T20:34:59.672362+0000 (oldest deadline 2024-08-28T20:35:25.572041+0000) 2024-08-28T20:36:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-08-28T20:35:05.572676+0000 front 2024-08-28T20:35:05.572746+0000 (oldest deadline 2024-08-28T20:35:29.672678+0000) 2024-08-28T20:36:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:14.274233+0000 front 2024-08-28T20:35:14.274184+0000 (oldest deadline 2024-08-28T20:35:39.574216+0000) 2024-08-28T20:36:06.815 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:24.275339+0000 front 2024-08-28T20:35:24.275313+0000 (oldest deadline 2024-08-28T20:35:49.575230+0000) 2024-08-28T20:36:06.816 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10[49990]: 2024-08-28T20:36:06.439+0000 7f3cdca34640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:29.575911+0000 front 2024-08-28T20:35:29.575811+0000 (oldest deadline 2024-08-28T20:35:57.776325+0000) 2024-08-28T20:36:07.098 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:06 smithi007 podman[61275]: 2024-08-28 20:36:06.842224227 +0000 UTC m=+5.472269433 container died ab57f51104bd6f25776672ba6446b48e310dad4237f345a2d84a580a2496e076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-28T20:36:07.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:07.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:07.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:07.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:07.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:07.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:07.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:06 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:06.900+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:07.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61275]: 2024-08-28 20:36:07.097225292 +0000 UTC m=+5.727270533 container cleanup ab57f51104bd6f25776672ba6446b48e310dad4237f345a2d84a580a2496e076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-28T20:36:07.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 bash[61275]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10 2024-08-28T20:36:07.565 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61291]: 2024-08-28 20:36:07.33165542 +0000 UTC m=+0.483005021 container remove ab57f51104bd6f25776672ba6446b48e310dad4237f345a2d84a580a2496e076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-28T20:36:07.953 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61380]: 2024-08-28 20:36:07.542016317 +0000 UTC m=+0.015492761 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:36:07.953 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61380]: 2024-08-28 20:36:07.65784837 +0000 UTC m=+0.131324856 container create 413d389180afb13d1277d4deaf3777714694ebb36beb3f80daa8df16dbd84247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:36:07.953 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61380]: 2024-08-28 20:36:07.877218624 +0000 UTC m=+0.350695069 container init 413d389180afb13d1277d4deaf3777714694ebb36beb3f80daa8df16dbd84247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:36:07.953 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61380]: 2024-08-28 20:36:07.880437199 +0000 UTC m=+0.353913646 container start 413d389180afb13d1277d4deaf3777714694ebb36beb3f80daa8df16dbd84247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:36:07.953 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:07 smithi007 podman[61380]: 2024-08-28 20:36:07.952219902 +0000 UTC m=+0.425696349 container attach 413d389180afb13d1277d4deaf3777714694ebb36beb3f80daa8df16dbd84247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-08-28T20:36:08.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:08.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:08.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:08.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:08.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:08.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:08.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:07 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:07.926+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:08.315 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:08 smithi007 podman[61380]: 2024-08-28 20:36:08.073906229 +0000 UTC m=+0.547382682 container died 413d389180afb13d1277d4deaf3777714694ebb36beb3f80daa8df16dbd84247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T20:36:08.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-28T20:36:08.761 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:08 smithi007 podman[61403]: 2024-08-28 20:36:08.714098691 +0000 UTC m=+0.634523426 container remove 413d389180afb13d1277d4deaf3777714694ebb36beb3f80daa8df16dbd84247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:36:08.761 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:08 smithi007 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.10.service: Deactivated successfully. 2024-08-28T20:36:08.761 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:08 smithi007 systemd[1]: Stopped Ceph osd.10 for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:36:08.761 INFO:journalctl@ceph.osd.10.smithi007.stdout:Aug 28 20:36:08 smithi007 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.10.service: Consumed 8min 2.888s CPU time. 2024-08-28T20:36:08.777 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:08.777 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-28T20:36:08.777 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-28T20:36:08.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.11 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 systemd[1]: Stopping Ceph osd.11 for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:08 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:08.907+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:09.112 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.109+0000 7f68099bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:09.113 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.109+0000 7f68099bb640 -1 osd.11 79 *** Got signal Terminated *** 2024-08-28T20:36:09.113 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.109+0000 7f68099bb640 -1 osd.11 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T20:36:10.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:10.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:10.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:10.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:10.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:10.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:10.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:09 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:09.925+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:11.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:11.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:11.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:11.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:11.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:11.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:11.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:10 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:10.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:12.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:11 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:11.951+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:13.479 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:13.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:12 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:12.982+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-08-28T20:34:42.770683+0000 front 2024-08-28T20:34:42.770607+0000 (oldest deadline 2024-08-28T20:35:05.070603+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6804 osd.1 since back 2024-08-28T20:34:51.972436+0000 front 2024-08-28T20:34:51.972542+0000 (oldest deadline 2024-08-28T20:35:13.672391+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-08-28T20:34:57.073751+0000 front 2024-08-28T20:34:57.073931+0000 (oldest deadline 2024-08-28T20:35:22.973893+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6812 osd.4 since back 2024-08-28T20:35:12.776137+0000 front 2024-08-28T20:35:12.776224+0000 (oldest deadline 2024-08-28T20:35:38.576741+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-08-28T20:35:25.378794+0000 front 2024-08-28T20:35:25.378808+0000 (oldest deadline 2024-08-28T20:35:48.878810+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-08-28T20:35:28.879459+0000 front 2024-08-28T20:35:28.879476+0000 (oldest deadline 2024-08-28T20:35:54.779162+0000) 2024-08-28T20:36:14.480 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:13 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11[50199]: 2024-08-28T20:36:13.988+0000 7f6805fa6640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.7:6820 osd.7 since back 2024-08-28T20:35:41.180448+0000 front 2024-08-28T20:35:41.180498+0000 (oldest deadline 2024-08-28T20:36:03.480322+0000) 2024-08-28T20:36:14.844 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:14 smithi121 podman[61829]: 2024-08-28 20:36:14.575970347 +0000 UTC m=+5.604481387 container died 734dd2a67f871e26ed15caae80c852a8b3560516ce878c90474943fdba6b6b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-28T20:36:15.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:14 smithi121 podman[61829]: 2024-08-28 20:36:14.942470568 +0000 UTC m=+5.970981659 container cleanup 734dd2a67f871e26ed15caae80c852a8b3560516ce878c90474943fdba6b6b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-28T20:36:15.230 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:14 smithi121 bash[61829]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11 2024-08-28T20:36:15.536 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61844]: 2024-08-28 20:36:15.235094152 +0000 UTC m=+0.653104439 container remove 734dd2a67f871e26ed15caae80c852a8b3560516ce878c90474943fdba6b6b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-28T20:36:15.814 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61936]: 2024-08-28 20:36:15.535955931 +0000 UTC m=+0.109357087 container create 680e43d1d0d1d1784b2c6380a5a2723ee7806cf420c2344fdc2db616b1e81089 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:36:15.814 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61936]: 2024-08-28 20:36:15.442181918 +0000 UTC m=+0.015583085 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T20:36:15.814 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61936]: 2024-08-28 20:36:15.738311005 +0000 UTC m=+0.311712159 container init 680e43d1d0d1d1784b2c6380a5a2723ee7806cf420c2344fdc2db616b1e81089 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-28T20:36:15.814 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61936]: 2024-08-28 20:36:15.741626348 +0000 UTC m=+0.315027511 container start 680e43d1d0d1d1784b2c6380a5a2723ee7806cf420c2344fdc2db616b1e81089 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-28T20:36:15.814 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61936]: 2024-08-28 20:36:15.813217927 +0000 UTC m=+0.386619097 container attach 680e43d1d0d1d1784b2c6380a5a2723ee7806cf420c2344fdc2db616b1e81089 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-28T20:36:16.229 INFO:journalctl@ceph.osd.11.smithi121.stdout:Aug 28 20:36:15 smithi121 podman[61936]: 2024-08-28 20:36:15.93389186 +0000 UTC m=+0.507293016 container died 680e43d1d0d1d1784b2c6380a5a2723ee7806cf420c2344fdc2db616b1e81089 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-28T20:36:16.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-28T20:36:16.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:16.595 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-28T20:36:16.595 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-28T20:36:16.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.a 2024-08-28T20:36:16.977 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:16 smithi001 systemd[1]: Stopping Ceph mds.a for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:17.477 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:17 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a[64063]: 2024-08-28T20:36:17.004+0000 7f048b200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:17.477 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:17 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a[64063]: 2024-08-28T20:36:17.004+0000 7f048b200640 -1 mds.a *** got signal Terminated *** 2024-08-28T20:36:21.477 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:21 smithi001 podman[83968]: 2024-08-28 20:36:21.024838765 +0000 UTC m=+4.137526890 container died d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-28T20:36:21.775 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:21 smithi001 podman[83968]: 2024-08-28 20:36:21.584127896 +0000 UTC m=+4.696816025 container cleanup d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:36:21.776 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:21 smithi001 bash[83968]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a 2024-08-28T20:36:22.027 INFO:journalctl@ceph.mds.a.smithi001.stdout:Aug 28 20:36:21 smithi001 podman[83982]: 2024-08-28 20:36:21.774556376 +0000 UTC m=+0.732215563 container remove d5e24778eeee0f77981903024a978f801afc83cff55825981db0a4e15fe85c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-28T20:36:22.037 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-28T20:36:22.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:22.110 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-28T20:36:22.110 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-28T20:36:22.110 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.d 2024-08-28T20:36:22.477 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:22 smithi001 systemd[1]: Stopping Ceph mds.d for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:22.977 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:22 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d[62995]: 2024-08-28T20:36:22.541+0000 7f0e0fa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:22.977 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:22 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d[62995]: 2024-08-28T20:36:22.541+0000 7f0e0fa00640 -1 mds.d *** got signal Terminated *** 2024-08-28T20:36:26.441 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:25 smithi001 podman[84088]: 2024-08-28 20:36:25.998757447 +0000 UTC m=+3.615601160 container died a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-28T20:36:26.727 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:26 smithi001 podman[84088]: 2024-08-28 20:36:26.554904659 +0000 UTC m=+4.171748367 container cleanup a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-28T20:36:26.727 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:26 smithi001 bash[84088]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d 2024-08-28T20:36:27.207 INFO:journalctl@ceph.mds.d.smithi001.stdout:Aug 28 20:36:26 smithi001 podman[84100]: 2024-08-28 20:36:26.881666277 +0000 UTC m=+0.868113566 container remove a77034e07edd524616df108612bd3b1ec46daa804fb5fae348eb3e1444d2ee58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-28T20:36:27.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-28T20:36:27.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:27.301 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-28T20:36:27.302 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-28T20:36:27.302 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.g 2024-08-28T20:36:27.477 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:27 smithi001 systemd[1]: Stopping Ceph mds.g for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:27.977 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g[63692]: 2024-08-28T20:36:27.703+0000 7f1b81400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:27.977 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:27 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g[63692]: 2024-08-28T20:36:27.703+0000 7f1b81400640 -1 mds.g *** got signal Terminated *** 2024-08-28T20:36:29.429 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:29 smithi001 podman[84207]: 2024-08-28 20:36:29.113195615 +0000 UTC m=+1.537431292 container died 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-08-28T20:36:29.695 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:29 smithi001 podman[84207]: 2024-08-28 20:36:29.533963036 +0000 UTC m=+1.958198710 container cleanup 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-28T20:36:29.695 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:29 smithi001 bash[84207]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g 2024-08-28T20:36:29.956 INFO:journalctl@ceph.mds.g.smithi001.stdout:Aug 28 20:36:29 smithi001 podman[84219]: 2024-08-28 20:36:29.693470971 +0000 UTC m=+0.566684152 container remove 890e06dc62acecf204f7ed667f4d859372d98eedfba55aa60644d272a90904e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T20:36:29.976 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-28T20:36:30.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:30.045 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-28T20:36:30.045 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-28T20:36:30.045 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.j 2024-08-28T20:36:30.227 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:30 smithi001 systemd[1]: Stopping Ceph mds.j for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:30.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j[62604]: 2024-08-28T20:36:30.499+0000 7fb7bbe00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:30.977 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:30 smithi001 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j[62604]: 2024-08-28T20:36:30.499+0000 7fb7bbe00640 -1 mds.j *** got signal Terminated *** 2024-08-28T20:36:34.857 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:34 smithi001 podman[84328]: 2024-08-28 20:36:34.520617053 +0000 UTC m=+4.188630851 container died 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-28T20:36:35.227 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:35 smithi001 podman[84328]: 2024-08-28 20:36:35.071091091 +0000 UTC m=+4.739104895 container cleanup 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-28T20:36:35.227 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:35 smithi001 bash[84328]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j 2024-08-28T20:36:35.569 INFO:journalctl@ceph.mds.j.smithi001.stdout:Aug 28 20:36:35 smithi001 podman[84354]: 2024-08-28 20:36:35.305973393 +0000 UTC m=+0.771239834 container remove 2b418594d4b1987f8ae2bba6b6260af8800c2d8742dd8924ab40c3a935159db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-28T20:36:35.579 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-28T20:36:35.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:35.650 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-28T20:36:35.650 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-28T20:36:35.650 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.b 2024-08-28T20:36:35.932 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:36:35 smithi007 systemd[1]: Stopping Ceph mds.b for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:36.206 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:36:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: 2024-08-28T20:36:35.930+0000 7fedd17ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:36.206 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:36:35 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b[55223]: 2024-08-28T20:36:35.930+0000 7fedd17ff640 -1 mds.b *** got signal Terminated *** 2024-08-28T20:36:37.315 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:36:37 smithi007 podman[61481]: 2024-08-28 20:36:37.028110919 +0000 UTC m=+1.183278380 container died 82c9b2cc727575bf125fc643921d7b11ff7a1ec56cb16c1c57250228d6aba96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-28T20:36:37.784 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:36:37 smithi007 podman[61481]: 2024-08-28 20:36:37.499184013 +0000 UTC m=+1.654351476 container cleanup 82c9b2cc727575bf125fc643921d7b11ff7a1ec56cb16c1c57250228d6aba96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-28T20:36:37.784 INFO:journalctl@ceph.mds.b.smithi007.stdout:Aug 28 20:36:37 smithi007 bash[61481]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-b 2024-08-28T20:36:37.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-28T20:36:37.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:37.953 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-28T20:36:37.953 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-28T20:36:37.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.e 2024-08-28T20:36:38.315 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:36:38 smithi007 systemd[1]: Stopping Ceph mds.e for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:38.815 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:36:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e[54605]: 2024-08-28T20:36:38.395+0000 7f145a3bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:38.815 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:36:38 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e[54605]: 2024-08-28T20:36:38.395+0000 7f145a3bb640 -1 mds.e *** got signal Terminated *** 2024-08-28T20:36:40.813 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:36:40 smithi007 podman[61616]: 2024-08-28 20:36:40.414492187 +0000 UTC m=+2.241301455 container died 03c9553a31e93f319531c9966cce67bc7fe4098edb4397c9dc9fe901e3d465f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T20:36:41.065 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:36:40 smithi007 podman[61616]: 2024-08-28 20:36:40.886340239 +0000 UTC m=+2.713149504 container cleanup 03c9553a31e93f319531c9966cce67bc7fe4098edb4397c9dc9fe901e3d465f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=) 2024-08-28T20:36:41.065 INFO:journalctl@ceph.mds.e.smithi007.stdout:Aug 28 20:36:40 smithi007 bash[61616]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-e 2024-08-28T20:36:41.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-28T20:36:41.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:41.355 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-28T20:36:41.355 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-28T20:36:41.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.h 2024-08-28T20:36:41.708 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:36:41 smithi007 systemd[1]: Stopping Ceph mds.h for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:42.065 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:36:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h[54908]: 2024-08-28T20:36:41.706+0000 7f1aff454640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:42.065 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:36:41 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h[54908]: 2024-08-28T20:36:41.706+0000 7f1aff454640 -1 mds.h *** got signal Terminated *** 2024-08-28T20:36:45.283 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:36:45 smithi007 podman[61738]: 2024-08-28 20:36:45.026479584 +0000 UTC m=+3.451697047 container died e8d292d41c0af73dd66df5b17bcff9d7f721ec17d7cbd30daa14bd5664aef593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-28T20:36:45.565 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:36:45 smithi007 podman[61738]: 2024-08-28 20:36:45.498424595 +0000 UTC m=+3.923642053 container cleanup e8d292d41c0af73dd66df5b17bcff9d7f721ec17d7cbd30daa14bd5664aef593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-28T20:36:45.565 INFO:journalctl@ceph.mds.h.smithi007.stdout:Aug 28 20:36:45 smithi007 bash[61738]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-h 2024-08-28T20:36:45.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-28T20:36:45.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:45.921 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-28T20:36:45.921 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-28T20:36:45.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.k 2024-08-28T20:36:46.065 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:36:45 smithi007 systemd[1]: Stopping Ceph mds.k for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:46.565 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:36:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k[54291]: 2024-08-28T20:36:46.226+0000 7fed9303e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:46.565 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:36:46 smithi007 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k[54291]: 2024-08-28T20:36:46.226+0000 7fed9303e640 -1 mds.k *** got signal Terminated *** 2024-08-28T20:36:50.565 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:36:50 smithi007 podman[61859]: 2024-08-28 20:36:50.234948895 +0000 UTC m=+4.099036015 container died 845cb1f731c48acfc4daef6966958587c2312d562352b418ee40a5ab0dee2152 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-28T20:36:51.061 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:36:50 smithi007 podman[61859]: 2024-08-28 20:36:50.818404149 +0000 UTC m=+4.682491271 container cleanup 845cb1f731c48acfc4daef6966958587c2312d562352b418ee40a5ab0dee2152 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T20:36:51.062 INFO:journalctl@ceph.mds.k.smithi007.stdout:Aug 28 20:36:50 smithi007 bash[61859]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-k 2024-08-28T20:36:51.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-28T20:36:51.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:51.230 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-28T20:36:51.230 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-28T20:36:51.231 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.c 2024-08-28T20:36:51.514 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:51 smithi121 systemd[1]: Stopping Ceph mds.c for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:51.769 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c[55302]: 2024-08-28T20:36:51.513+0000 7fdce0532640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:51.769 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:51 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c[55302]: 2024-08-28T20:36:51.513+0000 7fdce0532640 -1 mds.c *** got signal Terminated *** 2024-08-28T20:36:53.330 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:53 smithi121 podman[62039]: 2024-08-28 20:36:53.028275868 +0000 UTC m=+1.610683921 container died d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-08-28T20:36:53.682 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:53 smithi121 podman[62039]: 2024-08-28 20:36:53.329690099 +0000 UTC m=+1.912098149 container cleanup d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:36:53.683 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:53 smithi121 bash[62039]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c 2024-08-28T20:36:53.683 INFO:journalctl@ceph.mds.c.smithi121.stdout:Aug 28 20:36:53 smithi121 podman[62063]: 2024-08-28 20:36:53.555672957 +0000 UTC m=+0.518394719 container remove d0d7bb423f762d1346077f44efc6636d27115c3a2eabfa53f7dcb405809f7221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-c, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-28T20:36:53.697 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-28T20:36:53.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:53.733 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-28T20:36:53.734 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-28T20:36:53.734 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.f 2024-08-28T20:36:53.979 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:36:53 smithi121 systemd[1]: Stopping Ceph mds.f for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:54.479 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:36:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f[54998]: 2024-08-28T20:36:54.066+0000 7fefc4a14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:54.480 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:36:54 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f[54998]: 2024-08-28T20:36:54.066+0000 7fefc4a14640 -1 mds.f *** got signal Terminated *** 2024-08-28T20:36:57.302 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:36:57 smithi121 podman[62174]: 2024-08-28 20:36:57.028448464 +0000 UTC m=+3.081889082 container died f44e044acf3e5bdf4fe50a76b6232f7ad40b2b2f1042772f2077a2f11fa5e5b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T20:36:57.677 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:36:57 smithi121 podman[62174]: 2024-08-28 20:36:57.38299037 +0000 UTC m=+3.436430996 container cleanup f44e044acf3e5bdf4fe50a76b6232f7ad40b2b2f1042772f2077a2f11fa5e5b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-28T20:36:57.677 INFO:journalctl@ceph.mds.f.smithi121.stdout:Aug 28 20:36:57 smithi121 bash[62174]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-f 2024-08-28T20:36:57.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-28T20:36:57.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:36:57.858 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-28T20:36:57.858 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-28T20:36:57.859 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.i 2024-08-28T20:36:58.229 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:36:57 smithi121 systemd[1]: Stopping Ceph mds.i for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:36:58.229 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:36:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i[55604]: 2024-08-28T20:36:58.161+0000 7f900ee09640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:36:58.229 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:36:58 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i[55604]: 2024-08-28T20:36:58.161+0000 7f900ee09640 -1 mds.i *** got signal Terminated *** 2024-08-28T20:37:01.355 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 podman[62294]: 2024-08-28 20:37:01.029805685 +0000 UTC m=+2.954861764 container died 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-28T20:37:01.663 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 podman[62294]: 2024-08-28 20:37:01.461417487 +0000 UTC m=+3.386473566 container cleanup 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-28T20:37:01.663 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 bash[62294]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i 2024-08-28T20:37:01.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-28T20:37:01.915 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 podman[62306]: 2024-08-28 20:37:01.662701959 +0000 UTC m=+0.621216228 container remove 63312ff05b751dd73e0aec3ab3a6610e4e97292bd7a86356c1ccb4d476fd6c73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-28T20:37:01.915 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.i.service: Deactivated successfully. 2024-08-28T20:37:01.915 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 systemd[1]: Stopped Ceph mds.i for f9e93946-6578-11ef-bcd4-c7b262605968. 2024-08-28T20:37:01.915 INFO:journalctl@ceph.mds.i.smithi121.stdout:Aug 28 20:37:01 smithi121 systemd[1]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.i.service: Consumed 5.998s CPU time. 2024-08-28T20:37:01.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:37:01.926 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-28T20:37:01.926 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-28T20:37:01.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.l 2024-08-28T20:37:02.197 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:37:02 smithi121 systemd[1]: Stopping Ceph mds.l for f9e93946-6578-11ef-bcd4-c7b262605968... 2024-08-28T20:37:02.479 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:37:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l[54693]: 2024-08-28T20:37:02.356+0000 7ff808bb5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T20:37:02.479 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:37:02 smithi121 ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l[54693]: 2024-08-28T20:37:02.356+0000 7ff808bb5640 -1 mds.l *** got signal Terminated *** 2024-08-28T20:37:04.775 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:37:04 smithi121 podman[62413]: 2024-08-28 20:37:04.49225822 +0000 UTC m=+2.357574333 container died f3f7312b5c505802ec34ae3b7e0a9916890af88f65516e07a12684efcf9d709a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-28T20:37:05.083 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:37:04 smithi121 podman[62413]: 2024-08-28 20:37:04.865239409 +0000 UTC m=+2.730555511 container cleanup f3f7312b5c505802ec34ae3b7e0a9916890af88f65516e07a12684efcf9d709a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-28T20:37:05.084 INFO:journalctl@ceph.mds.l.smithi121.stdout:Aug 28 20:37:04 smithi121 bash[62413]: ceph-f9e93946-6578-11ef-bcd4-c7b262605968-mds-l 2024-08-28T20:37:05.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9e93946-6578-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-28T20:37:05.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T20:37:05.249 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-28T20:37:05.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-28T20:37:05.533 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:37:09.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-28T20:37:09.678 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:37:12.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-28T20:37:12.314 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:37:14.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:37:14.649 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:37:14.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T20:37:14.709 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-28T20:37:14.711 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi001/crash 2024-08-28T20:37:14.712 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash -- . 2024-08-28T20:37:14.785 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-28T20:37:14.785 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-08-28T20:37:14.789 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi007/crash 2024-08-28T20:37:14.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash -- . 2024-08-28T20:37:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-28T20:37:14.834 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-08-28T20:37:14.836 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi121/crash 2024-08-28T20:37:14.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash -- . 2024-08-28T20:37:14.874 INFO:teuthology.orchestra.run.smithi121.stderr:tar: /var/lib/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-28T20:37:14.875 INFO:teuthology.orchestra.run.smithi121.stderr:tar: Error is not recoverable: exiting now 2024-08-28T20:37:14.876 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-28T20:37:14.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-28T20:37:14.983 INFO:teuthology.orchestra.run.smithi001.stdout:2024-08-28T20:25:14.713995+0000 mon.a (mon.0) 1148 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:37:14.984 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-28T20:37:14.984 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[SEC\]' /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-28T20:37:15.072 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]' /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-28T20:37:15.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[WRN\]' /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-28T20:37:15.240 INFO:teuthology.orchestra.run.smithi001.stdout:2024-08-28T20:25:14.713995+0000 mon.a (mon.0) 1148 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-28T20:37:15.241 INFO:tasks.cephadm:Compressing logs... 2024-08-28T20:37:15.241 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-28T20:37:15.245 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-28T20:37:15.248 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-28T20:37:15.273 INFO:teuthology.orchestra.run.smithi121.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-28T20:37:15.273 INFO:teuthology.orchestra.run.smithi121.stderr:: No such file or directory 2024-08-28T20:37:15.273 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-28T20:37:15.274 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-28T20:37:15.274 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.c.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log 2024-08-28T20:37:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-28T20:37:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-28T20:37:15.275 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-28T20:37:15.275 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-28T20:37:15.275 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.k.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.10.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-28T20:37:15.279 INFO:teuthology.orchestra.run.smithi007.stderr: 82.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi121.stderr: 82.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.i.log: 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.c.log: 87.1% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-28T20:37:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log: 87.1% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-28T20:37:15.282 INFO:teuthology.orchestra.run.smithi121.stderr: 95.0% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-28T20:37:15.282 INFO:teuthology.orchestra.run.smithi121.stderr: 92.9% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-28T20:37:15.282 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-28T20:37:15.285 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-28T20:37:15.285 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-28T20:37:15.285 INFO:teuthology.orchestra.run.smithi007.stderr: 94.9% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-28T20:37:15.286 INFO:teuthology.orchestra.run.smithi007.stderr: 92.7% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-28T20:37:15.286 INFO:teuthology.orchestra.run.smithi007.stderr: 94.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-28T20:37:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-28T20:37:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-28T20:37:15.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-28T20:37:15.288 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-28T20:37:15.289 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.1.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-28T20:37:15.289 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-28T20:37:15.289 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.7.log: 90.4% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-28T20:37:15.292 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-28T20:37:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-28T20:37:15.295 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.4.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.11.log: 90.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-28T20:37:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-28T20:37:15.297 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-28T20:37:15.298 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log 2024-08-28T20:37:15.299 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-28T20:37:15.300 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-28T20:37:15.301 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-28T20:37:15.302 INFO:teuthology.orchestra.run.smithi001.stderr: 82.3% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-28T20:37:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.0.log: 87.1% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-28T20:37:15.303 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-28T20:37:15.304 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-28T20:37:15.304 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-28T20:37:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-28T20:37:15.306 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.j.log: 94.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-28T20:37:15.307 INFO:teuthology.orchestra.run.smithi001.stderr: 94.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-28T20:37:15.307 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-28T20:37:15.308 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-28T20:37:15.310 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-28T20:37:15.317 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log: gzip 94.7% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-28T20:37:15.317 INFO:teuthology.orchestra.run.smithi001.stderr: -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-28T20:37:15.317 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.5.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-28T20:37:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-28T20:37:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.9.log: /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.a.log: 90.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-28T20:37:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-28T20:37:15.327 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/cephadm.log: 90.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-28T20:37:15.333 INFO:teuthology.orchestra.run.smithi001.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-28T20:37:15.532 INFO:teuthology.orchestra.run.smithi121.stderr: 93.4% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-28T20:37:15.605 INFO:teuthology.orchestra.run.smithi121.stderr: 94.1% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-28T20:37:15.655 INFO:teuthology.orchestra.run.smithi001.stderr: 90.4% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-28T20:37:15.717 INFO:teuthology.orchestra.run.smithi007.stderr: 94.0% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-28T20:37:15.859 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-28T20:37:15.882 INFO:teuthology.orchestra.run.smithi007.stderr: 91.7% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-28T20:37:16.519 INFO:teuthology.orchestra.run.smithi001.stderr: 90.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-28T20:37:17.053 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-28T20:37:17.839 INFO:teuthology.orchestra.run.smithi007.stderr: 93.7% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-28T20:37:18.675 INFO:teuthology.orchestra.run.smithi001.stderr: 93.6% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-28T20:37:29.451 INFO:teuthology.orchestra.run.smithi001.stderr: 93.7% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-28T20:37:30.325 INFO:teuthology.orchestra.run.smithi007.stderr: 94.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-28T20:37:31.414 INFO:teuthology.orchestra.run.smithi121.stderr: 94.1% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-28T20:37:32.719 INFO:teuthology.orchestra.run.smithi121.stderr: 94.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-28T20:37:34.421 INFO:teuthology.orchestra.run.smithi007.stderr: 94.3% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-28T20:37:36.197 INFO:teuthology.orchestra.run.smithi001.stderr: 93.9% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-28T20:37:36.205 INFO:teuthology.orchestra.run.smithi007.stderr: 93.9% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-28T20:37:36.770 INFO:teuthology.orchestra.run.smithi121.stderr: 93.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-28T20:37:36.891 INFO:teuthology.orchestra.run.smithi007.stderr: 94.3% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-28T20:37:36.893 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-08-28T20:37:36.893 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m21.630s 2024-08-28T20:37:36.893 INFO:teuthology.orchestra.run.smithi007.stderr:user 1m17.574s 2024-08-28T20:37:36.893 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m2.640s 2024-08-28T20:37:39.513 INFO:teuthology.orchestra.run.smithi001.stderr: 94.2% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-28T20:37:40.346 INFO:teuthology.orchestra.run.smithi121.stderr: 94.0% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-28T20:37:40.347 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-08-28T20:37:40.348 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m25.085s 2024-08-28T20:37:40.348 INFO:teuthology.orchestra.run.smithi121.stderr:user 1m19.974s 2024-08-28T20:37:40.348 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m2.979s 2024-08-28T20:37:44.670 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/f9e93946-6578-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-28T20:37:44.674 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-08-28T20:37:44.674 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m29.400s 2024-08-28T20:37:44.674 INFO:teuthology.orchestra.run.smithi001.stderr:user 1m26.085s 2024-08-28T20:37:44.674 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m7.468s 2024-08-28T20:37:44.675 INFO:tasks.cephadm:Archiving logs... 2024-08-28T20:37:44.675 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi001/log 2024-08-28T20:37:44.676 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-28T20:37:56.395 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi007/log 2024-08-28T20:37:56.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-28T20:38:08.473 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi121/log 2024-08-28T20:38:08.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-28T20:38:19.653 INFO:tasks.cephadm:Removing cluster... 2024-08-28T20:38:19.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --force 2024-08-28T20:38:19.939 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:38:20.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --force 2024-08-28T20:38:20.894 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:38:21.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9e93946-6578-11ef-bcd4-c7b262605968 --force 2024-08-28T20:38:21.432 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: f9e93946-6578-11ef-bcd4-c7b262605968 2024-08-28T20:38:21.904 INFO:tasks.cephadm:Removing cephadm ... 2024-08-28T20:38:21.904 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-28T20:38:21.944 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-28T20:38:21.963 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-28T20:38:21.979 INFO:tasks.cephadm:Teardown complete 2024-08-28T20:38:21.979 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-28T20:38:21.989 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-28T20:38:21.989 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-28T20:38:21.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-28T20:38:22.006 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-28T20:38:22.121 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-28T20:38:22.131 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-28T20:38:22.132 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T20:38:22.136 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T20:38:22.139 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T20:38:22.153 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-08-28T20:38:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-08-28T20:38:22.161 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T20:38:22.161 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 -5264ns[ +13us] +/- 48ms 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -378us[ -378us] +/- 54ms 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +632us[ +632us] +/- 79ms 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -13us[+8927ns] +/- 48ms 2024-08-28T20:38:22.162 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -386us[ -364us] +/- 54ms 2024-08-28T20:38:22.163 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +621us[ +643us] +/- 79ms 2024-08-28T20:38:22.163 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:38:22.169 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-08-28T20:38:22.177 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T20:38:22.177 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-08-28T20:38:22.177 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +15us[ +10us] +/- 48ms 2024-08-28T20:38:22.178 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -350us[ -355us] +/- 54ms 2024-08-28T20:38:22.178 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +653us[ +648us] +/- 79ms 2024-08-28T20:38:22.178 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T20:38:22.179 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-28T20:38:22.188 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-28T20:38:22.189 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-28T20:38:22.212 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-28T20:38:22.335 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-28T20:38:22.441 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-28T20:38:22.495 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T20:38:22.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:38:22.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T20:38:22.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:38:22.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T20:38:22.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:38:22.618 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-28T20:38:22.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-28T20:38:22.902 INFO:teuthology.task.internal:Duration was 2245.102361 seconds 2024-08-28T20:38:22.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-28T20:38:22.983 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-28T20:38:22.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-28T20:38:22.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-28T20:38:22.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-28T20:38:23.030 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T20:38:23.033 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T20:38:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T20:38:23.561 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-28T20:38:23.561 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-08-28T20:38:23.562 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-28T20:38:23.614 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-08-28T20:38:23.614 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-28T20:38:23.650 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-08-28T20:38:23.650 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-28T20:38:23.692 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-28T20:38:23.693 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-28T20:38:23.697 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-28T20:38:23.699 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-28T20:38:23.762 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-28T20:38:23.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-28T20:38:23.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-28T20:38:23.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-28T20:38:24.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-28T20:38:24.286 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-28T20:38:24.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-28T20:38:24.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-28T20:38:24.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-28T20:38:24.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-28T20:38:24.406 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-28T20:38:24.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-28T20:38:24.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-28T20:38:24.435 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-08-28T20:38:24.460 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-08-28T20:38:24.477 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-08-28T20:38:24.507 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-28T20:38:24.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:38:24.541 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-28T20:38:24.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:38:24.556 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-28T20:38:24.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T20:38:24.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-28T20:38:24.582 INFO:teuthology.task.internal:Transferring archived files... 2024-08-28T20:38:24.583 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi001 2024-08-28T20:38:24.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-28T20:38:24.654 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi007 2024-08-28T20:38:24.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-28T20:38:24.688 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877790/remote/smithi121 2024-08-28T20:38:24.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-28T20:38:24.721 INFO:teuthology.task.internal:Removing archive directory... 2024-08-28T20:38:24.721 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-28T20:38:24.725 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-28T20:38:24.728 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-28T20:38:24.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-28T20:38:24.783 INFO:teuthology.task.internal:Not uploading archives. 2024-08-28T20:38:24.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-28T20:38:24.819 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-28T20:38:24.820 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-28T20:38:24.824 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-28T20:38:24.827 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-28T20:38:24.840 INFO:teuthology.orchestra.run.smithi007.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 28 20:38 /home/ubuntu/cephtest 2024-08-28T20:38:24.841 INFO:teuthology.orchestra.run.smithi121.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 28 20:38 /home/ubuntu/cephtest 2024-08-28T20:38:24.855 INFO:teuthology.orchestra.run.smithi001.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 28 20:38 /home/ubuntu/cephtest 2024-08-28T20:38:24.857 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-28T20:38:24.875 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-28T20:38:24.951 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} duration: 2245.1023609638214 failure_reason: '"2024-08-28T20:25:14.713995+0000 mon.a (mon.0) 1148 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_mchangir@teuthology success: false 2024-08-28T20:38:24.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-28T20:38:25.044 INFO:teuthology.run:FAIL